Skip to content

TVM Serve

Use the serve action to deploy a compiled TVM model.so as a service on Kubernetes.

What the action does

The Run uses function.so_model unless it supplies model_path. Configure the served model name, replicas and workers on the Run; reusable Tasks contain common infrastructure settings.

  • Create


    Use the TVM Function created for the build action.

  • Run


    Deploy a compiled model and configure the service.

  • Use


    Check readiness and inspect the service endpoint.