Use a TVM Serving Run
Refresh the Run and inspect its status until the service is ready.
run.status.service describes the Kubernetes service. run.status.inference_v2
contains model, baseUrl, inferenceUrl, modelMetadataUrl, modelReadinessUrl,
readinessUrl and livenessUrl. The model name is served_name, otherwise the
Function name. Read metadata before constructing an inference tensor.
Use the metadata datatype and a concrete shape consistent with its rank and static
dimensions; send exactly the number of values implied by that shape. Go 0.26.0-r3
and Rust 0.26.0-r2 reject incompatible tensors with HTTP 400 or gRPC
INVALID_ARGUMENT, while preserving positional input matching when names do not
all match. Older images may behave differently; see the
input validation guide
for image versions, numeric limits and gRPC encoding rules.
The default service URL is internal to Kubernetes. Use dhcli port-forward to
call REST from your computer; a browser cannot resolve a cluster-only hostname
by itself. See the inference tutorial.