Run an OpenInference Service
Call function.run(action="serve", ...) to deploy the inference function.
Task and run parameters
| Name | Type | Required | Description |
|---|---|---|---|
| action | str | ✓ | Action to execute. Must be serve. |
| volumes | list[dict] | List of volumes. | |
| resources | dict | Resource values with optional cpu, mem, gpu, and disk keys. |
|
| envs | list[dict] | Environment variables. | |
| secrets | list[str] | List of secret names. | |
| profile | str | Profile template. | |
| replicas | int | Number of service replicas. | |
| service_type | str | Kubernetes service type. | |
| service_name | str | Name assigned to the created service. | |
| init_parameters | dict | Values supplied to the init function. |