Skip to content

Create a vLLM Speech Function

Define the Function with the speech model source URL.

Parameters

Name Type Required Description
project str (✓) Project name. Required only when creating from the library; otherwise MUST NOT be set.
name str ✓ Name that identifies the object.
kind str ✓ Function kind. Must be vllmserve-speech.
uuid str Object ID in UUID4 format.
description str Description of the object.
labels list[str] List of labels.
embedded bool Whether to embed the object in the project.
model_name str Name of the model.
image str Docker image used to serve the model.
url str Model source URL.
adapters list[dict] List of model adapters.

Adapters

Adapters are a list of dictionaries with name and url keys:

adapters = [{"name": "adapter-name", "url": "adapter-url"}]

Example

function = dh.new_function(
    name="my-vllm-speech-service",
    kind="vllmserve-speech",
    url="s3://my-bucket/path-to-model"
)