Compile a TVM Model
Call function.run(action="compile", ...) with the target settings. The Run uses
function.ir_model unless you set model_path explicitly.
Parameters
| Name | Type | Required | Description |
|---|---|---|---|
| action | str | ✓ | Action to execute. Must be compile. |
| volumes | list[dict] | List of volumes. | |
| resources | dict | Resource values with optional cpu, mem, gpu, and disk keys. |
|
| envs | list[dict] | Environment variables. | |
| secrets | list[str] | List of secret names. | |
| profile | str | Scheduling/resource profile; does not select the model target. | |
| model_path | str | Optional IR override; otherwise uses function.ir_model. |
|
| target_architecture | str | Profile from CORE's YAML catalogue; default auto. See target architectures. |
|
| target | dict | Explicit standard LLVM target object; omit target_architecture or set it to auto. The separate profile can still select scheduling/resources. |
|
| optimization | dict | Compiler settings described below. | |
| tuning | dict | MetaSchedule settings described below; mode defaults to off. |
|
| tag | str | Model suffix <function>-<tag>; default so. |
|
| image | str | Toolkit image override for this Run. | |
| inputs | dict[str, str] | Consumed entity keys for lineage, not inference tensor values. |
TVM options belong to the Run. Reusable Tasks contain only common infrastructure settings, for example:
Example
run = function.run(
action="compile",
target_architecture="amd64",
optimization={"opt_level": 3},
wait=True,
)
Optimization settings
These fields go inside optimization. Flat keyword arguments are also accepted;
explicit grouped values take precedence.
| Field | Default | Meaning |
|---|---|---|
target_num_cores |
Job CPU request, rounded up | Cores used to optimize the target. This field wins over the CPU request; both override preset num-cores. |
opt_level |
3 |
TVM optimization level, 0–3. |
cross_cc |
profile default | C++ compiler linking model.so. |
cross_cc_options |
profile defaults | Separate compiler arguments; e.g. ["--sysroot=/opt/sysroots/arm64"]. An explicit [] clears profile arguments. |
exec_mode |
bytecode |
Relax VM bytecode or compiled graph execution. |
relax_pipeline, tir_pipeline |
default |
Standard TVM pipeline names. |
benchmark_runs |
10 |
Timed inferences on a compatible compile host; 0 disables them. |
system_lib |
false |
System-library mode; not loadable by the Go/Rust serve images. |
params_path |
IR params.bin |
Optional weights path inside the compile container. |
Tuning settings
Use tuning={"tuning_mode": "off"} to compile without tuning. Inactive values are
preserved but not applied. apply needs tuning_model_path; tune needs a positive
tuning_trials budget. Databases must match the model, effective target and TVM build.
run = function.run(
"compile",
target_architecture="amd64_native",
optimization={"target_num_cores": 4},
resources={"cpu": "4", "mem": "8Gi"},
tuning={"tuning_mode": "tune", "tuning_trials": 8000, "tuning_runner": "local"},
wait=True,
)
All tuning fields use the same names/defaults as the complete CORE tuning reference:
| Purpose | Fields |
|---|---|
| Search and coverage | tuning_mode, tuning_model_path, tuning_trials, max_trials_per_task, tuning_trials_per_iter, tuning_ops, allow_partial_tuning |
| Measurements | tuning_runner, tuning_workers, tuning_seed, tuning_number, tuning_repeat, tuning_min_repeat_ms, tuning_alloc_repeat, tuning_enable_cpu_cache_flush |
| Timeouts | tuning_builder_timeout_sec, tuning_runner_timeout_sec |
| RPC | rpc_tracker_host, rpc_tracker_port, rpc_tracker_key, rpc_session_timeout_sec |
RPC fields are active only for tuning_mode="tune" with tuning_runner="rpc".
That mode ignores tuning_runner_timeout_sec and uses rpc_session_timeout_sec.
apply uses only the database/filter/coverage settings; off ignores all tuning fields.
Local tuning checks the actual compile host, not the presence of cross_cc.
For an incompatible target, measure on an RPC device or apply an existing database.
Explicit target
run = function.run(
"compile",
target={"kind": "llvm", "mtriple": "aarch64-linux-gnu", "mcpu": "cortex-a72"},
optimization={"cross_cc": "aarch64-linux-gnu-g++"},
wait=True,
)
The target uses standard TVM keys. Do not combine it with a non-auto
target_architecture; it does not inherit preset linker settings. The separate
profile still chooses platform scheduling and resources.
The compiled metadata records the resolved
target and, when different, target_requested. The latter is not a Run option. The selected image must contain the matching
LLVM backend, compiler and libraries. Adding a target does not add a serving image,
and this pipeline does not enable GPU/CUDA execution.