Examples
import digitalhub as dh
project = dh.get_or_create_project("my-project")
model = project.log_onnx(name="mobilenet", source="mobilenet.onnx")
function = project.new_function(
name="mobilenet",
kind="tvm",
model=model.key,
format="onnx",
)
build = function.run(
action="build",
wait=True,
)
compile_run = function.run(
action="compile",
target_architecture="auto",
optimization={"opt_level": 3},
tuning={"tuning_mode": "off"},
resources={"cpu": "4", "mem": "8Gi"},
wait=True,
)
serve = function.run(
action="serve",
served_name="mobilenet",
replicas=1,
resources={"cpu": "4", "mem": "2Gi"},
wait=True,
)
CORE updates the function's ir_model and so_model after successful runs. The next
action uses those references unless you explicitly set model_path.
TVM options belong to the Run; Task settings cover resources, profiles and volumes.
Explicit CPU target
Profile names come from CORE's runtime-tvm.yaml. Instead of selecting a profile,
an advanced run can provide the target directly:
compile_run = function.run(
"compile",
target={"kind": "llvm", "mtriple": "aarch64-linux-gnu", "mcpu": "cortex-a72"},
optimization={"cross_cc": "aarch64-linux-gnu-g++"},
wait=True,
)
Set the optional profile to choose a platform node, independently of this target.
The compiler must exist in the selected compile image. See the
compile reference for tuning and toolchain options.
Tutorials
Find additional examples in the tutorial repository of the DSLab GitHub organization.