docker model start-runner

内容説明Start Docker Model Runner (Docker Engine only)
利用方法docker model start-runner

内容説明

This command starts the Docker Model Runner without pulling container images. Use this command to start the runner when you already have the required images locally.

For the first-time setup or to ensure you have the latest images, use docker model install-runner instead.

オプション

オプションデフォルト内容説明
--backendSpecify backend (llama.cpp|vllm). Default: llama.cpp
--debugEnable debug logging
--do-not-trackDo not track models usage in Docker Model Runner
--gpuautoSpecify GPU support (none|auto|cuda|rocm|musa|cann)
--portDocker container port for Docker Model Runner (default: 12434 for Docker Engine, 12435 for Cloud mode)