Skip to content

Commit 01ee939

Browse files
committed
docs(inference): clarify NIM startup wait duration
Signed-off-by: Carlos Villela <cvillela@nvidia.com>
1 parent 4fdf203 commit 01ee939

2 files changed

Lines changed: 3 additions & 3 deletions

File tree

docs/inference/use-local-inference.mdx

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -376,7 +376,7 @@ NEMOCLAW_EXPERIMENTAL=1 $$nemoclaw onboard
376376

377377
Select **Local NVIDIA NIM [experimental]** from the provider list.
378378
NemoClaw filters available models by GPU VRAM, pulls the NIM container image, starts it, and waits for it to become healthy before continuing.
379-
The managed NIM startup health wait defaults to 900 seconds so first-time checkpoint loads on systems such as DGX Spark can finish before onboard falls back to another provider.
379+
The managed NIM startup health wait defaults to 15 minutes (900 seconds) so first-time checkpoint loads on systems such as DGX Spark can finish before onboard falls back to another provider.
380380
On hosts with mixed NVIDIA GPU models, the preflight summary shows each detected GPU model and the total VRAM so you can confirm which device class the model selection used.
381381

382382
NVIDIA hosts NIM container images on `nvcr.io`, and `docker pull` requires NGC registry authentication.
@@ -418,7 +418,7 @@ NemoClaw bakes this setting into the sandbox at build time.
418418
Changing it after onboarding requires re-running `$$nemoclaw onboard`.
419419

420420
`NEMOCLAW_LOCAL_INFERENCE_TIMEOUT` only governs the inference-server validation probe.
421-
The managed NIM startup health wait uses its own 900-second default and still exits early if the container stops before it becomes healthy.
421+
The managed NIM startup health wait uses its own 15-minute (900-second) default and still exits early if the container stops before it becomes healthy.
422422
During local Ollama setup, NemoClaw treats host-side curl process timeouts as retryable probe failures and retries with a larger timeout before it reports a validation failure.
423423
NemoClaw also retries Docker runtime detection with a longer `docker info` timeout before it chooses the local inference route.
424424
The post-create readiness wait (image build, gateway upload, in-sandbox boot) has its own budget, `NEMOCLAW_SANDBOX_READY_TIMEOUT`, also defaulting to 180 seconds.

docs/reference/troubleshooting.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -674,7 +674,7 @@ For auth, export `AWS_BEARER_TOKEN_BEDROCK`, `AWS_PROFILE`, or standard IAM envi
674674
Region errors usually mean the pasted endpoint region, `AWS_REGION`, `AWS_DEFAULT_REGION`, or the model/inference profile ID do not match.
675675

676676
For Ollama, vLLM, NIM, and compatible-endpoint inference validation, the default timeout is 180 seconds.
677-
The managed NIM startup health wait uses a separate 900-second default and still exits early if the container stops before it becomes healthy.
677+
The managed NIM startup health wait uses a separate 15-minute (900-second) default and still exits early if the container stops before it becomes healthy.
678678
If large prompts still cause timeouts, increase it with `NEMOCLAW_LOCAL_INFERENCE_TIMEOUT` before re-running onboard:
679679

680680
```bash

0 commit comments

Comments
 (0)