Skip to content

Commit 549fb1b

Browse files
chunfangamdfunctionstackx
authored andcommitted
Update the vLLM external router container
vllm/vllm-router only retains ~16 recent nightlies on Docker Hub; older dated tags are garbage-collected (manifest unknown), which makes `docker run` fail with exit 125 on any node that has not already cached the image.
1 parent 666cc73 commit 549fb1b

1 file changed

Lines changed: 4 additions & 2 deletions

File tree

benchmarks/multi_node/amd_utils/job.slurm

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -315,8 +315,10 @@ export IS_MULTINODE="${IS_MULTINODE:-false}"
315315
SANITIZED_USER=$(echo "$USER_NAME" | tr -c 'a-zA-Z0-9_.-' '_')
316316
export DOCKER_CONT_NAME="container_${ENGINE}_${SANITIZED_USER}_${MODEL_NAME}_${SLURM_JOB_ID}"
317317

318-
# vLLM external router container
319-
VLLM_ROUTER_IMAGE="${VLLM_ROUTER_IMAGE:-vllm/vllm-router:nightly-20260603-e667ebb}"
318+
# vLLM external router container.
319+
# NOTE: vllm/vllm-router only retains ~16 recent nightlies on Docker Hub; older
320+
# dated tags are garbage-collected (manifest unknown)
321+
VLLM_ROUTER_IMAGE="${VLLM_ROUTER_IMAGE:-vllm/vllm-router:nightly-20260617-e667ebb}"
320322
ROUTER_CONT_NAME="router_vllm_${SANITIZED_USER}_${SLURM_JOB_ID}"
321323
export RUN_FILE_FULL="$WS_PATH/${RUN_FILE}"
322324

0 commit comments

Comments
 (0)