Skip to content

[SDK] Document in-place replica scaling in create examples - #149

Merged
michaelshin merged 1 commit into
mainfrom
mshin/examples-in-place-replica-scale
Aug 19, 2026
Merged

[SDK] Document in-place replica scaling in create examples#149
michaelshin merged 1 commit into
mainfrom
mshin/examples-in-place-replica-scale

Conversation

@michaelshin

@michaelshin michaelshin commented Aug 18, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Add commented scale snippets to Inference, vLLM, CServe, and Dynamo create examples showing how to change only min_replicas / max_replicas via update_*.
  • Document that those replica-only updates reuse the selected revision (no new revision_number / no rolling update), matching platform PR https://github.com/CentML/platform/pull/4218.

Show how Inference/CServe/Dynamo updates that only change min/max
replicas reuse the selected revision without a rolling update.
@michaelshin
michaelshin merged commit 17c38b8 into main Aug 19, 2026
5 checks passed
@michaelshin
michaelshin deleted the mshin/examples-in-place-replica-scale branch August 19, 2026 18:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants