Skip to content

Commit 39df741

Browse files
Abraham Sewillclaude
andcommitted
docs(vram): note that the two-phase scratch is opportunistic
The per-tier floors are derived ballasted, so they are what a card AT its floor uses. On a roomy card the same tier reads higher in nvidia-smi, because the T2/T3 two-phase match scratch is only taken when there is room: compact measures 5228 MB ballasted to its floor (model 5200, two-phase 0) and 6012 MB on an idle 24 GB card (model 5200, two-phase 780). Nothing was wrong with the floors — I misread the big-card figure as the requirement and had to ballast the card to tell the two apart, so the difference is worth one paragraph. Measured at k=28 on sm_89: two-phase is 780 MB on plain and compact, 1170 on minimal, 0 on tiny. A run at 5399 MiB free (~5009 after context, under the 5328 declared) does OOM, which is the floor being real rather than conservative. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
1 parent 98b7de1 commit 39df741

1 file changed

Lines changed: 8 additions & 0 deletions

File tree

README.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -124,6 +124,14 @@ native Windows or a non-WSL setup, jump to [Windows](#windows).
124124
pinned come in *under* their models). If the GPU also drives a desktop
125125
and you see mid-plot OOMs, raise it with `POS2GPU_VRAM_MARGIN_MB`.
126126

127+
Those are floor figures, so **a roomy card will show more in
128+
`nvidia-smi` for the same tier** — the T2/T3 two-phase match scratch is
129+
taken only when there is room for it (at k=28: 780 MB on plain and
130+
compact, 1170 MB on minimal, none on tiny). Compact measures 5228 MB
131+
ballasted to its floor and 6012 MB on an idle 24 GB card. Each run's
132+
`vram:` line splits the total as `model + two-phase + margin`, so the
133+
extra is visible as headroom in use rather than a larger requirement.
134+
127135
`xchplot2 bench` samples the driver's counter for the whole run, fails
128136
if a path exceeds what it declared, and warns if a path declares far
129137
more than it uses (an over-declared model quietly denies the path to

0 commit comments

Comments
 (0)