Commit 39df741
docs(vram): note that the two-phase scratch is opportunistic
The per-tier floors are derived ballasted, so they are what a card AT its
floor uses. On a roomy card the same tier reads higher in nvidia-smi,
because the T2/T3 two-phase match scratch is only taken when there is
room: compact measures 5228 MB ballasted to its floor (model 5200,
two-phase 0) and 6012 MB on an idle 24 GB card (model 5200, two-phase
780). Nothing was wrong with the floors — I misread the big-card figure
as the requirement and had to ballast the card to tell the two apart, so
the difference is worth one paragraph.
Measured at k=28 on sm_89: two-phase is 780 MB on plain and compact,
1170 on minimal, 0 on tiny. A run at 5399 MiB free (~5009 after context,
under the 5328 declared) does OOM, which is the floor being real rather
than conservative.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>1 parent 98b7de1 commit 39df741
1 file changed
Lines changed: 8 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
124 | 124 | | |
125 | 125 | | |
126 | 126 | | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
127 | 135 | | |
128 | 136 | | |
129 | 137 | | |
| |||
0 commit comments