Commit a82a006
smoke: shrink to mb_mult=4 (matches first working 50M smoke)
Previous cluster smoke OOM'd at startup despite nw=4. Reducing:
--mem 48GB → 64GB (more CPU headroom)
--train.minibatch-multiplier 25 → 4 (minibatch 20100 → 3216, 6x less GPU memory)
--train.max-minibatch-size 20100 → 3216
--train.total-timesteps 5M → 2M (finish faster)
--time 30min → 20min
This matches the config of the first 50M smoke on the vast box that
ran cleanly end-to-end. If THIS still OOMs, the issue is cluster
container limits, not our minibatch sizing.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>1 parent a379013 commit a82a006
1 file changed
Lines changed: 5 additions & 5 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
5 | | - | |
6 | | - | |
| 5 | + | |
| 6 | + | |
7 | 7 | | |
8 | 8 | | |
9 | 9 | | |
| |||
35 | 35 | | |
36 | 36 | | |
37 | 37 | | |
38 | | - | |
39 | | - | |
| 38 | + | |
| 39 | + | |
40 | 40 | | |
41 | 41 | | |
42 | 42 | | |
43 | 43 | | |
44 | | - | |
| 44 | + | |
45 | 45 | | |
46 | 46 | | |
47 | 47 | | |
| |||
0 commit comments