perf(glm): add GLM-5.2 GB200 debugging proxy recipes - #5095
Conversation
Signed-off-by: yaoyu-33 <yaoyu.094@gmail.com>
Signed-off-by: yaoyu-33 <yaoyu.094@gmail.com>
|
line1 |
|
Light review — LGTM with minor notes The two new GB200 GLM-5.2 50B dense-equivalent proxy recipes ( Minor, non-blocking:
Suggested test cases There is no
|
What does this PR do ?
Add canonical 8-GPU GB200 BF16 and MXFP8 dense-equivalent performance proxy recipes for GLM-5.2, plus verified MXFP8 results in the model verification card. This PR is stacked on #5034.
The proxy is deliberately not train-equivalent GLM-5.2: it uses 18 layers, 64 experts, mock data, forced router balancing, DSA indexer top-k 512, and zero indexer-loss coefficient. The public recipe and card state this limitation explicitly.
Changelog
Performance
GitHub Actions CI
See the CI section in the Contributing doc for how to trigger the CI. A Nvidia developer will need to approve and trigger the CI for external contributors.
Before your PR is Ready for review
Pre checks:
Validation:
uv run python -m pytest tests/unit_tests/recipes/test_glm5_perf_recipes.py— 10 passed.uv run --no-project --with pyyaml python skills/create-model-verification-card/scripts/validate_card.py examples/model_verification_cards/glm5-2/card.yaml— passed.uv run --no-project --with pre-commit pre-commit run --all-files— passed.Additional Information