Skip to content

[Task][Megatron] 3.4: Performance benchmark suite #261

Description

@lvyufeng

Parent Issue

Part of #206 — Megatron Roadmap, Phase 3 (Megatron Core Execution MVP): Task 3.4

Description

Benchmark step time, communication overlap, and scalability on NPU.

Requirements

  • Per-step time breakdown (compute, communication, overlap)
  • Scaling efficiency across NPU counts (2, 4, 8)
  • Communication-computation overlap measurement
  • Memory usage per rank
  • Comparison against torch_npu + Megatron baseline
  • Reproducible benchmark scripts

Blocked By

Blocks

  • Performance optimization roadmap

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions