Dflash optimized - #49

Merged

benchislett merged 15 commits into

dflash-attempt2from

dflash-optimized-rebase

Mar 19, 2026

Commits on Mar 19, 2026

optimize dflash using customop
benchislett
committed
aa22078
aggressive optimization
benchislett
committed
7a606d4
leverage some torch.compile
benchislett
committed
282ccde
optimize with triton kernel
benchislett
committed
7478a30
remove customop and store context states directly into KV cache
benchislett
committed
a5428ce
async scheduling support
benchislett
committed
7324cf4
fix qwen3-next aux hidden states
benchislett
committed
1918dd1
don't need to add humaneval here
benchislett
committed
cf7aa25
Apply suggestion from @benchislett
benchislett
authored
af2a7d7
better documentation in qwen3_dflash.py
benchislett
committed
d73f3e2
Remove redundant comment
benchislett
authored
7e05c1d
remove fc_extras
benchislett
committed
8053ea2
remove redundant comment
benchislett
authored
5260a24
Remove redundant comment
benchislett
authored
d43462c
test for dflash prepare inputs
benchislett
committed
eac3d63