Skip to content

perf(gqa): template the sliding window out of the no-window v5 prefill path (-494 ms TTFT) - #623

Open
BoarQing wants to merge 1 commit into
perf/gqa-flash-prefill-windowfrom
perf/gqa-v5-window-template
Open

perf(gqa): template the sliding window out of the no-window v5 prefill path (-494 ms TTFT)#623
BoarQing wants to merge 1 commit into
perf/gqa-flash-prefill-windowfrom
perf/gqa-v5-window-template

perf(gqa): template the sliding window out of the v5 prefill kernel

9615d03
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar