Skip to content

perf: route low-token qwen3 decode through optimized nz quantmatmul. - #2248

Draft
maojunx99 wants to merge 3 commits into
xLLM-AI:mainfrom
maojunx99:perf/qwen3vl-decode-nofusion
Draft

perf: route low-token qwen3 decode through optimized nz quantmatmul.#2248
maojunx99 wants to merge 3 commits into
xLLM-AI:mainfrom
maojunx99:perf/qwen3vl-decode-nofusion

perf: specialize quantized decode shapes

850b877
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs