Skip to content

opencl: add q4_0 MoE GEMM for Adreno #22731

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
lhez merged 6 commits into from
May 8, 2026
Merged

opencl: add q4_0 MoE GEMM for Adreno #22731

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
f711091
Q4_0 MoE CLC pass sanity check
shawngu-quic Apr 22, 2026
711b2ef
release program
shawngu-quic May 4, 2026
9077ce1
opencl: fix whitespace
lhez May 6, 2026
844e1d5
opencl: remove unused cl_program
lhez May 6, 2026
d2e57a6
opencl: break #if block to make it more clear
lhez May 6, 2026
597e1b0
opencl: adjust format
lhez May 7, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions ggml/src/ggml-opencl/CMakeLists.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -102,6 +102,8 @@ set(GGML_OPENCL_KERNELS
mul_mv_id_q8_0_f32_flat
mul_mv_id_mxfp4_f32
mul_mv_id_mxfp4_f32_flat
gemm_moe_q4_0_f32_ns
gemv_moe_q4_0_f32_ns
gemm_moe_mxfp4_f32
gemv_moe_mxfp4_f32
gemm_moe_mxfp4_f32_ns
Expand Down
Loading