Skip to content

RDNA3.5 (gfx11 / gfx1151) MMQ prefill optimizations #32

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
liangliangchang wants to merge 23 commits into
base: gfx11
Choose a base branch
from
+608 −30
Open

RDNA3.5 (gfx11 / gfx1151) MMQ prefill optimizations #32

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
377f11e
Improve RDNA3.5 MMQ occupancy, LDS layout, and activation pipelining
liangliangchang Jul 9, 2026
c728c65
Improve RDNA3.5 Q4_K MMQ dequant/vec_dot and add phase profiling
liangliangchang Jul 9, 2026
f2c161e
cuda: optimize RDNA3.5 tiny-M MMQ for gate Q8_0 prefill
liangliangchang Jul 9, 2026
a0d7e61
Improve RDNA3.5 Q6_K MMQ prefill and narrow-N tile sizing
liangliangchang Jul 9, 2026
7483e49
cuda: fix RDNA3.5 MMQ codegen regression after profiling cleanup
liangliangchang Jul 9, 2026
a907526
Fix Q6_K B-tile prefetch using wrong K offset in vec_dot
liangliangchang Jul 10, 2026
501ba43
Improve RDNA3.5 MMQ occupancy, LDS layout, and activation pipelining
liangliangchang Jul 9, 2026
3b0a5a7
Improve RDNA3.5 Q4_K MMQ dequant/vec_dot and add phase profiling
liangliangchang Jul 9, 2026
d590354
cuda: optimize RDNA3.5 tiny-M MMQ for gate Q8_0 prefill
liangliangchang Jul 9, 2026
ae65d07
Improve RDNA3.5 Q6_K MMQ prefill and narrow-N tile sizing
liangliangchang Jul 9, 2026
05f28d2
cuda: fix RDNA3.5 MMQ codegen regression after profiling cleanup
liangliangchang Jul 9, 2026
74503ef
Fix Q6_K B-tile prefetch using wrong K offset in vec_dot
liangliangchang Jul 10, 2026
c9bbb21
Merge branch 'lichang.mmq_opt' of https://github.com/liangliangchang/…
liangliangchang Jul 14, 2026
01637a8
Merge latest rocm/gfx11 into lichang.mmq_opt
liangliangchang Jul 14, 2026
cb01a99
Merge branch 'gfx11' of rocm/llama.cpp into lichang.mmq_opt
liangliangchang Jul 20, 2026
c12b327
test: add RDNA3.5 MMQ prefill kernel cases for PR #32.
liangliangchang Jul 20, 2026
c1594c8
fix(hip): restore Q4_0 MMQ vec_dot at mmq_x<=32 on RDNA3.5
liangliangchang Jul 20, 2026
effc3ca
fix(hip): RDNA3.5 MMQ vec_dot accuracy and Q4_K MTP-safe path
liangliangchang Jul 21, 2026
a2d70ae
test: dedupe RDNA3.5 MMQ prefill cases in test-backend-ops
liangliangchang Jul 21, 2026
81ab3f4
refactor(hip): drop q4k_legacy flags from MMQ host tile policy
liangliangchang Jul 21, 2026
68bbe93
fix(hip): drop RDNA3.5 activation B-pipeline that regressed MTP accept.
liangliangchang Jul 21, 2026
cf31ddd
fix(hip): restore RDNA3.5 activation B-pipeline without MTP regression.
liangliangchang Jul 21, 2026
a610b9c
fix(hip): tune RDNA3.5 MMQ tile policy for Q4_K and small-N shapes
liangliangchang Jul 21, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading