Skip to content

feat: make ATB context and operation cache device-aware for single-process mode. - #1

Open
XuZhang99 wants to merge 2 commits into
xLLM-AI:mainfrom
XuZhang99:feat/single_process_atb_context
Open

feat: make ATB context and operation cache device-aware for single-process mode.#1
XuZhang99 wants to merge 2 commits into
xLLM-AI:mainfrom
XuZhang99:feat/single_process_atb_context

fix: guard triton KernelRegistry with a shared_mutex for single-proce…

bebc9fe
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs