Popular repositories Loading

1. T-MAC T-MAC Public

   Forked from microsoft/T-MAC

   T-MAC: CPU Renaissance via Table Lookup for Low-Bit LLM Inference

   C++

2. vllm-ascend vllm-ascend Public

   Forked from vllm-project/vllm-ascend

   Community maintained hardware plugin for vLLM on Ascend

   C++

3. xllm xllm Public

   Forked from xLLM-AI/xllm

   A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

   C++