Skip to content

feat: add lag confidence to decouple adaptive speculative pruning from critical path. - #2280

Open
weizhehuang0827 wants to merge 2 commits into
xLLM-AI:mainfrom
weizhehuang0827:feat/adaptive-lag-confidence
Open

feat: add lag confidence to decouple adaptive speculative pruning from critical path.#2280
weizhehuang0827 wants to merge 2 commits into
xLLM-AI:mainfrom
weizhehuang0827:feat/adaptive-lag-confidence

perf: overlap the adaptive varlen rebuild with the draft forward.

d9a68bb
Select commit
Loading
Failed to load commit list.
Sign in for the full log view