Skip to content

perf(unigram): pre-size token map and replace per-node HashMap with Vec#2039

Open
taeyun16 wants to merge 2 commits intohuggingface:mainfrom
taeyun16:perf/unigram-trie-vec
Open

perf(unigram): pre-size token map and replace per-node HashMap with Vec#2039
taeyun16 wants to merge 2 commits intohuggingface:mainfrom
taeyun16:perf/unigram-trie-vec

Commits

Commits on Apr 27, 2026