Repository navigation
|
Hello |
Replies: 2 comments
|
Hi @tidotua, You're not missing anything, if (!ends_with_ignore_case(filename, ".gguf") ||
is_draft_gguf_filename(filename)) continue;and Since your actual problem is space on sudo mkdir -p /mnt/data/hf-hub
sudo rsync -a /var/lib/lemonade/.cache/huggingface/hub/ /mnt/data/hf-hub/
sudo chown -R lemonade:lemonade /mnt/data/hf-hub
echo 'HF_HUB_CACHE=/mnt/data/hf-hub' | sudo tee -a /etc/default/lemond
sudo systemctl restart lemondPick a path outside |
|
@18w thank you for you answer! |
Hi @tidotua,
You're not missing anything,
extra_models_dirskips them on purpose. Insrc/cpp/server/models/scan_catalog.cppthe scan doesand
is_draft_gguf_filenamematchesmtp-*,*-mtp-ud-*anddflash-*. They are treated as draft files, not standalone models, and the extra-dir scan has no step that attaches them to a base model. That pairing (plus themtplabel that makes llama.cpp start with--spec-type draft-mtp) only happens for models that come through the HF cache, inhf_variants.cpp.Since your actual problem is space on
/, the easier fix is to move the HF cache itself instead of usinge…