Repository navigation
Commit 6461e29
committed
Say where /api/generate's load answer deviates from Ollama
The isLoadOnly Javadoc attributed the "and without a suffix" condition
to Ollama, and toOllamaLoadResponse called its answer "as Ollama gives
it". Ollama's GenerateHandler reads the prompt alone and answers a
keep_alive of 0 with done_reason "unload". Both are deliberate choices
here: an empty prompt with a suffix stays fill-in-the-middle at the
start of a file (also for an empty suffix), and keep_alive 0 keeps the
load answer because nothing is unloaded. The Javadoc, the README row of
the Ollama routes, TODO.md and the F205 entry now say so. Documentation
only, no behaviour change.
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01VBFFnrhtvXiUeyxjmUc4R21 parent 43f2f3b commit 6461e29
4 files changed
Lines changed: 19 additions & 6 deletions
File tree
- llama/src/main/java/net/ladenthin/llama/server
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1705 | 1705 | | |
1706 | 1706 | | |
1707 | 1707 | | |
| 1708 | + | |
1708 | 1709 | | |
1709 | 1710 | | |
1710 | 1711 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
998 | 998 | | |
999 | 999 | | |
1000 | 1000 | | |
1001 | | - | |
| 1001 | + | |
1002 | 1002 | | |
1003 | 1003 | | |
1004 | 1004 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
520 | 520 | | |
521 | 521 | | |
522 | 522 | | |
| 523 | + | |
| 524 | + | |
523 | 525 | | |
524 | 526 | | |
525 | 527 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
542 | 542 | | |
543 | 543 | | |
544 | 544 | | |
545 | | - | |
546 | | - | |
| 545 | + | |
| 546 | + | |
| 547 | + | |
| 548 | + | |
| 549 | + | |
| 550 | + | |
| 551 | + | |
| 552 | + | |
| 553 | + | |
| 554 | + | |
547 | 555 | | |
548 | 556 | | |
549 | 557 | | |
| |||
553 | 561 | | |
554 | 562 | | |
555 | 563 | | |
556 | | - | |
557 | | - | |
558 | | - | |
| 564 | + | |
| 565 | + | |
| 566 | + | |
| 567 | + | |
| 568 | + | |
559 | 569 | | |
560 | 570 | | |
561 | 571 | | |
| |||
0 commit comments