Repository navigation
Commit 707da0e
committed
Document the one-prompt, one-completion rule on every entry point
F184 and F197 refuse several prompts in one request and "n" > 1 with
InvalidRequestException, unlike upstream's server, which answers both.
Only the C header of jllama_completions/jllama_completions_oai said so,
and streamCompletionsOai named the prompts but not "n". The @throws of
handleCompletions, handleCompletionsOai and streamCompletionsOai now
name both, handleChatCompletions and handleInfill only "n" (a chat
request renders one prompt from its messages, infill builds its own);
the eight request methods of FfmLlamaModel carry the same split, and
the chat, infill and streaming functions of jllama_api.h say it too.
Phrased as an unconditional refusal, not tied to the slot count.
Documentation only; javadoc builds clean for the core and llama-ffm.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01VBFFnrhtvXiUeyxjmUc4R21 parent a520c36 commit 707da0e
4 files changed
Lines changed: 42 additions & 10 deletions
File tree
- llama-ffm/src/main/java/net/ladenthin/llama/ffm
- llama/src/main
- cpp
- java/net/ladenthin/llama
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1612 | 1612 | | |
1613 | 1613 | | |
1614 | 1614 | | |
| 1615 | + | |
1615 | 1616 | | |
1616 | 1617 | | |
1617 | 1618 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
146 | 146 | | |
147 | 147 | | |
148 | 148 | | |
| 149 | + | |
| 150 | + | |
149 | 151 | | |
150 | 152 | | |
151 | 153 | | |
| |||
157 | 159 | | |
158 | 160 | | |
159 | 161 | | |
| 162 | + | |
| 163 | + | |
160 | 164 | | |
161 | 165 | | |
162 | 166 | | |
| |||
169 | 173 | | |
170 | 174 | | |
171 | 175 | | |
| 176 | + | |
| 177 | + | |
172 | 178 | | |
173 | 179 | | |
174 | 180 | | |
| |||
180 | 186 | | |
181 | 187 | | |
182 | 188 | | |
| 189 | + | |
| 190 | + | |
| 191 | + | |
183 | 192 | | |
184 | 193 | | |
185 | 194 | | |
| |||
190 | 199 | | |
191 | 200 | | |
192 | 201 | | |
| 202 | + | |
| 203 | + | |
| 204 | + | |
193 | 205 | | |
194 | 206 | | |
195 | 207 | | |
| |||
202 | 214 | | |
203 | 215 | | |
204 | 216 | | |
| 217 | + | |
| 218 | + | |
| 219 | + | |
205 | 220 | | |
206 | 221 | | |
207 | 222 | | |
| |||
213 | 228 | | |
214 | 229 | | |
215 | 230 | | |
| 231 | + | |
| 232 | + | |
216 | 233 | | |
217 | 234 | | |
218 | 235 | | |
| |||
223 | 240 | | |
224 | 241 | | |
225 | 242 | | |
| 243 | + | |
| 244 | + | |
| 245 | + | |
226 | 246 | | |
227 | 247 | | |
228 | 248 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
123 | 123 | | |
124 | 124 | | |
125 | 125 | | |
126 | | - | |
| 126 | + | |
| 127 | + | |
127 | 128 | | |
128 | 129 | | |
129 | 130 | | |
130 | 131 | | |
131 | 132 | | |
132 | 133 | | |
133 | 134 | | |
134 | | - | |
| 135 | + | |
| 136 | + | |
135 | 137 | | |
136 | 138 | | |
137 | 139 | | |
| |||
192 | 194 | | |
193 | 195 | | |
194 | 196 | | |
195 | | - | |
| 197 | + | |
196 | 198 | | |
197 | 199 | | |
198 | 200 | | |
199 | 201 | | |
200 | 202 | | |
201 | 203 | | |
202 | | - | |
| 204 | + | |
| 205 | + | |
203 | 206 | | |
204 | 207 | | |
205 | 208 | | |
206 | 209 | | |
207 | 210 | | |
208 | 211 | | |
209 | | - | |
| 212 | + | |
210 | 213 | | |
211 | 214 | | |
212 | 215 | | |
213 | 216 | | |
214 | 217 | | |
215 | 218 | | |
| 219 | + | |
216 | 220 | | |
217 | 221 | | |
218 | 222 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
800 | 800 | | |
801 | 801 | | |
802 | 802 | | |
803 | | - | |
| 803 | + | |
| 804 | + | |
804 | 805 | | |
805 | 806 | | |
806 | 807 | | |
| |||
826 | 827 | | |
827 | 828 | | |
828 | 829 | | |
829 | | - | |
| 830 | + | |
| 831 | + | |
| 832 | + | |
830 | 833 | | |
831 | 834 | | |
832 | 835 | | |
| |||
838 | 841 | | |
839 | 842 | | |
840 | 843 | | |
841 | | - | |
| 844 | + | |
| 845 | + | |
| 846 | + | |
842 | 847 | | |
843 | 848 | | |
844 | 849 | | |
| |||
850 | 855 | | |
851 | 856 | | |
852 | 857 | | |
853 | | - | |
| 858 | + | |
| 859 | + | |
854 | 860 | | |
855 | 861 | | |
856 | 862 | | |
| |||
1180 | 1186 | | |
1181 | 1187 | | |
1182 | 1188 | | |
1183 | | - | |
| 1189 | + | |
| 1190 | + | |
1184 | 1191 | | |
1185 | 1192 | | |
1186 | 1193 | | |
| |||
0 commit comments