You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 96cbbc7
Browse filesBrowse the repository at this point in the historyBrowse files
llama-atmosphere-agent: general-purpose default prompt, run_command for any command
The default system prompt called the agent a "careful coding agent" and described
run_command as a way "to build, test or inspect the project"; the tool description
said "build, test, grep or list files". Qwen3-4B read that as a prohibition and
refused "list the docker images" ("my tools are only for files") although the tool
was registered and docker was on PATH -- in a fresh single-turn run too, so it was
the prompt, not the chat history.
- LocalAgent.systemPrompt: a general-purpose assistant on the user's machine. With
--allow-shell it states that run_command executes any command line through the
named shell, starting in the workspace but not limited to it, and that the model
should run a command instead of explaining one; without it, the prompt says
commands are unavailable and names the flag. Answers in the user's language.
- ShellTool: description widened to "any command line on this machine through
<shell>"; isWindows()/shellName() shared with the prompt.
- READMEs: general-purpose wording, an "everything at once" example with
--allow-shell --system, a "The system prompt" section, generic paths only.
- CLAUDE.md: why the prompt must not be narrowed back; ShellToolTest is POSIX-only.
Verified with Qwen3-4B-Instruct-2507 on Vulkan: the same question now calls
run_command {command=docker images} with the default prompt.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01E2h8gXyyE5UeimkL9vQv9G
# everything at once: shell access plus your own system prompt (replaces the built-in one)
1049
+
mvn -q compile exec:java \
1050
+
-Dexec.args="--model /models/Qwen3-4B-Instruct-2507-Q4_K_M.gguf --ngl 99 --ctx-size 16384 --workspace /path/to/project --allow-shell --system 'You are a local assistant on this machine with full shell access. run_command executes any command line, including docker, git and build tools. When asked about the system, run a command instead of explaining it. Answer in the language of the user.'"
1046
1051
```
1047
1052
1048
1053
The full streaming tool-calling loop (tools → `delta.tool_calls` → Java tool → `role:"tool"` result →
**Everything at once — shell access and your own system prompt:**
73
+
74
+
```bash
75
+
mvn -q compile exec:java \
76
+
-Dexec.args="--model /models/Qwen3-4B-Instruct-2507-Q4_K_M.gguf --ngl 99 --ctx-size 16384 --workspace /path/to/project --allow-shell --system 'You are a local assistant on this machine with full shell access. run_command executes any command line, including docker, git and build tools. When asked about the system, run a command instead of explaining it. Read a file before you edit it. Answer in the language of the user.'"
77
+
```
78
+
79
+
Then ask, for example, *"which docker images are available?"* or *"build the project and fix the
80
+
first compiler error"*. On Windows PowerShell, quote the whole argument instead:
81
+
`"-Dexec.args=--model C:\models\… --allow-shell --system '…'"`. Inside `--system '…'` avoid the
82
+
apostrophe (write *the user* rather than *user's*): the value is already single-quoted.
83
+
69
84
GPU natives: pick the core classifier, e.g. `-Dllama.classifier=cuda13-linux-x86-64` or
70
85
`vulkan-windows-x86-64` (the vendor runtime must be installed — see the root README's classifier
71
86
table). Without it the default CPU jar (incl. macOS Metal) is used. In mode A the classifier is
@@ -79,8 +94,8 @@ irrelevant: inference stays in the running server, the agent's JVM loads no mode
79
94
|`--model <file.gguf>`| load this GGUF in-process instead | — |
0 commit comments