You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
docs: advertise the agent's terminal, browser and ACP front ends
- README: a "Local agent" entry in Features and in the table of contents,
and the agent section opens with a table of the three front ends
(terminal / --plain, --web, --acp) and how to reach each.
- Agent README: the intro lists the front ends, and no longer claims the
agent runs without a servlet container (--web embeds Jetty).
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01FtfgoazykGcQSCR3TYBmTQ
3.7 [Local agent: terminal, browser, IDE via ACP](#local-agent-terminal-browser-ide-via-acp)
102
103
4.[Android](#importing-in-android)
103
104
5.[Feature Ideas](#feature-ideas)
104
105
@@ -118,6 +119,7 @@ Inference of Meta's LLaMA model (and others) in pure C/C++.
118
119
-**Conversation checkpoints** — `Session.checkpoint(...)` / `rewind(...)` / `fork(...)` branch and roll back a chat (KV-cache slot save/restore + transcript snapshot) without re-prefilling.
119
120
-**GGUF metadata inspection** without loading the model (`GgufInspector` — pure Java, reads header + key/value table only, big-endian aware).
120
121
-**Distributed inference over RPC** — offload a model's layers to llama.cpp RPC servers on other machines (`ModelParameters.setRpcServers(...)` / `--rpc host:port`), and serve this machine's devices to them with `RpcServer` (the in-JVM `rpc-server`). See [Distributed inference over RPC](#distributed-inference-over-rpc).
122
+
-**Local agent** ([`llama-atmosphere-agent`](llama-atmosphere-agent/), release asset, JDK 21+) — a fully offline agent on top of this library that reads and edits files and, if allowed, runs commands. One agent session, three ways to use it: a **terminal** (full console or line-oriented `--plain`, fine over SSH/PuTTY), a **browser** (`--web`, token-protected, loopback by default — reach it from elsewhere through an SSH tunnel), and **IDEs** over the [Agent Client Protocol](https://agentclientprotocol.com) (`--acp`: JetBrains IDEs and Zed natively, VS Code through an ACP extension). See [Local agent](#local-agent-terminal-browser-ide-via-acp).
121
123
-**Multi-model router mode** (`--models-dir` + per-request model selection, managed via the typed `RouterClient`) and **attach mode** (`NativeServer(LlamaModel, ...)` serves an already-loaded model over the full upstream HTTP frontend — one copy of the weights).
122
124
- Pre-built native binaries in the default JAR for Linux (x86-64, aarch64, s390x), macOS (x86-64, arm64 — Metal included), Windows (x86-64, x86, arm64) and Android (arm64, x86-64); GPU backends (CUDA, Vulkan, OpenCL, ROCm/HIP, SYCL, OpenVINO) ship as Maven classifiers — see [Choosing the right classifier](#choosing-the-right-classifier). Android additionally ships as the [`llama-android` AAR](#importing-in-android) with the optional `llama-kotlin` coroutines façade.
123
125
@@ -1087,10 +1089,19 @@ See [`llama-langchain4j/README.md`](llama-langchain4j/) for streaming/embedding/
1087
1089
examples and the current mapping limitations (tool calling, JSON mode, and multimodal input are
1088
1090
not yet forwarded).
1089
1091
1090
-
### Local coding agent with Atmosphere (`llama-atmosphere-agent/`)
1092
+
### Local agent: terminal, browser, IDE via ACP
1091
1093
1092
-
A copy-and-run **general-purpose terminal agent on the JVM** — Claude Code / OpenCode reduced to the
1093
-
essentials, fully offline; it edits files and, with `--allow-shell`, runs any command on your machine
1094
+
> [!TIP]
1095
+
> **Supported front ends** — all on the same agent session (history, slash commands, approval mode):
1096
+
>
1097
+
> | Front end | Start with | Where it runs |
1098
+
> |---|---|---|
1099
+
> | Terminal |*(default)* / `--plain`| this console; `--plain` for piped, logged or line-only sessions |
0 commit comments