feat(gateway): image generation offload - job-service routing, sync_id, poll progress, per-device auth - #86

Open

siddWednesday wants to merge 202 commits into

mainfrom

feat/image-gen-offload

Commits on Aug 11, 2026

docs(computer-use): approach - replicate the mobile-use stack on desktop

siddWednesday
and
claude
committed
80fd8c8
docs(computer-use): build plan with dated timeline

siddWednesday
and
claude
committed
3739d6e
docs(computer-use): compress timeline for solo AI-assisted development

siddWednesday
and
claude
committed
562f2ee
docs(computer-use): phase 0 shared-repo setup + mobile sequencing note

siddWednesday
and
claude
committed
a9ac675
docs(computer-use): record decision status; break out the after-v1 mobile adapter

siddWednesday
and
claude
committed
34d0290
docs(computer-use): per-phase repo column + write-access dependency

siddWednesday
and
claude
committed
259095c

Commits on Aug 12, 2026

docs(computer-use): agent-browser rail, reuse list, brand guidelines, re-phased timeline

siddWednesday
and
claude
committed
eb96d1c
feat(actions): transport-agnostic approval seam with risk classes

siddWednesday
and
claude
committed
0a4e563
feat(packaging): TCC usage strings for the computer-use semantic rail

siddWednesday
and
claude
committed
2aa9411
docs(computer-use): lock @offgrid/use package name (lead confirmed)

siddWednesday
and
claude
committed
8f4cfc4
feat(actions): native helper invoker + EventKit calendar backend

siddWednesday
and
claude
committed
614b79f
feat(actions): wire calendar tools into the chat loop, gated + shipped

siddWednesday
and
claude
committed
acb0f0a
feat(actions): add Reminders to the semantic rail

siddWednesday
and
claude
committed
45b7283
feat(actions): add Contacts lookup to the semantic rail

siddWednesday
and
claude
committed
85e88c2
feat(actions): add Messages and Mail send to the semantic rail

siddWednesday
and
claude
committed
421b9df
feat(actions): add open_url to the semantic rail

siddWednesday
and
claude
committed
0fde34b
build(mac): stage the native actions helper in local builds

siddWednesday
and
claude
committed
c5205ec
fix(actions): accept timezone-less local times in the helper

siddWednesday
and
claude
committed
4fa6ec6
Merge remote-tracking branch 'origin/main' into feat/computer-use
siddWednesday
committed
ab803db
docs(computer-use): reframe around the proactive assistant model

siddWednesday
and
claude
committed
c5fb3c6
docs(computer-use): compress the plan to a 2-week sprint

siddWednesday
and
claude
committed
493212d
docs(computer-use): design brief for the proactive-assistant demo

siddWednesday
and
claude
committed
9c7b3e7
docs(computer-use): ground the demo brief in the real app

siddWednesday
and
claude
committed
5f7bd02
docs(computer-use): competitive + prior-art research

siddWednesday
and
claude
committed
ba3b95c
docs(computer-use): add PBD research blueprint + two sharper lessons

siddWednesday
and
claude
committed
50025ec
docs(computer-use): make the demo brief match the real app + add evidence/confidence card

siddWednesday
and
claude
committed
e94f6d9

Commits on Aug 13, 2026

docs(assistant): high-level act-pipeline architecture + decisions + open questions

siddWednesday
and
claude
committed
9926bca
docs(assistant): name the actuation layer 'the rails' (canonical)

siddWednesday
and
claude
committed
11d9bd5
docs(assistant): add the brain-and-rails component diagram (ports and adapters)

siddWednesday
and
claude
committed
6644d4b
docs(assistant): TRD/PRD diagrams - C4 sys arch, swimlane, user flows

siddWednesday
and
claude
committed
1329fe7
docs(assistant): fold C4/swimlane/user-flow diagrams into the architecture doc

siddWednesday
and
claude
committed
ed8ba94
docs(assistant): reshape plan to release-led + Windows from day 1

siddWednesday
and
claude
committed
6f7780a
docs(assistant): make it a 12-day plan (Windows heavy-rail parity as fast-follow)

siddWednesday
and
claude
committed
27d01bb
docs(assistant): port-from map (incl. mobile) + shorten to a 10-day plan

siddWednesday
and
claude
committed
40fd7cc
docs(assistant): deep port-vs-bespoke research map across the whole system

siddWednesday
and
claude
committed
6dc8c01
docs(plan): name the specific ports per release (from PORTING_MAP)

siddWednesday
and
claude
committed
a2d65a3
docs: sanitize the assistant doc set; crown the plan as the build doc

siddWednesday
and
claude
committed
acb9699
docs(r1): execution checklist - 19 commit-sized boxes with done-when criteria

siddWednesday
and
claude
committed
db3185b
feat(use): consume @offgrid/use from the shared sibling (R1 box 1)

siddWednesday
and
claude
committed
c24ff46
docs(r1): tick box 1 - @offgrid/use scaffolded and consumed

siddWednesday
and
claude
committed
1b43ed3
chore(use): record @offgrid/use's zod dependency in the lock

siddWednesday
and
claude
committed
b91dbc5
docs(r1): tick box 2 - the Action contract is in; box 1 wording matches the house test pattern

siddWednesday
and
claude
committed
6621b93
chore(use): record @offgrid/use's xstate dependency in the lock

siddWednesday
and
claude
committed
84deb91
docs(r1): tick box 3 - the lifecycle machine is in with crash-resume proven

siddWednesday
and
claude
committed
b8c89b8
chore(use): lock refresh for @offgrid/use manifest

siddWednesday
and
claude
committed
fa345b8
docs(r1): tick box 4 - the durable queue is in; Day 1 of R1 complete

siddWednesday
and
claude
committed
bfc7a12
chore(use): record @offgrid/use's @noble/hashes dependency in the lock

siddWednesday
and
claude
committed
3372941
docs(r1): tick boxes 5 and 6 - retry policy and the bound gate are in

siddWednesday
and
claude
committed
1c2eeac
docs: three fixes from external review - offline scope, escalation rule, AX as eyes

siddWednesday
and
claude
committed
85f23ac
docs(r1): tick box 7 - the port, the registry, and the effect journal are in

siddWednesday
and
claude
committed
cf68106
docs(porting): evaluate OpenWorkflow - right shape, wrong storage, stays on the re-evaluate list

siddWednesday
and
claude
committed
5ad4f4b
docs(r1): tick box 8 - the engine checkpoint passes; Day 2 of R1 complete

siddWednesday
and
claude
committed
0b4538e
feat(actions): the use-engine storage adapter on the app database (R1 box 9)

siddWednesday
and
claude
committed
260a05a
docs(r1): tick box 9 - the engine runs on the app database

siddWednesday
and
claude
committed
f19caf9
feat(actions): the semantic rail behind the DeviceController port (R1 box 10)

siddWednesday
and
claude
committed
9189ee7
docs(r1): tick box 10 - the semantic rail is mapped and guarded

siddWednesday
and
claude
committed
894bb4e
feat(actions): the gate host - the engine's approval callback on the existing seam (R1 box 11)

siddWednesday
and
claude
committed
be3bfcd
docs(r1): tick box 11 - the gate host bridges the engine to the approval seam

siddWednesday
and
claude
committed
2363fa5
feat(actions): emission hardening - schema wire, SAP repair ladder, bounded retry (R1 box 12)

siddWednesday
and
claude
committed
92d4a37
docs(r1): tick box 12 - emission hardening is in

siddWednesday
and
claude
committed
01a49fa
feat(actions): chat mutations run through the durable engine (R1 box 13)

siddWednesday
and
claude
committed
78d6827
docs(r1): tick box 13 - chat mutations are durable; app-testable on macOS free build

siddWednesday
and
claude
committed
3cc40b6
feat(tools): assistant actions are Tools, on by default; Connectors stays external accounts

siddWednesday
and
claude
committed
e216c4f
feat(actions): read-back verification - done means observed (R1 box 14)

siddWednesday
and
claude
committed
2b023f9
docs(r1): tick box 14 - read-back verification is live

siddWednesday
and
claude
committed
e1b5f9d
test(e2e): the R1 golden path - a chat ask becomes a durable, verified action (box 15)

siddWednesday
and
claude
committed
15021fc
docs(r1): tick box 15 - golden-path evidence captured and validated

siddWednesday
and
claude
committed
51f2b39

Commits on Aug 14, 2026

fix(test): green the suite in core-only + Electron-hosted environments; Tools default reverts to off

siddWednesday
and
claude
committed
35f2320
fix(test): await startModelServer before fetching it - a scheduling race

siddWednesday
and
claude
committed
cdd4aba
test(actions): close the new-code coverage gaps - all four floors met

siddWednesday
and
claude
committed
0fc8c9c
chore(pro): stop tracking six pro test files that belong to desktop-pro

siddWednesday
and
claude
committed
7da5867
ci(win): windows-build checks out shared; both workflows build @offgrid/use

siddWednesday
and
claude
committed
32d7147
feat(actions): the Windows semantic rail - local Outlook first (R1 box 17)

siddWednesday
and
claude
committed
58340a7
docs(r1): tick box 16 - the Windows CI build of this branch is green

siddWednesday
and
claude
committed
9a7f212
fix(tools): break the tools <-> extension-select cycle structurally

siddWednesday
and
claude
committed
e83198a
docs(plan): the re-cut - R2 is full rails + Approval UX v2; reasoning and routines follow

siddWednesday
and
claude
committed
763439e
Merge pull request #81 from off-grid-ai/feat/computer-use
siddWednesday
authored
8f887f6
docs(r2): the R2 checklist; R1 boxes 18/18b closed by the merged PR

siddWednesday
and
claude
committed
174a0c2
feat(tools): per-platform tool exposure - Windows joins with the Outlook subset (R2-A1)

siddWednesday
and
claude
committed
d1e1ecc
feat(actions): the win32 inline runner - links open, everything else refuses (R2-A2)

siddWednesday
and
claude
committed
c2fd140
feat(actions): Outlook read-back - Windows verifies what it creates (R2-A3)

siddWednesday
and
claude
committed
d1d5cf3
test(actions): the platform-pick seams, both arms each (R2-A follow-through)

siddWednesday
and
claude
committed
ff83efb
test(coverage): one report owns each file; a dbtest stops leaking its profile env

siddWednesday
and
claude
committed
bc3e88b
feat(actions): risk-tiered gating - reversible mutations auto-run with undo (R2-B1)

siddWednesday
and
claude
committed
d01d80a
feat(actions): the inline-gate plumbing - park-and-render instead of run-now (R2-B3, main + preload)

siddWednesday
and
claude
committed
43d3a8c
feat(renderer): the inline gate card + undo chip in the conversation (R2-B2/B3)

siddWednesday
and
claude
committed
2df0bbb
test(actions): cover the B3 surface - IPC contract, dock branches, outcome fanout

siddWednesday
and
claude
committed
e9e4ba9
docs(r2): tick B4 - the pro queue resolves the engine gate (desktop-pro PR #42)

siddWednesday
and
claude
committed
6b98f82
feat(browser): the rail's eyes - in-page collector with indexed elements (R2-C1)

siddWednesday
and
claude
committed
0a7c7ec
feat(browser): the rail's hands - CDP driver behind a transport seam (R2-C1)

siddWednesday
and
claude
committed
5a7c223
feat(browser): the web-task loop - snapshot/decide/act with takeover parking (R2-C3 core)

siddWednesday
and
claude
committed
9250956
feat(browser): the watched pane + takeover handoff (R2-C2)

siddWednesday
and
claude
committed
1222eb7
feat(browser): web_task through the engine - the browser rail, chat-drivable (R2-C3)

siddWednesday
and
claude
committed
5180cf3
docs(r2): tick C1-C3 - the browser rail is chat-drivable with takeover
siddWednesday
committed
6098994
feat(vision): the UI-TARS action parser (R2-D1 core)

siddWednesday
and
claude
committed
663be36
feat(vision): the supervised vision-rail spine - guard, loop, engine adapter (R2-D)

siddWednesday
and
claude
committed
782fc57
feat(vision): wire the vision rail into the engine, host behind a capability gate (R2-D)

siddWednesday
and
claude
committed
98f4142
docs(r2): D spine landed - vision rail wired, actuation capability-gated (D2b pending)

siddWednesday
and
claude
committed
0754c1e
feat(safety): injection-resistance review + cross-rail prompt guards (R2-E1)

siddWednesday
and
claude
committed
e549253
test(coverage): write the report even when a test fails (reportOnFailure)

siddWednesday
and
claude
committed
52c8a45
docs(r2): tick E1 (injection review + prompt guards); E2 blockers recorded

siddWednesday
and
claude
committed
98cebcd
test(coverage): the db report must not own the unit-tested browser/vision rails

siddWednesday
and
claude
committed
b140395
test(tools): pin darwin in the tool tests so they pass on the Linux CI runner

siddWednesday
and
claude
committed
1e13146

Commits on Aug 17, 2026

feat(vision): the supervised overlay + Stop/Pause controller (R2-D2b UX half)

siddWednesday
and
claude
committed
e238890
docs(r2): D1b done (UI-TARS catalogued) + D2b UX-half done (supervised overlay)

siddWednesday
and
claude
committed
f1371c3
feat(vision): warn (don't block) when computer use runs on a non-grounder

siddWednesday
and
claude
committed
8e78c1d
docs(r2): D1b corrected (OGAD's own catalog) + D1c model-agnostic grounder notice

siddWednesday
and
claude
committed
11311f9
feat(vision): wire the native actuation - the vision rail can now act (R2-D2b)

siddWednesday
and
claude
committed
3ab1155
docs(r2): D2b-native wired - the vision rail can act (needs real-machine verify)
siddWednesday
committed
6627ce3
fix(vision): hand the grounder a screenshot PATH, not raw base64

siddWednesday
and
claude
committed
157a838
fix(vision): surface the grounder nudge IN THE CHAT, not just the overlay

siddWednesday
and
claude
committed
bd9cdc0
fix(vision): grounder nudge reuses the chat MessageNudge, deterministic

siddWednesday
and
claude
committed
f6b3197
fix(vision): fire the grounder nudge at QUEUE time, not only when the rail runs

siddWednesday
and
claude
committed
e1f0455
docs(r5): the tiered, model-agnostic computer-use plan (AX-first, set-of-marks, grounder as fallback)

siddWednesday
and
claude
committed
30ad2a4
feat(a11y): the AX driving rail's eyes - structured-element parser (R5 T1a)

siddWednesday
and
claude
committed
adcf0ac
feat(a11y): the element-picking loop - shared by AX and set-of-marks (R5 T1b)

siddWednesday
and
claude
committed
b3d5624
feat(a11y): the Swift --elements mode - structured AX element emitter (R5 T1c)

siddWednesday
and
claude
committed
d0a69e1
feat(a11y): the cheapest-first routing decision - AX or fall to vision (R5 T1e, pure)

siddWednesday
and
claude
committed
14f8a2b
refactor(input): extract the nut.js actuation into a shared module

siddWednesday
and
claude
committed
60e2a50
feat(a11y): make the --elements helper drive real apps (Electron trigger, retry, --apps)

siddWednesday
and
claude
committed
4e0cf9b
feat(a11y): the accessibility driving rail + AX-first computer_task tiering (R5 T1d/T1e)

siddWednesday
and
claude
committed
4aa0264
docs(r5): mark tier-1 T1a-T1e done (AX driving rail landed), T1f = live drive

siddWednesday
and
claude
committed
dc17d65
fix(a11y): the grounder nudge is AX-aware - no "load a grounder" when AX will drive

siddWednesday
and
claude
committed
f89223c
fix(a11y): the element parser tolerates a general model wrapping its JSON

siddWednesday
and
claude
committed
db87742
chore(a11y): trace the computer_task tiering + AX drive in the app log

siddWednesday
and
claude
committed
b14df15
fix(a11y): type into the focused field (optional index) + trailing submit key

siddWednesday
and
claude
committed
3fad0d2
fix(a11y): coach the message-a-person flow so the model stops typing into search

siddWednesday
and
claude
committed
983c796
fix(a11y): correct the messaging flow - quick switcher + target the labeled composer

siddWednesday
and
claude
committed
b1ee7a1
fix(a11y): drop 1px hover artifacts + raise the element cap so the composer is visible

siddWednesday
and
claude
committed
e1643ac
fix(a11y): runaway guard - halt on a repeated action so a live send never doubles

siddWednesday
and
claude
committed
e87c3c4
feat(computer-use): AX-vs-grounder A/B harness - forced rail, timing, on-demand UI-TARS swap

siddWednesday
and
claude
committed
07d7d30
fix(vision): grounder rail was broken - empty screenshot + missing image-min-tokens

siddWednesday
and
claude
committed
ef18ad0

Commits on Aug 18, 2026

Commits on Aug 19, 2026

fix(routing): a website request stays a web_task even if a word matches a running app

siddWednesday
and
claude
committed
b133dd5
fix(rails): a repeated step skips instead of killing the task

siddWednesday
and
claude
committed
5e82e85
feat(mcp): expose the desktop's action tools over the MCP server so clients can run them here

siddWednesday
and
claude
committed
a4060c3
feat(mcp): gate the action tools behind a per-device pairing token

siddWednesday
and
claude
committed
308347e

Commits on Aug 20, 2026

Commits on Aug 21, 2026

feat(explore): the demo-preset catalog (SSOT for the showcase)
siddWednesday
committed
0cdd0b5
feat(explore): ExploreSection - capability-grouped preset cards
siddWednesday
committed
31c035f
feat(explore): surface demo presets in the chat empty state

siddWednesday
and
claude
committed
70d870e
feat(explore): add Explore landing view + seed-prompt handoff

siddWednesday
and
claude
committed
183e6b6
fix(explore): use the brand name "Off Grid AI" in the Explore header

siddWednesday
and
claude
committed
2bb50b1
fix(rag): stop a hyphenated query from crashing the whole chat retrieval

siddWednesday
and
claude
committed
a961ce4
fix(explore): make the Play-music preset concrete and drop the volume clause

siddWednesday
and
claude
committed
4cb26ee
feat(approvals): show the inline chat card for computer-use gates in pro too

siddWednesday
and
claude
committed
c064376
feat(approvals): core seam for the auto/ask computer-task approval mode

siddWednesday
and
claude
committed
964fd72
feat(approvals): multi-subscriber inline gate surface (fan out to card + mesh)

siddWednesday
and
claude
committed
d9bf87c

Commits on Aug 23, 2026

feat(explore): capability panels + label titles, never the raw prompt

siddWednesday
and
claude
committed
9a1f4e2
test(e2e): explore surfaces render label-only cards on both placements

siddWednesday
and
claude
committed
59aab3c
feat(explore): per-preset icons + runs count on each capability panel

siddWednesday
and
claude
committed
5fed910
fix(browser): stop the agent browser's audio when it's hidden or the app quits

siddWednesday
and
claude
committed
5e45465
fix(chat): remove the grounder-model nudge from the chat

siddWednesday
and
claude
committed
4463ae1
fix(approvals): dismiss the gate card the instant the user decides

siddWednesday
and
claude
committed
c65db99
fix(browser): make the watched-pane resize handle grabbable with a grip notch

siddWednesday
and
claude
committed
b96cdfe
fix(browser): stream web-task steps in the chat, not below the browser

siddWednesday
and
claude
committed
df28524
refine(explore): make preset prompts concrete and self-explanatory

siddWednesday
and
claude
committed
f750019
Merge remote-tracking branch 'origin/main' into feat/chat-approvals

siddWednesday
and
claude
committed
37cb1d8
fix(merge): bump pro pointer + resolve pre-existing failures surfaced by the sync

siddWednesday
and
claude
committed
14090a3
feat(win/vision): DPI-aware coordinate mapping for the computer-use rail

siddWednesday
and
claude
committed
dc00ac0
ci(win): fail loud if the computer-use input addon (nut.js) is absent
siddWednesday
committed
2f26fac
docs(win): record action-rails + computer-use Windows status
siddWednesday
committed
08c92ff
ci(win): build @offgrid/models + let dispatch pin the shared ref
siddWednesday
committed
d3e8504
feat(vision): fall back to the active model when the grounder isn't downloaded
siddWednesday
committed
a18819c

Commits on Aug 24, 2026

feat(win/ax): Windows accessibility rail via PowerShell + UI Automation
siddWednesday
committed
f459c71
chore(pro): bump submodule to the eviction/license fix (420b3c6)

siddWednesday
and
claude
committed
15776a6
feat(mcp): action-tool auth reads live per-device tokens

siddWednesday
and
claude
committed
a6a8b35
ci(release): add artifact_only mode (signed DMG as a run artifact, no Release)

siddWednesday
and
claude
committed
b10addf

Commits on Aug 26, 2026

feat(gateway): image routes run through the job service; opportunistic bearer auth

siddWednesday
and
claude
committed
617e982