Compare commits
10 Commits
v2.6.8-age
...
main
| Author | SHA1 | Date | |
|---|---|---|---|
| 9c1ddcaa7c | |||
| 217f487395 | |||
| 2dfbef4c41 | |||
| c7a8128059 | |||
| 986c8a83a9 | |||
| aa3797e356 | |||
| 850d48853f | |||
| f619ae0978 | |||
| 0d3d08f5f2 | |||
| 0658d19b64 |
12
CHANGELOG.md
12
CHANGELOG.md
@@ -2,6 +2,18 @@
|
|||||||
|
|
||||||
All notable changes per release tag. Most recent on top, ordered by tag creation date (which matches the git history). Tag names follow `vMAJOR.MINOR.PATCH-slug` — the slug describes what shipped, so the tag name alone is enough to recall the batch.
|
All notable changes per release tag. Most recent on top, ordered by tag creation date (which matches the git history). Tag names follow `vMAJOR.MINOR.PATCH-slug` — the slug describes what shipped, so the tag name alone is enough to recall the batch.
|
||||||
|
|
||||||
|
## v2.6.11-close-hooks-staging — 2026-06-01
|
||||||
|
|
||||||
|
The two v2.6 follow-ups left after `v2.6.10-lifecycle-hardening`. **Server close-hook caller:** `apps/server` (BooChat) now fire-and-forgets BooCoder's Phase-3 close hooks so warm agent backends + worktrees tear down *immediately* on delete/archive instead of waiting for the idle-evict/reaper backstop — a new `coder-notify.ts` `notifyCoderClose(kind,id)` (reusing the v2.6.2 `BOOCODER_URL` reach, never-rejects) is `void`-called after the WS frame at session-delete (`POST /api/sessions/:id/close`) and chat archive / archive-all / delete (`POST /api/chats/:id/close`); an unreachable coder can never block or fail the user's delete/archive. **Staging-boundary hint (task 3.7):** the BooCoder DiffPanel now shows a muted one-liner when the selected provider can't see another agent's unapplied worktree edits — native boocode selected + external-agent-staged changes (or vice-versa) → "<agent>'s edits live in its worktree — BooCode won't see them until applied" — derived purely from the per-change `agent` + current provider, no new state. 6 new server tests (`coder-notify`), 537 server tests pass; web + server tsc/build clean. **With these the v2.6 openspec is fully closed** — only the live Smoke 2/2b/3 remain (manual exercise).
|
||||||
|
|
||||||
|
## v2.6.10-lifecycle-hardening — 2026-06-01
|
||||||
|
|
||||||
|
v2.6 Phase 3 (the last phase) — lifecycle hardening of the warm-process backends. **Idle eviction + LRU cap:** the agent pool runs a 60s sweep that evicts backends/sessions idle past `AGENT_POOL_IDLE_TTL_MS` (30 min default) and any beyond `AGENT_POOL_MAX_LIVE` (10, LRU) — **never a busy one** (in-flight turn, double-checked via a new `isBusy()` backend hook); the worktree persists (DB-backed) and the next turn re-spawns + reattaches. The eviction/LRU/restart decisions are factored into a pure `lifecycle-decisions.ts` (modeled on the inference `selectPruneTargets` pattern). **Crash recovery:** lifts openchamber's health-monitor + busy-aware-restart + consecutive-failure + stale-busy-grace state machine into `opencode-server.ts` (with port reclaim) and `warm-acp.ts` — an opencode server crash settles in-flight turns as failed, marks the rows `crashed`, and recreates fresh sessions (a fresh server can't hold the old in-memory id), while a warm-ACP child crash re-`session/new`s next turn; the F.1 turn-guard and U.6 usage are preserved (their tests still pass). **Worktree reaper:** a periodic reaper removes orphan on-disk worktrees (no live `worktrees` row, 1h grace) behind a superset-style preflight that skips dirty/unpushed/unmerged work, with Paseo-style soft-delete (`status='archived'`). Plus close hooks (`/api/chats/:id/close`, `/api/sessions/:id/close`, awaiting the apps/server caller) and diff re-baseline after `apply_pending`. Built test-first — 35 new tests (`lifecycle-decisions` 22, `agent-pool` 13) + a DB-opt-in reconnect integration test; 215 coder tests pass, tsc + build clean. **This completes v2.6** (Phase 0–3 + F.1 + Phase 1-UX). Remaining follow-ups (out of v2.6 scope): the apps/server close-hook caller, the 3.7 DiffPanel staging-boundary hint (frontend), and live Smoke 2/2b/3.
|
||||||
|
|
||||||
|
## v2.6.9-warm-acp — 2026-05-31
|
||||||
|
|
||||||
|
v2.6 Phase 2: goose and qwen now run as **warm ACP backends** instead of one-shot-per-task. A new `WarmAcpBackend` (`backends/warm-acp.ts`, implementing the same `AgentBackend` interface as the opencode warm server) holds one persistent `goose acp` / `qwen --acp` child + `ClientSideConnection` + ACP session per `(chat, agent)`, running `initialize` + `session/new` once and reusing the connection across turns; per-turn abort cancels the in-flight prompt (`session/cancel`) without killing the child, and a child exit marks `agent_sessions.status='crashed'` for re-spawn on the next turn. The dispatcher routes `goose`/`qwen` chat-tab tasks to the pooled warm backend via a pure `shouldUseWarmBackend(task)` predicate (warm only when both `session_id` and `chat_id` are set), keeping the one-shot `runExternalAgent` path as the fallback for session-less creators (arena, MCP, `new_task`); broker frames + `persistExternalAgentTurn` + the latest-wins `pending_changes` diff are identical to the opencode path. The `acp-dispatch.ts` `handleSessionUpdate` switch was extracted into a pure shared `acp-event-map.ts` mapper used by both the one-shot and warm paths (one-shot behavior byte-identical, all existing acp tests green). The design's `unstable_resumeSession` concern is resolved — the installed `@agentclientprotocol/sdk@^0.22.1` exposes stable `resumeSession`/`loadSession`, but resume is moot in the hot path (warm reuse needs none); cross-restart resume + idle eviction are deferred to Phase 3. Built test-first (15 new tests: `warm-acp-routing`, `acp-event-map`); 180 coder tests pass, tsc + build clean. **Smoke 2/2b (live two-message warm reuse + the opencode→boocode→opencode switch round-trip) to be run post-deploy.** Phase 3 (lifecycle hardening) is the last v2.6 phase.
|
||||||
|
|
||||||
## v2.6.8-agent-attribution — 2026-05-31
|
## v2.6.8-agent-attribution — 2026-05-31
|
||||||
|
|
||||||
v2.6 Phase 1-UX: agent attribution + switch affordances over the already-shipped `pending_changes.agent` column and `agent_sessions` table (read+display, no new backend capability). **Backend:** `pending_changes.agent` is now stamped at every queue site (native write tools → `'boocode'`, dispatched external agents → the task's agent, manual RightRail create → `NULL`) and flows through `listPending`; a new `GET /api/sessions/:id/agent-sessions` route returns `[{agent,status,has_session,last_active_at}]` per `(chat,agent)` for the session's chats; and the opencode warm-server backend consumes opencode's `session.next.step.ended` events, accumulating `input_tokens`/`output_tokens`/`cost` onto the `agent_sessions` row (new columns, idempotent). **Frontend:** the BooCoder DiffPanel renders a per-row agent badge (provider icon + label; `null` → "manual") with a "Changes from X, Y" note when a pending set spans multiple agents, and the AgentComposerBar shows a resumed / history / new-session chip beside the Provider picker — gated on an optional `sessionId` prop so BooChat is unaffected — driven by a new `useAgentSessions` hook that refetches on message-complete; `providerIcon` was extracted to a shared `components/coder/providerIcons.tsx`. Built by three parallel subagents over disjoint file sets; web + coder typecheck clean, 165 coder tests pass (9 new across `opencode-usage` and `agent-sessions.routes`). U.6's persisted token totals are conversation-cumulative and not yet surfaced in the UI (deferred). Implements the U.1–U.6 "remaining" plan from the v2.6 openspec reconciliation; Phase 2 (warm ACP goose/qwen) + Phase 3 (lifecycle hardening) remain.
|
v2.6 Phase 1-UX: agent attribution + switch affordances over the already-shipped `pending_changes.agent` column and `agent_sessions` table (read+display, no new backend capability). **Backend:** `pending_changes.agent` is now stamped at every queue site (native write tools → `'boocode'`, dispatched external agents → the task's agent, manual RightRail create → `NULL`) and flows through `listPending`; a new `GET /api/sessions/:id/agent-sessions` route returns `[{agent,status,has_session,last_active_at}]` per `(chat,agent)` for the session's chats; and the opencode warm-server backend consumes opencode's `session.next.step.ended` events, accumulating `input_tokens`/`output_tokens`/`cost` onto the `agent_sessions` row (new columns, idempotent). **Frontend:** the BooCoder DiffPanel renders a per-row agent badge (provider icon + label; `null` → "manual") with a "Changes from X, Y" note when a pending set spans multiple agents, and the AgentComposerBar shows a resumed / history / new-session chip beside the Provider picker — gated on an optional `sessionId` prop so BooChat is unaffected — driven by a new `useAgentSessions` hook that refetches on message-complete; `providerIcon` was extracted to a shared `components/coder/providerIcons.tsx`. Built by three parallel subagents over disjoint file sets; web + coder typecheck clean, 165 coder tests pass (9 new across `opencode-usage` and `agent-sessions.routes`). U.6's persisted token totals are conversation-cumulative and not yet surfaced in the UI (deferred). Implements the U.1–U.6 "remaining" plan from the v2.6 openspec reconciliation; Phase 2 (warm ACP goose/qwen) + Phase 3 (lifecycle hardening) remain.
|
||||||
|
|||||||
@@ -35,6 +35,21 @@ const ConfigSchema = z.object({
|
|||||||
// SSH access to the host for external agent dispatch (Phase 5)
|
// SSH access to the host for external agent dispatch (Phase 5)
|
||||||
BOOCODER_SSH_HOST: z.string().default('100.114.205.53'),
|
BOOCODER_SSH_HOST: z.string().default('100.114.205.53'),
|
||||||
BOOCODER_SSH_USER: z.string().default('samkintop'),
|
BOOCODER_SSH_USER: z.string().default('samkintop'),
|
||||||
|
// v2.6 Phase 3 (lifecycle hardening). Idle TTL: evict a non-busy warm backend
|
||||||
|
// (opencode server / warm-ACP child) after this long with no turn — its worktree
|
||||||
|
// + agent_sessions row persist, so the next turn re-spawns + reattaches. 30 min
|
||||||
|
// default (design §6).
|
||||||
|
AGENT_POOL_IDLE_TTL_MS: z.coerce.number().int().positive().default(1_800_000),
|
||||||
|
// LRU cap: max live warm backends before the least-recently-used (non-busy) ones
|
||||||
|
// are evicted. Bounds the long-lived-daemon's per-(chat,agent) Map growth.
|
||||||
|
AGENT_POOL_MAX_LIVE: z.coerce.number().int().positive().default(10),
|
||||||
|
// Periodic sweep cadence (idle/LRU pool eviction + orphan-worktree reap). 60s
|
||||||
|
// mirrors the apps/server truncation/stale-streaming sweeper.
|
||||||
|
LIFECYCLE_SWEEP_INTERVAL_MS: z.coerce.number().int().positive().default(60_000),
|
||||||
|
// Orphan-worktree grace: an on-disk worktree dir with no live `worktrees` row is
|
||||||
|
// only reaped after it's been untouched this long (avoids sweeping a dir mid
|
||||||
|
// ensureSessionWorktree create). 1h default.
|
||||||
|
ORPHAN_WORKTREE_GRACE_MS: z.coerce.number().int().positive().default(3_600_000),
|
||||||
});
|
});
|
||||||
|
|
||||||
export type Config = z.infer<typeof ConfigSchema>;
|
export type Config = z.infer<typeof ConfigSchema>;
|
||||||
|
|||||||
@@ -32,10 +32,12 @@ import { registerStatsRoutes } from './routes/stats.js';
|
|||||||
import { registerArenaRoutes } from './routes/arena.js';
|
import { registerArenaRoutes } from './routes/arena.js';
|
||||||
import { registerProviderRoutes } from './routes/providers.js';
|
import { registerProviderRoutes } from './routes/providers.js';
|
||||||
import { registerWorktreeSafetyRoutes } from './routes/worktree-safety.js';
|
import { registerWorktreeSafetyRoutes } from './routes/worktree-safety.js';
|
||||||
|
import { registerLifecycleRoutes } from './routes/lifecycle.js';
|
||||||
import { registerWebSocket } from './routes/ws.js';
|
import { registerWebSocket } from './routes/ws.js';
|
||||||
// Phase 4: dispatcher + agent probe
|
// Phase 4: dispatcher + agent probe
|
||||||
import { createDispatcher } from './services/dispatcher.js';
|
import { createDispatcher } from './services/dispatcher.js';
|
||||||
import { agentPool } from './services/agent-pool.js';
|
import { agentPool } from './services/agent-pool.js';
|
||||||
|
import { createOrphanWorktreeReaper } from './services/orphan-worktree-reaper.js';
|
||||||
import { probeAgents } from './services/agent-probe.js';
|
import { probeAgents } from './services/agent-probe.js';
|
||||||
import { getProviderSnapshot, persistProbedModels } from './services/provider-snapshot.js';
|
import { getProviderSnapshot, persistProbedModels } from './services/provider-snapshot.js';
|
||||||
import { setPermissionHooks } from './services/permission-waiter.js';
|
import { setPermissionHooks } from './services/permission-waiter.js';
|
||||||
@@ -181,10 +183,30 @@ async function main() {
|
|||||||
// Phase 4: dispatcher — polls tasks table and runs inference
|
// Phase 4: dispatcher — polls tasks table and runs inference
|
||||||
const dispatcher = createDispatcher({ sql, inference: inferenceApi, broker, log: app.log, config });
|
const dispatcher = createDispatcher({ sql, inference: inferenceApi, broker, log: app.log, config });
|
||||||
dispatcher.start();
|
dispatcher.start();
|
||||||
|
|
||||||
|
// v2.6 Phase 3: configure + start the agent-pool lifecycle sweep (idle-TTL +
|
||||||
|
// LRU-cap eviction of warm backends, plus each backend's proactive health probe)
|
||||||
|
// and the orphan-worktree reaper. Both run on the same periodic timer.
|
||||||
|
agentPool.configure({
|
||||||
|
idleTtlMs: config.AGENT_POOL_IDLE_TTL_MS,
|
||||||
|
maxLive: config.AGENT_POOL_MAX_LIVE,
|
||||||
|
sweepIntervalMs: config.LIFECYCLE_SWEEP_INTERVAL_MS,
|
||||||
|
log: app.log,
|
||||||
|
});
|
||||||
|
agentPool.startReaper(app.log);
|
||||||
|
const orphanReaper = createOrphanWorktreeReaper({
|
||||||
|
sql,
|
||||||
|
log: app.log,
|
||||||
|
intervalMs: config.LIFECYCLE_SWEEP_INTERVAL_MS,
|
||||||
|
graceMs: config.ORPHAN_WORKTREE_GRACE_MS,
|
||||||
|
});
|
||||||
|
orphanReaper.start();
|
||||||
|
|
||||||
app.addHook('onClose', async () => {
|
app.addHook('onClose', async () => {
|
||||||
// stop() first so in-flight dispatcher turns settle, then drain the pool.
|
// stop() first so in-flight dispatcher turns settle, then stop the reapers and
|
||||||
// Pool is empty in Phase 0 (nothing spawns yet) — dispose() is inert.
|
// drain the pool (kills opencode server + warm ACP children).
|
||||||
await dispatcher.stop();
|
await dispatcher.stop();
|
||||||
|
orphanReaper.stop();
|
||||||
await agentPool.dispose();
|
await agentPool.dispose();
|
||||||
});
|
});
|
||||||
|
|
||||||
@@ -199,6 +221,7 @@ async function main() {
|
|||||||
registerArenaRoutes(app, sql);
|
registerArenaRoutes(app, sql);
|
||||||
registerProviderRoutes(app, sql, config);
|
registerProviderRoutes(app, sql, config);
|
||||||
registerWorktreeSafetyRoutes(app, sql);
|
registerWorktreeSafetyRoutes(app, sql);
|
||||||
|
registerLifecycleRoutes(app, sql);
|
||||||
registerWebSocket(app, sql, broker);
|
registerWebSocket(app, sql, broker);
|
||||||
|
|
||||||
// Serve static frontend (built web app). In production, the dist/ is
|
// Serve static frontend (built web app). In production, the dist/ is
|
||||||
|
|||||||
122
apps/coder/src/routes/lifecycle.ts
Normal file
122
apps/coder/src/routes/lifecycle.ts
Normal file
@@ -0,0 +1,122 @@
|
|||||||
|
/**
|
||||||
|
* v2.6 Phase 3 (3.3) — chat/session close-or-archive cleanup hook (coder side).
|
||||||
|
*
|
||||||
|
* Chat/session close + archive + delete all live in apps/server (Docker), which
|
||||||
|
* cannot see the host worktree dirs (/tmp/booworktrees), run git on them, or reach
|
||||||
|
* the warm agent processes the dispatcher pooled in THIS (host systemd) process. So
|
||||||
|
* — exactly like the `worktree-risk` guard — the server signals the coder when a
|
||||||
|
* chat/session closes, and the coder does the real teardown:
|
||||||
|
* 1. dispose the chat's warm-ACP backends (`agentPool.closeChat`) — kills the
|
||||||
|
* goose/qwen child processes for that chat,
|
||||||
|
* 2. close the chat's opencode session on the shared server (`closeSession`),
|
||||||
|
* 3. mark every `agent_sessions` row for the chat 'closed' + (when the session's
|
||||||
|
* last open chat closes) remove the shared session worktree, preflighting
|
||||||
|
* work-at-risk so uncommitted/unmerged work is never silently dropped
|
||||||
|
* (`closeChatBackendState`).
|
||||||
|
*
|
||||||
|
* Idempotent: closing an already-closed chat is a no-op (0 rows, no backend).
|
||||||
|
*
|
||||||
|
* SERVER WIRING (not done here — apps/server, out of this batch's scope): the
|
||||||
|
* server's `POST /api/chats/:id/archive`, `DELETE /api/chats/:id`, and the
|
||||||
|
* session archive/delete routes should fire-and-forget
|
||||||
|
* fetch(`${BOOCODER_URL}/api/chats/${id}/close`, { method: 'POST' })
|
||||||
|
* after publishing their WS frame (best-effort; the orphan-worktree reaper +
|
||||||
|
* idle-pool eviction are the backstop if the call is missed).
|
||||||
|
*/
|
||||||
|
import type { FastifyInstance } from 'fastify';
|
||||||
|
import type { Sql } from '../db.js';
|
||||||
|
import { agentPool, OPENCODE_POOL_KEY } from '../services/agent-pool.js';
|
||||||
|
import { closeChatBackendState } from '../services/worktrees.js';
|
||||||
|
import type { AgentSessionHandle } from '../services/agent-backend.js';
|
||||||
|
|
||||||
|
export function registerLifecycleRoutes(app: FastifyInstance, sql: Sql): void {
|
||||||
|
// POST /api/chats/:chatId/close — tear down all warm state for a chat tab.
|
||||||
|
app.post<{ Params: { chatId: string }; Querystring: { force?: string } }>(
|
||||||
|
'/api/chats/:chatId/close',
|
||||||
|
async (req) => {
|
||||||
|
const chatId = req.params.chatId;
|
||||||
|
const force = req.query.force === 'true' || req.query.force === '1';
|
||||||
|
|
||||||
|
// 1. Close the chat's opencode session on the SHARED server (the server is
|
||||||
|
// not chat-keyed, so agentPool.closeChat won't touch it). Resolve the
|
||||||
|
// stored opencode session id and ask the backend to drop it.
|
||||||
|
const ocRows = await sql<{ agent: string; agent_session_id: string | null; worktree_id: string | null; session_id: string | null }[]>`
|
||||||
|
SELECT agent, agent_session_id, worktree_id, session_id
|
||||||
|
FROM agent_sessions
|
||||||
|
WHERE chat_id = ${chatId} AND backend = 'opencode_server'
|
||||||
|
`;
|
||||||
|
const ocBackend = agentPool.peek(OPENCODE_POOL_KEY, 'opencode');
|
||||||
|
if (ocBackend) {
|
||||||
|
for (const row of ocRows) {
|
||||||
|
if (!row.agent_session_id) continue;
|
||||||
|
const handle: AgentSessionHandle = {
|
||||||
|
sessionId: row.session_id ?? '',
|
||||||
|
agent: row.agent,
|
||||||
|
backend: 'opencode_server',
|
||||||
|
chatId,
|
||||||
|
worktreeId: row.worktree_id ?? '',
|
||||||
|
agentSessionId: row.agent_session_id,
|
||||||
|
serverPort: null,
|
||||||
|
};
|
||||||
|
await ocBackend.closeSession(handle).catch((err) => {
|
||||||
|
app.log.warn({ err: err instanceof Error ? err.message : String(err), chatId }, 'lifecycle: opencode closeSession threw');
|
||||||
|
});
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
// 2. Dispose any warm-ACP backends pooled under this chat (kills the
|
||||||
|
// goose/qwen child + marks its agent row closed via the backend).
|
||||||
|
const disposed = await agentPool.closeChat(chatId);
|
||||||
|
|
||||||
|
// 3. DB + worktree truth: mark agent rows closed; remove the shared session
|
||||||
|
// worktree iff this was the session's last open chat (preflight at-risk).
|
||||||
|
const result = await closeChatBackendState(sql, chatId, { force });
|
||||||
|
|
||||||
|
app.log.info({ chatId, disposed, ...result }, 'lifecycle: chat closed');
|
||||||
|
return { ok: true, disposed, ...result };
|
||||||
|
},
|
||||||
|
);
|
||||||
|
|
||||||
|
// POST /api/sessions/:sessionId/close — close every open chat in a session
|
||||||
|
// (session archive/delete). Loops the chat-close path so the same preflight +
|
||||||
|
// teardown applies per chat; the worktree is removed on the last one.
|
||||||
|
app.post<{ Params: { sessionId: string }; Querystring: { force?: string } }>(
|
||||||
|
'/api/sessions/:sessionId/close',
|
||||||
|
async (req) => {
|
||||||
|
const sessionId = req.params.sessionId;
|
||||||
|
const force = req.query.force === 'true' || req.query.force === '1';
|
||||||
|
|
||||||
|
const chats = await sql<{ id: string }[]>`
|
||||||
|
SELECT id FROM chats WHERE session_id = ${sessionId}
|
||||||
|
`;
|
||||||
|
const results: { chatId: string; disposed: string[]; worktreeRemoved: boolean; worktreeAtRisk: boolean }[] = [];
|
||||||
|
for (const c of chats) {
|
||||||
|
const ocBackend = agentPool.peek(OPENCODE_POOL_KEY, 'opencode');
|
||||||
|
if (ocBackend) {
|
||||||
|
const ocRows = await sql<{ agent: string; agent_session_id: string | null; worktree_id: string | null; session_id: string | null }[]>`
|
||||||
|
SELECT agent, agent_session_id, worktree_id, session_id
|
||||||
|
FROM agent_sessions WHERE chat_id = ${c.id} AND backend = 'opencode_server'
|
||||||
|
`;
|
||||||
|
for (const row of ocRows) {
|
||||||
|
if (!row.agent_session_id) continue;
|
||||||
|
await ocBackend.closeSession({
|
||||||
|
sessionId: row.session_id ?? '',
|
||||||
|
agent: row.agent,
|
||||||
|
backend: 'opencode_server',
|
||||||
|
chatId: c.id,
|
||||||
|
worktreeId: row.worktree_id ?? '',
|
||||||
|
agentSessionId: row.agent_session_id,
|
||||||
|
serverPort: null,
|
||||||
|
}).catch(() => {});
|
||||||
|
}
|
||||||
|
}
|
||||||
|
const disposed = await agentPool.closeChat(c.id);
|
||||||
|
const r = await closeChatBackendState(sql, c.id, { force });
|
||||||
|
results.push({ chatId: c.id, disposed, worktreeRemoved: r.worktreeRemoved, worktreeAtRisk: r.worktreeAtRisk });
|
||||||
|
}
|
||||||
|
|
||||||
|
app.log.info({ sessionId, chats: results.length }, 'lifecycle: session closed');
|
||||||
|
return { ok: true, results };
|
||||||
|
},
|
||||||
|
);
|
||||||
|
}
|
||||||
@@ -10,6 +10,7 @@ import {
|
|||||||
queueCreate,
|
queueCreate,
|
||||||
} from '../services/pending_changes.js';
|
} from '../services/pending_changes.js';
|
||||||
import { WriteGuardError } from '../services/write_guard.js';
|
import { WriteGuardError } from '../services/write_guard.js';
|
||||||
|
import { rebaselineWorktreeAfterApply } from '../services/worktrees.js';
|
||||||
|
|
||||||
const CreateBody = z.object({
|
const CreateBody = z.object({
|
||||||
file_path: z.string().min(1),
|
file_path: z.string().min(1),
|
||||||
@@ -117,6 +118,15 @@ export function registerPendingRoutes(app: FastifyInstance, sql: Sql): void {
|
|||||||
}
|
}
|
||||||
|
|
||||||
const results = await applyAll(sql, sessionId, projectRoot);
|
const results = await applyAll(sql, sessionId, projectRoot);
|
||||||
|
|
||||||
|
// v2.6 Phase 3 (3.5): re-baseline the session worktree's diff to the applied
|
||||||
|
// state, so the next external-agent turn diffs against applied-not-original
|
||||||
|
// and doesn't re-surface the just-applied changes. Best-effort: a worktree
|
||||||
|
// session may not exist (native-only chat), and a re-baseline hiccup must not
|
||||||
|
// fail the apply the user just requested.
|
||||||
|
if (results.some((r) => r.success)) {
|
||||||
|
await rebaselineWorktreeAfterApply(sql, sessionId).catch(() => {});
|
||||||
|
}
|
||||||
return { results };
|
return { results };
|
||||||
},
|
},
|
||||||
);
|
);
|
||||||
@@ -136,6 +146,15 @@ export function registerPendingRoutes(app: FastifyInstance, sql: Sql): void {
|
|||||||
const result = await applyOne(sql, changeId, projectRoot);
|
const result = await applyOne(sql, changeId, projectRoot);
|
||||||
if (!result.success) {
|
if (!result.success) {
|
||||||
reply.code(422);
|
reply.code(422);
|
||||||
|
} else {
|
||||||
|
// v2.6 Phase 3 (3.5): re-baseline the session worktree after a successful
|
||||||
|
// apply so the next external-agent turn diffs against applied-not-original.
|
||||||
|
// Resolve the change's session; best-effort, never fails the apply.
|
||||||
|
const sessRows = await sql<{ session_id: string }[]>`
|
||||||
|
SELECT session_id FROM pending_changes WHERE id = ${changeId}
|
||||||
|
`;
|
||||||
|
const sessionId = sessRows[0]?.session_id;
|
||||||
|
if (sessionId) await rebaselineWorktreeAfterApply(sql, sessionId).catch(() => {});
|
||||||
}
|
}
|
||||||
return result;
|
return result;
|
||||||
},
|
},
|
||||||
|
|||||||
110
apps/coder/src/services/__tests__/acp-event-map.test.ts
Normal file
110
apps/coder/src/services/__tests__/acp-event-map.test.ts
Normal file
@@ -0,0 +1,110 @@
|
|||||||
|
import { describe, it, expect } from 'vitest';
|
||||||
|
import type { SessionNotification } from '@agentclientprotocol/sdk';
|
||||||
|
import { mapSessionUpdate } from '../acp-event-map.js';
|
||||||
|
import type { AcpToolSnapshot } from '../acp-tool-snapshot.js';
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Pure event-mapping shared by the one-shot ACP dispatch (AcpStreamContext) and
|
||||||
|
* the warm ACP backend (Phase 2). Mirrors the original handleSessionUpdate switch
|
||||||
|
* verbatim but returns normalized AgentEvents instead of publishing broker frames.
|
||||||
|
*/
|
||||||
|
describe('mapSessionUpdate (shared ACP event mapping)', () => {
|
||||||
|
function note(update: SessionNotification['update']): SessionNotification {
|
||||||
|
return { sessionId: 's1', update };
|
||||||
|
}
|
||||||
|
|
||||||
|
it('maps an agent_message_chunk text → a text event', () => {
|
||||||
|
const events = mapSessionUpdate(
|
||||||
|
note({ sessionUpdate: 'agent_message_chunk', content: { type: 'text', text: 'hello' } }),
|
||||||
|
);
|
||||||
|
expect(events).toEqual([{ type: 'text', text: 'hello' }]);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('maps an agent_thought_chunk text → a reasoning event', () => {
|
||||||
|
const events = mapSessionUpdate(
|
||||||
|
note({ sessionUpdate: 'agent_thought_chunk', content: { type: 'text', text: 'thinking' } }),
|
||||||
|
);
|
||||||
|
expect(events).toEqual([{ type: 'reasoning', text: 'thinking' }]);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('ignores non-text content on message/thought chunks', () => {
|
||||||
|
const img = mapSessionUpdate(
|
||||||
|
note({
|
||||||
|
sessionUpdate: 'agent_message_chunk',
|
||||||
|
content: { type: 'image', data: 'x', mimeType: 'image/png' },
|
||||||
|
} as never),
|
||||||
|
);
|
||||||
|
expect(img).toEqual([]);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('maps a tool_call → a tool_call event with a merged snapshot', () => {
|
||||||
|
const events = mapSessionUpdate(
|
||||||
|
note({
|
||||||
|
sessionUpdate: 'tool_call',
|
||||||
|
toolCallId: 't1',
|
||||||
|
title: 'read_file',
|
||||||
|
status: 'pending',
|
||||||
|
rawInput: { path: 'a.ts' },
|
||||||
|
} as never),
|
||||||
|
);
|
||||||
|
expect(events).toHaveLength(1);
|
||||||
|
expect(events[0]!.type).toBe('tool_call');
|
||||||
|
const snap = (events[0] as { type: 'tool_call'; toolCall: AcpToolSnapshot }).toolCall;
|
||||||
|
expect(snap.toolCallId).toBe('t1');
|
||||||
|
expect(snap.title).toBe('read_file');
|
||||||
|
expect(snap.status).toBe('pending');
|
||||||
|
expect(snap.rawInput).toEqual({ path: 'a.ts' });
|
||||||
|
});
|
||||||
|
|
||||||
|
it('maps a tool_call_update → a tool_update event merged over the prior snapshot', () => {
|
||||||
|
const prior = new Map<string, AcpToolSnapshot>([
|
||||||
|
['t1', { toolCallId: 't1', title: 'read_file', status: 'pending', rawInput: { path: 'a.ts' } }],
|
||||||
|
]);
|
||||||
|
const events = mapSessionUpdate(
|
||||||
|
note({
|
||||||
|
sessionUpdate: 'tool_call_update',
|
||||||
|
toolCallId: 't1',
|
||||||
|
status: 'completed',
|
||||||
|
rawOutput: 'file body',
|
||||||
|
} as never),
|
||||||
|
prior,
|
||||||
|
);
|
||||||
|
expect(events).toHaveLength(1);
|
||||||
|
expect(events[0]!.type).toBe('tool_update');
|
||||||
|
const snap = (events[0] as { type: 'tool_update'; toolCall: AcpToolSnapshot }).toolCall;
|
||||||
|
expect(snap.toolCallId).toBe('t1');
|
||||||
|
// merged: title carried from prior, status updated, output added, input retained
|
||||||
|
expect(snap.title).toBe('read_file');
|
||||||
|
expect(snap.status).toBe('completed');
|
||||||
|
expect(snap.rawOutput).toBe('file body');
|
||||||
|
expect(snap.rawInput).toEqual({ path: 'a.ts' });
|
||||||
|
});
|
||||||
|
|
||||||
|
it('maps available_commands_update → a commands event', () => {
|
||||||
|
const events = mapSessionUpdate(
|
||||||
|
note({
|
||||||
|
sessionUpdate: 'available_commands_update',
|
||||||
|
availableCommands: [
|
||||||
|
{ name: 'plan', description: 'make a plan' },
|
||||||
|
{ name: 'review', description: null },
|
||||||
|
],
|
||||||
|
} as never),
|
||||||
|
);
|
||||||
|
expect(events).toEqual([
|
||||||
|
{
|
||||||
|
type: 'commands',
|
||||||
|
commands: [
|
||||||
|
{ name: 'plan', description: 'make a plan' },
|
||||||
|
{ name: 'review', description: undefined },
|
||||||
|
],
|
||||||
|
},
|
||||||
|
]);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('returns [] for unhandled update kinds (plan, mode change)', () => {
|
||||||
|
expect(mapSessionUpdate(note({ sessionUpdate: 'plan', entries: [] } as never))).toEqual([]);
|
||||||
|
expect(
|
||||||
|
mapSessionUpdate(note({ sessionUpdate: 'current_mode_update', currentModeId: 'code' } as never)),
|
||||||
|
).toEqual([]);
|
||||||
|
});
|
||||||
|
});
|
||||||
233
apps/coder/src/services/__tests__/agent-pool.test.ts
Normal file
233
apps/coder/src/services/__tests__/agent-pool.test.ts
Normal file
@@ -0,0 +1,233 @@
|
|||||||
|
import { describe, it, expect, vi } from 'vitest';
|
||||||
|
import { AgentPool, OPENCODE_POOL_KEY } from '../agent-pool.js';
|
||||||
|
import type {
|
||||||
|
AgentBackend,
|
||||||
|
AgentSessionHandle,
|
||||||
|
EnsureSessionOpts,
|
||||||
|
PromptCtx,
|
||||||
|
TurnResult,
|
||||||
|
} from '../agent-backend.js';
|
||||||
|
|
||||||
|
/**
|
||||||
|
* v2.6 Phase 3 — AgentPool lifecycle unit test (T.1). No DB / no child process:
|
||||||
|
* a fake AgentBackend records dispose + reports busy/health, so we exercise
|
||||||
|
* get-or-create, idle eviction, the LRU cap, the busy-never-evict rule, closeChat,
|
||||||
|
* and dispose-drains directly. The pure decisions are covered separately in
|
||||||
|
* backends/__tests__/lifecycle-decisions.test.ts; this verifies the wiring.
|
||||||
|
*/
|
||||||
|
|
||||||
|
class FakeBackend implements AgentBackend {
|
||||||
|
disposed = 0;
|
||||||
|
closedSessions = 0;
|
||||||
|
private busyFlag = false;
|
||||||
|
tickHealthCalls = 0;
|
||||||
|
|
||||||
|
constructor(public readonly name = 'fake') {}
|
||||||
|
|
||||||
|
setBusy(b: boolean): void {
|
||||||
|
this.busyFlag = b;
|
||||||
|
}
|
||||||
|
|
||||||
|
// — AgentBackend —
|
||||||
|
async ensureSession(sessionId: string, opts: EnsureSessionOpts): Promise<AgentSessionHandle> {
|
||||||
|
return {
|
||||||
|
sessionId,
|
||||||
|
agent: opts.agent,
|
||||||
|
backend: 'acp_warm',
|
||||||
|
chatId: opts.chatId,
|
||||||
|
worktreeId: opts.worktreeId,
|
||||||
|
agentSessionId: 'fake-session',
|
||||||
|
serverPort: null,
|
||||||
|
};
|
||||||
|
}
|
||||||
|
async prompt(_h: AgentSessionHandle, _input: string, _ctx: PromptCtx): Promise<TurnResult> {
|
||||||
|
return { ok: true };
|
||||||
|
}
|
||||||
|
async closeSession(): Promise<void> {
|
||||||
|
this.closedSessions++;
|
||||||
|
}
|
||||||
|
async dispose(): Promise<void> {
|
||||||
|
this.disposed++;
|
||||||
|
}
|
||||||
|
health(): 'up' | 'down' {
|
||||||
|
return 'up';
|
||||||
|
}
|
||||||
|
isBusy(): boolean {
|
||||||
|
return this.busyFlag;
|
||||||
|
}
|
||||||
|
async tickHealth(): Promise<void> {
|
||||||
|
this.tickHealthCalls++;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
describe('AgentPool — get/register/touch (3.1)', () => {
|
||||||
|
it('register then get returns the same backend', () => {
|
||||||
|
const pool = new AgentPool();
|
||||||
|
const b = new FakeBackend();
|
||||||
|
pool.register('chat-1', 'goose', b);
|
||||||
|
expect(pool.get('chat-1', 'goose')).toBe(b);
|
||||||
|
expect(pool.get('chat-1', 'qwen')).toBeUndefined();
|
||||||
|
});
|
||||||
|
|
||||||
|
it('peek does NOT exist for a missing key', () => {
|
||||||
|
const pool = new AgentPool();
|
||||||
|
expect(pool.peek('nope', 'goose')).toBeUndefined();
|
||||||
|
});
|
||||||
|
|
||||||
|
it('health reports size + busy count', () => {
|
||||||
|
const pool = new AgentPool();
|
||||||
|
const a = new FakeBackend();
|
||||||
|
const b = new FakeBackend();
|
||||||
|
b.setBusy(true);
|
||||||
|
pool.register('c1', 'goose', a);
|
||||||
|
pool.register('c2', 'qwen', b);
|
||||||
|
expect(pool.health()).toEqual({ size: 2, busy: 1 });
|
||||||
|
});
|
||||||
|
});
|
||||||
|
|
||||||
|
describe('AgentPool.sweep — idle TTL eviction (3.1)', () => {
|
||||||
|
it('evicts an idle backend past the TTL and disposes it', async () => {
|
||||||
|
const pool = new AgentPool({ idleTtlMs: 1_000, maxLive: 100 });
|
||||||
|
const b = new FakeBackend();
|
||||||
|
pool.register('c1', 'goose', b);
|
||||||
|
// Sweep with now far past the registration → idle → evicted.
|
||||||
|
const { evicted } = await pool.sweep(Date.now() + 10_000);
|
||||||
|
expect(evicted).toEqual(['c1:goose']);
|
||||||
|
expect(b.disposed).toBe(1);
|
||||||
|
expect(pool.get('c1', 'goose')).toBeUndefined();
|
||||||
|
});
|
||||||
|
|
||||||
|
it('never evicts a busy backend even past the TTL', async () => {
|
||||||
|
const pool = new AgentPool({ idleTtlMs: 1_000, maxLive: 100 });
|
||||||
|
const b = new FakeBackend();
|
||||||
|
b.setBusy(true);
|
||||||
|
pool.register('c1', 'goose', b);
|
||||||
|
const { evicted } = await pool.sweep(Date.now() + 10_000);
|
||||||
|
expect(evicted).toEqual([]);
|
||||||
|
expect(b.disposed).toBe(0);
|
||||||
|
expect(pool.get('c1', 'goose')).toBe(b);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('touch keeps a backend warm so the TTL measures from the last turn', async () => {
|
||||||
|
const pool = new AgentPool({ idleTtlMs: 5_000, maxLive: 100 });
|
||||||
|
const b = new FakeBackend();
|
||||||
|
pool.register('c1', 'goose', b);
|
||||||
|
const base = Date.now();
|
||||||
|
// 4s later, touch — resets activity. A sweep at +6s from base is only +2s from
|
||||||
|
// the touch → still within TTL → not evicted.
|
||||||
|
vi.spyOn(Date, 'now').mockReturnValue(base + 4_000);
|
||||||
|
pool.touch('c1', 'goose');
|
||||||
|
vi.restoreAllMocks();
|
||||||
|
const { evicted } = await pool.sweep(base + 6_000);
|
||||||
|
expect(evicted).toEqual([]);
|
||||||
|
});
|
||||||
|
});
|
||||||
|
|
||||||
|
describe('AgentPool.sweep — LRU cap (3.4)', () => {
|
||||||
|
it('evicts the least-recently-used beyond the cap', async () => {
|
||||||
|
const pool = new AgentPool({ idleTtlMs: 1_000_000, maxLive: 2 });
|
||||||
|
const base = 1_000_000;
|
||||||
|
const mk = (key: string, regAt: number) => {
|
||||||
|
vi.spyOn(Date, 'now').mockReturnValue(regAt);
|
||||||
|
const b = new FakeBackend(key);
|
||||||
|
const [chat, agent] = key.split(':');
|
||||||
|
pool.register(chat!, agent!, b);
|
||||||
|
vi.restoreAllMocks();
|
||||||
|
return b;
|
||||||
|
};
|
||||||
|
const a = mk('c1:goose', base + 100);
|
||||||
|
const b = mk('c2:goose', base + 300);
|
||||||
|
const c = mk('c3:goose', base + 200);
|
||||||
|
// 3 entries, cap 2, all within idle TTL → LRU (oldest = a@+100) evicted.
|
||||||
|
const { evicted } = await pool.sweep(base + 1_000);
|
||||||
|
expect(evicted).toEqual(['c1:goose']);
|
||||||
|
expect(a.disposed).toBe(1);
|
||||||
|
expect(b.disposed).toBe(0);
|
||||||
|
expect(c.disposed).toBe(0);
|
||||||
|
});
|
||||||
|
});
|
||||||
|
|
||||||
|
describe('AgentPool.sweep — proactive health probe (3.2)', () => {
|
||||||
|
it('drives each backend tickHealth before eviction', async () => {
|
||||||
|
const pool = new AgentPool({ idleTtlMs: 1_000_000, maxLive: 100 });
|
||||||
|
const b = new FakeBackend();
|
||||||
|
pool.register('c1', 'opencode', b);
|
||||||
|
await pool.sweep(Date.now());
|
||||||
|
expect(b.tickHealthCalls).toBe(1);
|
||||||
|
});
|
||||||
|
});
|
||||||
|
|
||||||
|
describe('AgentPool.closeChat — chat-close teardown (3.3)', () => {
|
||||||
|
it('disposes only the matching chat keys, leaving others + the shared server', async () => {
|
||||||
|
const pool = new AgentPool();
|
||||||
|
const goose = new FakeBackend('goose');
|
||||||
|
const qwen = new FakeBackend('qwen');
|
||||||
|
const other = new FakeBackend('other-chat');
|
||||||
|
const ocServer = new FakeBackend('opencode-server');
|
||||||
|
pool.register('chat-1', 'goose', goose);
|
||||||
|
pool.register('chat-1', 'qwen', qwen);
|
||||||
|
pool.register('chat-2', 'goose', other);
|
||||||
|
pool.register(OPENCODE_POOL_KEY, 'opencode', ocServer);
|
||||||
|
|
||||||
|
const removed = await pool.closeChat('chat-1');
|
||||||
|
expect(removed.sort()).toEqual(['chat-1:goose', 'chat-1:qwen']);
|
||||||
|
expect(goose.disposed).toBe(1);
|
||||||
|
expect(qwen.disposed).toBe(1);
|
||||||
|
// other chat + shared opencode server untouched.
|
||||||
|
expect(other.disposed).toBe(0);
|
||||||
|
expect(ocServer.disposed).toBe(0);
|
||||||
|
expect(pool.peek('chat-2', 'goose')).toBe(other);
|
||||||
|
expect(pool.peek(OPENCODE_POOL_KEY, 'opencode')).toBe(ocServer);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('does not dispose a busy backend on closeChat', async () => {
|
||||||
|
const pool = new AgentPool();
|
||||||
|
const b = new FakeBackend();
|
||||||
|
b.setBusy(true);
|
||||||
|
pool.register('chat-1', 'goose', b);
|
||||||
|
const removed = await pool.closeChat('chat-1');
|
||||||
|
expect(removed).toEqual([]);
|
||||||
|
expect(b.disposed).toBe(0);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('does not match a chat id that is a prefix of another', async () => {
|
||||||
|
// 'chat-1' must not match 'chat-10' — keys are `${chatId}:${agent}` so the
|
||||||
|
// colon delimiter prevents the prefix collision.
|
||||||
|
const pool = new AgentPool();
|
||||||
|
const a = new FakeBackend();
|
||||||
|
const b = new FakeBackend();
|
||||||
|
pool.register('chat-1', 'goose', a);
|
||||||
|
pool.register('chat-10', 'goose', b);
|
||||||
|
await pool.closeChat('chat-1');
|
||||||
|
expect(a.disposed).toBe(1);
|
||||||
|
expect(b.disposed).toBe(0);
|
||||||
|
expect(pool.peek('chat-10', 'goose')).toBe(b);
|
||||||
|
});
|
||||||
|
});
|
||||||
|
|
||||||
|
describe('AgentPool.dispose — drain all (T.1)', () => {
|
||||||
|
it('disposes every backend and clears the map', async () => {
|
||||||
|
const pool = new AgentPool();
|
||||||
|
const a = new FakeBackend();
|
||||||
|
const b = new FakeBackend();
|
||||||
|
pool.register('c1', 'goose', a);
|
||||||
|
pool.register('c2', 'qwen', b);
|
||||||
|
await pool.dispose();
|
||||||
|
expect(a.disposed).toBe(1);
|
||||||
|
expect(b.disposed).toBe(1);
|
||||||
|
expect(pool.health()).toEqual({ size: 0, busy: 0 });
|
||||||
|
});
|
||||||
|
|
||||||
|
it('tolerates a backend whose dispose throws', async () => {
|
||||||
|
const pool = new AgentPool();
|
||||||
|
const good = new FakeBackend();
|
||||||
|
const bad = new FakeBackend();
|
||||||
|
bad.dispose = async () => {
|
||||||
|
throw new Error('boom');
|
||||||
|
};
|
||||||
|
pool.register('c1', 'goose', bad);
|
||||||
|
pool.register('c2', 'qwen', good);
|
||||||
|
await expect(pool.dispose()).resolves.toBeUndefined();
|
||||||
|
expect(good.disposed).toBe(1);
|
||||||
|
});
|
||||||
|
});
|
||||||
170
apps/coder/src/services/__tests__/reconnect_integration.test.ts
Normal file
170
apps/coder/src/services/__tests__/reconnect_integration.test.ts
Normal file
@@ -0,0 +1,170 @@
|
|||||||
|
import { describe, it, expect, beforeAll, afterAll } from 'vitest';
|
||||||
|
import { readFileSync, existsSync } from 'node:fs';
|
||||||
|
import { rm, mkdir } from 'node:fs/promises';
|
||||||
|
import { resolve } from 'node:path';
|
||||||
|
import postgres from 'postgres';
|
||||||
|
import {
|
||||||
|
ensureSessionWorktree,
|
||||||
|
closeChatBackendState,
|
||||||
|
rebaselineWorktreeAfterApply,
|
||||||
|
} from '../worktrees.js';
|
||||||
|
import { reapOrphanWorktrees } from '../orphan-worktree-reaper.js';
|
||||||
|
import { hostExec } from '../host-exec.js';
|
||||||
|
|
||||||
|
/**
|
||||||
|
* v2.6 Phase 3 (3.6) — reconnect-after-restart integration test.
|
||||||
|
*
|
||||||
|
* Proves the DB-truth side of crash/restart recovery: a BooCoder restart wipes the
|
||||||
|
* in-memory pool, but the persistent `worktrees` + `agent_sessions` rows survive,
|
||||||
|
* so the "next turn" re-resolves the SAME worktree (reattach, no new dir) and the
|
||||||
|
* agent-session row is still there to resume from. Also exercises the chat-close
|
||||||
|
* hook (3.3), the apply re-baseline (3.5), and the orphan reaper (3.4) end-to-end
|
||||||
|
* against a real git repo + postgres.
|
||||||
|
*
|
||||||
|
* Requires DATABASE_URL (DB-opt-in; skips cleanly otherwise) AND git on PATH. Runs:
|
||||||
|
* DATABASE_URL='postgres://boocode:devpass@localhost:5500/boochat' pnpm -C apps/coder test
|
||||||
|
*/
|
||||||
|
describe.runIf(!!process.env.DATABASE_URL)('reconnect after restart (Phase 3)', () => {
|
||||||
|
let sql: ReturnType<typeof postgres>;
|
||||||
|
const stamp = Date.now();
|
||||||
|
const projectDir = `/tmp/boocode-reconnect-proj-${stamp}`;
|
||||||
|
let projectId: string;
|
||||||
|
let sessionId: string;
|
||||||
|
let chatId: string;
|
||||||
|
|
||||||
|
beforeAll(async () => {
|
||||||
|
sql = postgres(process.env.DATABASE_URL!, { max: 3 });
|
||||||
|
|
||||||
|
// Both schemas land in the one boochat DB: server owns sessions/chats/projects,
|
||||||
|
// coder owns worktrees/agent_sessions (FK targets must pre-exist → server first).
|
||||||
|
const serverSchema = resolve(__dirname, '../../../../server/src/schema.sql');
|
||||||
|
const coderSchema = resolve(__dirname, '../../schema.sql');
|
||||||
|
await sql.unsafe(readFileSync(serverSchema, 'utf8'));
|
||||||
|
await sql.unsafe(readFileSync(coderSchema, 'utf8'));
|
||||||
|
|
||||||
|
// A real git repo with one commit so worktree add / diff / rev-parse work.
|
||||||
|
await mkdir(projectDir, { recursive: true });
|
||||||
|
await hostExec(
|
||||||
|
`cd ${projectDir} && git init -q && git config user.email t@t && git config user.name t ` +
|
||||||
|
`&& echo hello > README.md && git add -A && git commit -qm init`,
|
||||||
|
{ timeoutMs: 20_000 },
|
||||||
|
);
|
||||||
|
|
||||||
|
const [project] = await sql<{ id: string }[]>`
|
||||||
|
INSERT INTO projects (name, path, status) VALUES ('reconnect-test', ${projectDir}, 'open') RETURNING id
|
||||||
|
`;
|
||||||
|
projectId = project!.id;
|
||||||
|
const [session] = await sql<{ id: string }[]>`
|
||||||
|
INSERT INTO sessions (project_id, name, model, status)
|
||||||
|
VALUES (${projectId}, 'recon', 'm', 'open') RETURNING id
|
||||||
|
`;
|
||||||
|
sessionId = session!.id;
|
||||||
|
const [chat] = await sql<{ id: string }[]>`
|
||||||
|
INSERT INTO chats (session_id, name, status) VALUES (${sessionId}, 'tab', 'open') RETURNING id
|
||||||
|
`;
|
||||||
|
chatId = chat!.id;
|
||||||
|
});
|
||||||
|
|
||||||
|
afterAll(async () => {
|
||||||
|
if (sql) {
|
||||||
|
// Best-effort worktree cleanup before dropping rows.
|
||||||
|
const rows = await sql<{ path: string }[]>`SELECT path FROM worktrees WHERE session_id = ${sessionId}`.catch(() => []);
|
||||||
|
for (const r of rows) {
|
||||||
|
await hostExec(`git -C ${projectDir} worktree remove ${r.path} --force`, { timeoutMs: 10_000 }).catch(() => {});
|
||||||
|
}
|
||||||
|
await sql`DELETE FROM agent_sessions WHERE chat_id = ${chatId}`.catch(() => {});
|
||||||
|
await sql`DELETE FROM worktrees WHERE session_id = ${sessionId}`.catch(() => {});
|
||||||
|
await sql`DELETE FROM chats WHERE id = ${chatId}`.catch(() => {});
|
||||||
|
await sql`DELETE FROM sessions WHERE id = ${sessionId}`.catch(() => {});
|
||||||
|
await sql`DELETE FROM projects WHERE id = ${projectId}`.catch(() => {});
|
||||||
|
await sql.end({ timeout: 5 });
|
||||||
|
}
|
||||||
|
await rm(projectDir, { recursive: true, force: true });
|
||||||
|
});
|
||||||
|
|
||||||
|
it('reattaches the SAME worktree across a simulated restart (no new dir)', async () => {
|
||||||
|
// "Turn 1" — first ensureSessionWorktree creates the worktree + row.
|
||||||
|
const first = await ensureSessionWorktree(sql, projectDir, sessionId);
|
||||||
|
expect(existsSync(first.worktreePath)).toBe(true);
|
||||||
|
expect(first.baseCommit).toBeTruthy();
|
||||||
|
|
||||||
|
// Simulate an agent_sessions row written by turn 1 (opencode).
|
||||||
|
await sql`
|
||||||
|
INSERT INTO agent_sessions (chat_id, session_id, worktree_id, agent, backend, agent_session_id, status, last_active_at)
|
||||||
|
VALUES (${chatId}, ${sessionId}, ${first.worktreeId}, 'opencode', 'opencode_server', 'oc-sess-1', 'active', clock_timestamp())
|
||||||
|
ON CONFLICT (chat_id, agent) DO NOTHING
|
||||||
|
`;
|
||||||
|
|
||||||
|
// "Restart" = brand-new resolution with NO in-memory state. ensureSessionWorktree
|
||||||
|
// must return the EXISTING row (same id + path), proving reattach not re-create.
|
||||||
|
const second = await ensureSessionWorktree(sql, projectDir, sessionId);
|
||||||
|
expect(second.worktreeId).toBe(first.worktreeId);
|
||||||
|
expect(second.worktreePath).toBe(first.worktreePath);
|
||||||
|
expect(second.baseCommit).toBe(first.baseCommit);
|
||||||
|
|
||||||
|
// The agent_sessions row survived the "restart" with its resume handle intact.
|
||||||
|
const [row] = await sql<{ agent_session_id: string; status: string }[]>`
|
||||||
|
SELECT agent_session_id, status FROM agent_sessions WHERE chat_id = ${chatId} AND agent = 'opencode'
|
||||||
|
`;
|
||||||
|
expect(row!.agent_session_id).toBe('oc-sess-1');
|
||||||
|
});
|
||||||
|
|
||||||
|
it('re-baselines the worktree diff after apply (3.5)', async () => {
|
||||||
|
const wt = await ensureSessionWorktree(sql, projectDir, sessionId);
|
||||||
|
const baseBefore = wt.baseCommit;
|
||||||
|
// Make a change in the worktree (as an external agent would).
|
||||||
|
await hostExec(`cd ${wt.worktreePath} && echo change >> README.md`, { timeoutMs: 10_000 });
|
||||||
|
|
||||||
|
const r = await rebaselineWorktreeAfterApply(sql, sessionId);
|
||||||
|
expect(r.rebaselined).toBe(true);
|
||||||
|
expect(r.newBaseCommit).toBeTruthy();
|
||||||
|
expect(r.newBaseCommit).not.toBe(baseBefore);
|
||||||
|
|
||||||
|
const [row] = await sql<{ base_commit: string }[]>`
|
||||||
|
SELECT base_commit FROM worktrees WHERE session_id = ${sessionId} AND status = 'active'
|
||||||
|
`;
|
||||||
|
expect(row!.base_commit).toBe(r.newBaseCommit);
|
||||||
|
|
||||||
|
// Idempotent: a second re-baseline with no new edits is a no-op.
|
||||||
|
const r2 = await rebaselineWorktreeAfterApply(sql, sessionId);
|
||||||
|
expect(r2.rebaselined).toBe(false);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('chat-close hook closes agent rows + removes the worktree on the last chat (3.3)', async () => {
|
||||||
|
// Sanity: an active worktree + agent row exist from the prior tests.
|
||||||
|
const beforeWt = await sql<{ id: string }[]>`SELECT id FROM worktrees WHERE session_id = ${sessionId} AND status = 'active'`;
|
||||||
|
expect(beforeWt.length).toBe(1);
|
||||||
|
|
||||||
|
const result = await closeChatBackendState(sql, chatId);
|
||||||
|
expect(result.agentRowsClosed).toBeGreaterThanOrEqual(1);
|
||||||
|
// chatId is the session's only chat → worktree removed (it was clean after the
|
||||||
|
// re-baseline commit), not at-risk.
|
||||||
|
expect(result.worktreeAtRisk).toBe(false);
|
||||||
|
expect(result.worktreeRemoved).toBe(true);
|
||||||
|
|
||||||
|
const [agentRow] = await sql<{ status: string }[]>`
|
||||||
|
SELECT status FROM agent_sessions WHERE chat_id = ${chatId} AND agent = 'opencode'
|
||||||
|
`;
|
||||||
|
expect(agentRow!.status).toBe('closed');
|
||||||
|
|
||||||
|
const activeWt = await sql<{ id: string }[]>`SELECT id FROM worktrees WHERE session_id = ${sessionId} AND status = 'active'`;
|
||||||
|
expect(activeWt.length).toBe(0); // archived, no longer active
|
||||||
|
});
|
||||||
|
|
||||||
|
it('orphan reaper leaves a live worktree alone and reaps a row-less dir (3.4)', async () => {
|
||||||
|
// Recreate a live worktree for this session (the close test archived the old one).
|
||||||
|
const live = await ensureSessionWorktree(sql, projectDir, sessionId);
|
||||||
|
expect(existsSync(live.worktreePath)).toBe(true);
|
||||||
|
|
||||||
|
// A live worktree (active row) with grace 0 must NOT be reaped.
|
||||||
|
const r1 = await reapOrphanWorktrees(sql, console as never, 0, Date.now());
|
||||||
|
expect(r1.reaped).not.toContain(live.worktreePath);
|
||||||
|
|
||||||
|
// Now archive its row (simulating a leaked dir) and reap again — it becomes an
|
||||||
|
// orphan and is reclaimed (it's clean → not at-risk).
|
||||||
|
await sql`UPDATE worktrees SET status = 'archived' WHERE id = ${live.worktreeId}`;
|
||||||
|
const r2 = await reapOrphanWorktrees(sql, console as never, 0, Date.now());
|
||||||
|
expect(r2.reaped).toContain(live.worktreePath);
|
||||||
|
expect(existsSync(live.worktreePath)).toBe(false);
|
||||||
|
});
|
||||||
|
});
|
||||||
@@ -32,9 +32,9 @@ import { createAcpNdJsonStream } from './acp-stream.js';
|
|||||||
import { waitForPermissionResponse, waitForElicitationResponse, cancelPendingPermission } from './permission-waiter.js';
|
import { waitForPermissionResponse, waitForElicitationResponse, cancelPendingPermission } from './permission-waiter.js';
|
||||||
import { mergeTaskCommands, getTaskCommands } from './agent-commands-cache.js';
|
import { mergeTaskCommands, getTaskCommands } from './agent-commands-cache.js';
|
||||||
import { readWorktreeTextFile, writeWorktreeTextFile } from './acp-client-fs.js';
|
import { readWorktreeTextFile, writeWorktreeTextFile } from './acp-client-fs.js';
|
||||||
|
import { mapSessionUpdate } from './acp-event-map.js';
|
||||||
import {
|
import {
|
||||||
type AcpToolSnapshot,
|
type AcpToolSnapshot,
|
||||||
mergeToolSnapshot,
|
|
||||||
snapshotToWireToolCall,
|
snapshotToWireToolCall,
|
||||||
synthesizeCanceledSnapshots,
|
synthesizeCanceledSnapshots,
|
||||||
} from './acp-tool-snapshot.js';
|
} from './acp-tool-snapshot.js';
|
||||||
@@ -159,63 +159,47 @@ class AcpStreamContext {
|
|||||||
} as WsFrame);
|
} as WsFrame);
|
||||||
}
|
}
|
||||||
|
|
||||||
handleToolUpdate(toolCallId: string, update: Parameters<typeof mergeToolSnapshot>[1]): void {
|
|
||||||
const previous = this.toolSnapshots.get(toolCallId);
|
|
||||||
const snapshot = mergeToolSnapshot(toolCallId, update, previous);
|
|
||||||
this.toolSnapshots.set(toolCallId, snapshot);
|
|
||||||
this.publishToolSnapshot(snapshot);
|
|
||||||
}
|
|
||||||
|
|
||||||
async handleSessionUpdate(params: SessionNotification): Promise<void> {
|
async handleSessionUpdate(params: SessionNotification): Promise<void> {
|
||||||
const update = params.update;
|
// v2.6 Phase 2: the case-by-case mapping now lives in the shared, pure
|
||||||
switch (update.sessionUpdate) {
|
// `mapSessionUpdate` (reused by the warm ACP backend). This method keeps the
|
||||||
case 'agent_message_chunk': {
|
// identical broker-publishing side effects — it just translates the normalized
|
||||||
const content = update.content;
|
// AgentEvents back into the same frames it always emitted. `this.toolSnapshots`
|
||||||
if (content.type === 'text' && 'text' in content) {
|
// is the merge accumulator, so a later tool_call_update merges over its
|
||||||
const text = (content as { text: string }).text;
|
// tool_call (the prior `handleToolUpdate` behavior, byte-for-byte).
|
||||||
this.textChunks.push(text);
|
for (const event of mapSessionUpdate(params, this.toolSnapshots)) {
|
||||||
|
switch (event.type) {
|
||||||
|
case 'text':
|
||||||
|
this.textChunks.push(event.text);
|
||||||
if (this.canStream()) {
|
if (this.canStream()) {
|
||||||
this.opts.broker!.publishFrame(this.opts.sessionId!, {
|
this.opts.broker!.publishFrame(this.opts.sessionId!, {
|
||||||
type: 'delta',
|
type: 'delta',
|
||||||
message_id: this.opts.messageId!,
|
message_id: this.opts.messageId!,
|
||||||
chat_id: this.opts.chatId!,
|
chat_id: this.opts.chatId!,
|
||||||
content: text,
|
content: event.text,
|
||||||
} as WsFrame);
|
} as WsFrame);
|
||||||
}
|
}
|
||||||
}
|
|
||||||
break;
|
break;
|
||||||
}
|
case 'reasoning':
|
||||||
case 'agent_thought_chunk': {
|
this.reasoningChunks.push(event.text);
|
||||||
const content = update.content;
|
|
||||||
if (content.type === 'text' && 'text' in content) {
|
|
||||||
const text = (content as { text: string }).text;
|
|
||||||
this.reasoningChunks.push(text);
|
|
||||||
if (this.canStream()) {
|
if (this.canStream()) {
|
||||||
this.opts.broker!.publishFrame(this.opts.sessionId!, {
|
this.opts.broker!.publishFrame(this.opts.sessionId!, {
|
||||||
type: 'reasoning_delta',
|
type: 'reasoning_delta',
|
||||||
message_id: this.opts.messageId!,
|
message_id: this.opts.messageId!,
|
||||||
chat_id: this.opts.chatId!,
|
chat_id: this.opts.chatId!,
|
||||||
content: text,
|
content: event.text,
|
||||||
} as WsFrame);
|
} as WsFrame);
|
||||||
}
|
}
|
||||||
}
|
|
||||||
break;
|
break;
|
||||||
}
|
|
||||||
case 'tool_call':
|
case 'tool_call':
|
||||||
this.handleToolUpdate(update.toolCallId, update);
|
case 'tool_update':
|
||||||
|
// mapSessionUpdate already stored the merged snapshot in this.toolSnapshots.
|
||||||
|
this.publishToolSnapshot(event.toolCall);
|
||||||
break;
|
break;
|
||||||
case 'tool_call_update':
|
case 'commands':
|
||||||
this.handleToolUpdate(update.toolCallId, update);
|
if (this.opts.taskId && event.commands.length > 0) {
|
||||||
break;
|
mergeTaskCommands(this.opts.taskId, event.commands);
|
||||||
case 'available_commands_update': {
|
|
||||||
const commands = update.availableCommands.map((cmd) => ({
|
|
||||||
name: cmd.name,
|
|
||||||
description: cmd.description ?? undefined,
|
|
||||||
}));
|
|
||||||
if (this.opts.taskId && commands.length > 0) {
|
|
||||||
mergeTaskCommands(this.opts.taskId, commands);
|
|
||||||
if (this.canStream() && this.opts.sessionId) {
|
if (this.canStream() && this.opts.sessionId) {
|
||||||
const all = getTaskCommands(this.opts.taskId) ?? commands;
|
const all = getTaskCommands(this.opts.taskId) ?? event.commands;
|
||||||
this.opts.broker!.publishFrame(this.opts.sessionId, {
|
this.opts.broker!.publishFrame(this.opts.sessionId, {
|
||||||
type: 'agent_commands',
|
type: 'agent_commands',
|
||||||
task_id: this.opts.taskId,
|
task_id: this.opts.taskId,
|
||||||
@@ -226,8 +210,6 @@ class AcpStreamContext {
|
|||||||
}
|
}
|
||||||
break;
|
break;
|
||||||
}
|
}
|
||||||
default:
|
|
||||||
break;
|
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
|
|||||||
68
apps/coder/src/services/acp-event-map.ts
Normal file
68
apps/coder/src/services/acp-event-map.ts
Normal file
@@ -0,0 +1,68 @@
|
|||||||
|
/**
|
||||||
|
* Shared ACP session-update → normalized AgentEvent mapping.
|
||||||
|
*
|
||||||
|
* Extracted verbatim (v2.6 Phase 2) from `AcpStreamContext.handleSessionUpdate`
|
||||||
|
* in `acp-dispatch.ts` so the warm ACP backend (`backends/warm-acp.ts`) and the
|
||||||
|
* one-shot dispatch share ONE mapping. The one-shot path translates the returned
|
||||||
|
* events into broker frames itself (preserving its prior behavior byte-for-byte);
|
||||||
|
* the warm backend forwards them to the dispatcher's `ctx.onEvent` exactly like
|
||||||
|
* the opencode-server backend does. No I/O, no broker — pure, so it's unit-testable.
|
||||||
|
*
|
||||||
|
* Spec: openspec/changes/v2-6-persistent-agent-sessions/design.md §2b.
|
||||||
|
*/
|
||||||
|
import type { SessionNotification } from '@agentclientprotocol/sdk';
|
||||||
|
import type { AgentEvent } from './agent-backend.js';
|
||||||
|
import { type AcpToolSnapshot, mergeToolSnapshot } from './acp-tool-snapshot.js';
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Map one ACP `session/update` notification to zero-or-more normalized AgentEvents.
|
||||||
|
*
|
||||||
|
* `priorSnapshots` is the caller-owned tool-call snapshot accumulator (toolCallId →
|
||||||
|
* snapshot). For `tool_call` / `tool_call_update` the merged snapshot is written
|
||||||
|
* back into it (mutated in place, mirroring `AcpStreamContext.handleToolUpdate`)
|
||||||
|
* so a later `tool_call_update` merges over the earlier `tool_call`. Pass an empty
|
||||||
|
* Map for a stateless single call.
|
||||||
|
*
|
||||||
|
* Returns an array (never throws) so the caller can splat it onto `onEvent`.
|
||||||
|
*/
|
||||||
|
export function mapSessionUpdate(
|
||||||
|
params: SessionNotification,
|
||||||
|
priorSnapshots: Map<string, AcpToolSnapshot> = new Map(),
|
||||||
|
): AgentEvent[] {
|
||||||
|
const update = params.update;
|
||||||
|
switch (update.sessionUpdate) {
|
||||||
|
case 'agent_message_chunk': {
|
||||||
|
const content = update.content;
|
||||||
|
if (content.type === 'text' && 'text' in content) {
|
||||||
|
return [{ type: 'text', text: (content as { text: string }).text }];
|
||||||
|
}
|
||||||
|
return [];
|
||||||
|
}
|
||||||
|
case 'agent_thought_chunk': {
|
||||||
|
const content = update.content;
|
||||||
|
if (content.type === 'text' && 'text' in content) {
|
||||||
|
return [{ type: 'reasoning', text: (content as { text: string }).text }];
|
||||||
|
}
|
||||||
|
return [];
|
||||||
|
}
|
||||||
|
case 'tool_call': {
|
||||||
|
const snapshot = mergeToolSnapshot(update.toolCallId, update, priorSnapshots.get(update.toolCallId));
|
||||||
|
priorSnapshots.set(update.toolCallId, snapshot);
|
||||||
|
return [{ type: 'tool_call', toolCall: snapshot }];
|
||||||
|
}
|
||||||
|
case 'tool_call_update': {
|
||||||
|
const snapshot = mergeToolSnapshot(update.toolCallId, update, priorSnapshots.get(update.toolCallId));
|
||||||
|
priorSnapshots.set(update.toolCallId, snapshot);
|
||||||
|
return [{ type: 'tool_update', toolCall: snapshot }];
|
||||||
|
}
|
||||||
|
case 'available_commands_update': {
|
||||||
|
const commands = update.availableCommands.map((cmd) => ({
|
||||||
|
name: cmd.name,
|
||||||
|
description: cmd.description ?? undefined,
|
||||||
|
}));
|
||||||
|
return [{ type: 'commands', commands }];
|
||||||
|
}
|
||||||
|
default:
|
||||||
|
return [];
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -70,6 +70,12 @@ export interface PromptCtx {
|
|||||||
model: string;
|
model: string;
|
||||||
signal: AbortSignal;
|
signal: AbortSignal;
|
||||||
onEvent: (e: AgentEvent) => void;
|
onEvent: (e: AgentEvent) => void;
|
||||||
|
/** Phase 2: per-turn task id, so a warm ACP backend can route permission /
|
||||||
|
* elicitation prompts back to the UI via the permission-waiter. Optional —
|
||||||
|
* the opencode-server backend (autonomous) ignores it. */
|
||||||
|
taskId?: string;
|
||||||
|
/** Phase 2: per-turn mode id (gates autonomous mode in the permission-waiter). */
|
||||||
|
modeId?: string;
|
||||||
}
|
}
|
||||||
|
|
||||||
/** Result of a completed turn (§2). Diff/persist happen outside the backend. */
|
/** Result of a completed turn (§2). Diff/persist happen outside the backend. */
|
||||||
@@ -93,4 +99,21 @@ export interface AgentBackend {
|
|||||||
dispose(): Promise<void>;
|
dispose(): Promise<void>;
|
||||||
/** Liveness for health endpoint + dispatcher fallback decision. §2 */
|
/** Liveness for health endpoint + dispatcher fallback decision. §2 */
|
||||||
health(): 'up' | 'down';
|
health(): 'up' | 'down';
|
||||||
|
/**
|
||||||
|
* v2.6 Phase 3: true iff a turn is in flight on this backend. The pool's idle
|
||||||
|
* eviction + LRU cap NEVER evict a busy backend (design §6 busy rule); the
|
||||||
|
* health-monitor defers a restart while busy (stale-grace). Optional so the
|
||||||
|
* Phase-0 scaffold and any test double stay compatible — absent ⇒ treated as
|
||||||
|
* not busy. opencode-server (multi-session) is busy iff ANY session has an
|
||||||
|
* active turn; warm-acp (single session) iff its one slot is active.
|
||||||
|
*/
|
||||||
|
isBusy?(): boolean;
|
||||||
|
/**
|
||||||
|
* v2.6 Phase 3: optional proactive health probe + busy-aware self-restart, run
|
||||||
|
* by the pool's periodic sweep. The opencode-server backend implements it
|
||||||
|
* (detects a hung-but-not-exited server and restarts when non-busy). Backends
|
||||||
|
* with no long-lived shared process (warm-ACP recovers lazily on its own child
|
||||||
|
* exit) can omit it. Must never throw — the sweep ignores rejections.
|
||||||
|
*/
|
||||||
|
tickHealth?(now?: number): Promise<void>;
|
||||||
}
|
}
|
||||||
|
|||||||
@@ -1,44 +1,246 @@
|
|||||||
/**
|
/**
|
||||||
* v2.6 — AgentPool (Phase 0 scaffold).
|
* v2.6 — AgentPool.
|
||||||
*
|
*
|
||||||
* Lazy get-or-create registry of `AgentBackend` instances keyed by
|
* Lazy get-or-create registry of `AgentBackend` instances keyed by
|
||||||
* `${sessionId}:${agent}`. Phase 0 ships the skeleton only: an in-memory Map,
|
* `${primary}:${agent}` (primary = chatId for warm-ACP, a fixed sentinel for the
|
||||||
* lookup / register / health, and clean disposal wired to the server's onClose.
|
* single shared opencode server). Phase 0 shipped the skeleton (Map + health +
|
||||||
* Spawning lands in Phase 1/2; nothing populates the map yet.
|
* dispose). Phase 3 adds the LIFECYCLE: per-entry idle tracking, a periodic
|
||||||
|
* idle-TTL + LRU-cap sweep (the pure decisions live in
|
||||||
|
* `backends/lifecycle-decisions.ts`), and a `closeChat` helper for the chat-close
|
||||||
|
* hook. Reattach after eviction is implicit — the next turn's `ensureSession`
|
||||||
|
* rebuilds the backend from `agent_sessions` / `worktrees` (DB is the source of
|
||||||
|
* truth; the in-memory pool is a warm cache).
|
||||||
*
|
*
|
||||||
* Spec: openspec/changes/v2-6-persistent-agent-sessions/design.md §2.
|
* The hard rule (design §6): NEVER evict a busy backend (one with an in-flight
|
||||||
|
* turn). `selectIdleEvictionTargets` / `selectLruEvictionTargets` enforce it via
|
||||||
|
* `backend.isBusy()`; a long turn that outlives the TTL is left alone.
|
||||||
|
*
|
||||||
|
* Spec: openspec/changes/v2-6-persistent-agent-sessions/design.md §2 / §6.
|
||||||
*/
|
*/
|
||||||
|
import type { FastifyBaseLogger } from 'fastify';
|
||||||
import type { AgentBackend } from './agent-backend.js';
|
import type { AgentBackend } from './agent-backend.js';
|
||||||
|
import {
|
||||||
|
selectIdleEvictionTargets,
|
||||||
|
selectLruEvictionTargets,
|
||||||
|
DEFAULT_IDLE_TTL_MS,
|
||||||
|
DEFAULT_MAX_LIVE_BACKENDS,
|
||||||
|
} from './backends/lifecycle-decisions.js';
|
||||||
|
|
||||||
|
interface PoolEntry {
|
||||||
|
primary: string;
|
||||||
|
agent: string;
|
||||||
|
backend: AgentBackend;
|
||||||
|
/** Epoch ms of the last turn boundary (register or touch). Drives idle/LRU. */
|
||||||
|
lastActiveAt: number;
|
||||||
|
}
|
||||||
|
|
||||||
|
export interface AgentPoolOpts {
|
||||||
|
/** Idle TTL before a non-busy backend is evicted. Default 30 min. */
|
||||||
|
idleTtlMs?: number;
|
||||||
|
/** Max live backends before the LRU cap evicts the least-recently-used. */
|
||||||
|
maxLive?: number;
|
||||||
|
/** Sweep cadence. Default 60s (mirrors the server's periodic sweeper). */
|
||||||
|
sweepIntervalMs?: number;
|
||||||
|
log?: FastifyBaseLogger;
|
||||||
|
}
|
||||||
|
|
||||||
|
const DEFAULT_SWEEP_INTERVAL_MS = 60_000;
|
||||||
|
|
||||||
export class AgentPool {
|
export class AgentPool {
|
||||||
private readonly backends = new Map<string, AgentBackend>();
|
private readonly backends = new Map<string, PoolEntry>();
|
||||||
|
private idleTtlMs: number;
|
||||||
|
private maxLive: number;
|
||||||
|
private sweepIntervalMs: number;
|
||||||
|
private log: FastifyBaseLogger | undefined;
|
||||||
|
private sweepTimer: ReturnType<typeof setInterval> | null = null;
|
||||||
|
/** Serializes sweep runs so a slow eviction can't overlap the next tick. */
|
||||||
|
private sweeping = false;
|
||||||
|
|
||||||
private key(sessionId: string, agent: string): string {
|
constructor(opts: AgentPoolOpts = {}) {
|
||||||
return `${sessionId}:${agent}`;
|
this.idleTtlMs = opts.idleTtlMs ?? DEFAULT_IDLE_TTL_MS;
|
||||||
|
this.maxLive = opts.maxLive ?? DEFAULT_MAX_LIVE_BACKENDS;
|
||||||
|
this.sweepIntervalMs = opts.sweepIntervalMs ?? DEFAULT_SWEEP_INTERVAL_MS;
|
||||||
|
this.log = opts.log;
|
||||||
}
|
}
|
||||||
|
|
||||||
/** Map lookup only. Spawning is Phase 1/2 — never creates here. */
|
/** Apply env-derived knobs to the module singleton at bootstrap (before
|
||||||
get(sessionId: string, agent: string): AgentBackend | undefined {
|
* startReaper). Only overrides explicitly-provided fields. */
|
||||||
return this.backends.get(this.key(sessionId, agent));
|
configure(opts: AgentPoolOpts): void {
|
||||||
|
if (opts.idleTtlMs != null) this.idleTtlMs = opts.idleTtlMs;
|
||||||
|
if (opts.maxLive != null) this.maxLive = opts.maxLive;
|
||||||
|
if (opts.sweepIntervalMs != null) this.sweepIntervalMs = opts.sweepIntervalMs;
|
||||||
|
if (opts.log) this.log = opts.log;
|
||||||
}
|
}
|
||||||
|
|
||||||
/** Store a backend instance for this (session, agent). */
|
private key(primary: string, agent: string): string {
|
||||||
register(sessionId: string, agent: string, backend: AgentBackend): void {
|
return `${primary}:${agent}`;
|
||||||
this.backends.set(this.key(sessionId, agent), backend);
|
}
|
||||||
|
|
||||||
|
/** Map lookup only. Spawning happens in the dispatcher (Phase 1/2). A hit also
|
||||||
|
* marks the entry recently-active so a resolve-without-prompt doesn't get it
|
||||||
|
* evicted out from under an imminent turn. */
|
||||||
|
get(primary: string, agent: string): AgentBackend | undefined {
|
||||||
|
const entry = this.backends.get(this.key(primary, agent));
|
||||||
|
if (entry) entry.lastActiveAt = Date.now();
|
||||||
|
return entry?.backend;
|
||||||
|
}
|
||||||
|
|
||||||
|
/** Store a backend instance for this (primary, agent). */
|
||||||
|
register(primary: string, agent: string, backend: AgentBackend): void {
|
||||||
|
this.backends.set(this.key(primary, agent), { primary, agent, backend, lastActiveAt: Date.now() });
|
||||||
|
}
|
||||||
|
|
||||||
|
/** Mark a backend recently-active (call at turn start AND settle so a long turn
|
||||||
|
* keeps its slot warm). No-op if the key isn't pooled. */
|
||||||
|
touch(primary: string, agent: string): void {
|
||||||
|
const entry = this.backends.get(this.key(primary, agent));
|
||||||
|
if (entry) entry.lastActiveAt = Date.now();
|
||||||
|
}
|
||||||
|
|
||||||
|
/** Snapshot for the decision helpers (busy is read live from the backend). */
|
||||||
|
private snapshots(): { key: string; lastActiveAt: number; busy: boolean }[] {
|
||||||
|
const out: { key: string; lastActiveAt: number; busy: boolean }[] = [];
|
||||||
|
for (const [key, e] of this.backends) {
|
||||||
|
out.push({ key, lastActiveAt: e.lastActiveAt, busy: e.backend.isBusy?.() ?? false });
|
||||||
|
}
|
||||||
|
return out;
|
||||||
}
|
}
|
||||||
|
|
||||||
/** Summary for the health endpoint. */
|
/** Summary for the health endpoint. */
|
||||||
health(): { size: number } {
|
health(): { size: number; busy: number } {
|
||||||
return { size: this.backends.size };
|
let busy = 0;
|
||||||
|
for (const e of this.backends.values()) if (e.backend.isBusy?.()) busy++;
|
||||||
|
return { size: this.backends.size, busy };
|
||||||
|
}
|
||||||
|
|
||||||
|
// ─── Phase 3: idle-TTL + LRU eviction sweep ──────────────────────────────────
|
||||||
|
|
||||||
|
/** Start the periodic idle + LRU sweep. Idempotent; unref'd so it never holds
|
||||||
|
* the process open on its own. */
|
||||||
|
startReaper(log?: FastifyBaseLogger): void {
|
||||||
|
if (log) this.log = log;
|
||||||
|
if (this.sweepTimer) return;
|
||||||
|
this.sweepTimer = setInterval(() => {
|
||||||
|
void this.sweep().catch((err) => {
|
||||||
|
this.log?.warn({ err: errMsg(err) }, 'agent-pool: sweep error');
|
||||||
|
});
|
||||||
|
}, this.sweepIntervalMs);
|
||||||
|
this.sweepTimer.unref?.();
|
||||||
|
}
|
||||||
|
|
||||||
|
stopReaper(): void {
|
||||||
|
if (this.sweepTimer) {
|
||||||
|
clearInterval(this.sweepTimer);
|
||||||
|
this.sweepTimer = null;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* One sweep pass: evict idle-past-TTL backends, then enforce the LRU cap.
|
||||||
|
* Deduped (a key can't appear in both lists for one pass). Busy backends are
|
||||||
|
* excluded by the decision helpers — a live turn is never torn down.
|
||||||
|
*/
|
||||||
|
async sweep(now: number = Date.now()): Promise<{ evicted: string[] }> {
|
||||||
|
if (this.sweeping) return { evicted: [] };
|
||||||
|
this.sweeping = true;
|
||||||
|
try {
|
||||||
|
// Phase 3: drive each backend's optional proactive health probe first (the
|
||||||
|
// opencode server's busy-aware hung-detect + self-restart). Best-effort —
|
||||||
|
// a probe must never fail the sweep.
|
||||||
|
for (const e of this.backends.values()) {
|
||||||
|
if (e.backend.tickHealth) {
|
||||||
|
await e.backend.tickHealth(now).catch((err) => {
|
||||||
|
this.log?.warn({ key: this.key(e.primary, e.agent), err: errMsg(err) }, 'agent-pool: tickHealth threw');
|
||||||
|
});
|
||||||
|
}
|
||||||
|
}
|
||||||
|
const snaps = this.snapshots();
|
||||||
|
const idle = selectIdleEvictionTargets(snaps, now, this.idleTtlMs);
|
||||||
|
// LRU runs on what remains after idle eviction, so the two never double-evict.
|
||||||
|
const idleSet = new Set(idle);
|
||||||
|
const remaining = snaps.filter((s) => !idleSet.has(s.key));
|
||||||
|
const lru = selectLruEvictionTargets(remaining, this.maxLive);
|
||||||
|
const targets = [...idle, ...lru];
|
||||||
|
if (targets.length === 0) return { evicted: [] };
|
||||||
|
|
||||||
|
const evicted: string[] = [];
|
||||||
|
for (const key of targets) {
|
||||||
|
const entry = this.backends.get(key);
|
||||||
|
if (!entry) continue;
|
||||||
|
// Re-check busy right before teardown — a turn may have started since the
|
||||||
|
// snapshot. Defensive; the decision already excluded busy at snapshot time.
|
||||||
|
if (entry.backend.isBusy?.()) continue;
|
||||||
|
this.backends.delete(key);
|
||||||
|
try {
|
||||||
|
await entry.backend.dispose();
|
||||||
|
} catch (err) {
|
||||||
|
this.log?.warn({ key, err: errMsg(err) }, 'agent-pool: backend dispose threw during eviction');
|
||||||
|
}
|
||||||
|
evicted.push(key);
|
||||||
|
}
|
||||||
|
if (evicted.length > 0) {
|
||||||
|
this.log?.info({ evicted, size: this.backends.size }, 'agent-pool: evicted idle/over-cap backends');
|
||||||
|
}
|
||||||
|
return { evicted };
|
||||||
|
} finally {
|
||||||
|
this.sweeping = false;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
// ─── Phase 3: chat-close cleanup (3.3) ───────────────────────────────────────
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Tear down every pooled backend whose key is for this chat. Used by the
|
||||||
|
* chat-close hook. The opencode server is shared (keyed on a sentinel, not the
|
||||||
|
* chat), so it is NOT disposed here — only its session is closed via
|
||||||
|
* `closeSession`, which the hook calls directly with the per-(chat,agent)
|
||||||
|
* handle. Returns the keys it removed. Skips busy entries (a close mid-turn is
|
||||||
|
* rare but must not kill a live stream — the idle sweep reaps it shortly after).
|
||||||
|
*/
|
||||||
|
async closeChat(chatId: string): Promise<string[]> {
|
||||||
|
const removed: string[] = [];
|
||||||
|
const prefix = `${chatId}:`;
|
||||||
|
for (const [key, entry] of [...this.backends]) {
|
||||||
|
if (!key.startsWith(prefix)) continue;
|
||||||
|
if (entry.backend.isBusy?.()) continue;
|
||||||
|
this.backends.delete(key);
|
||||||
|
try {
|
||||||
|
await entry.backend.dispose();
|
||||||
|
} catch (err) {
|
||||||
|
this.log?.warn({ key, err: errMsg(err) }, 'agent-pool: dispose threw during closeChat');
|
||||||
|
}
|
||||||
|
removed.push(key);
|
||||||
|
}
|
||||||
|
return removed;
|
||||||
|
}
|
||||||
|
|
||||||
|
/** Look up a backend by exact key without bumping its activity (for closeSession). */
|
||||||
|
peek(primary: string, agent: string): AgentBackend | undefined {
|
||||||
|
return this.backends.get(this.key(primary, agent))?.backend;
|
||||||
}
|
}
|
||||||
|
|
||||||
/** Dispose every backend and clear the map. Tolerates throwing backends. */
|
/** Dispose every backend and clear the map. Tolerates throwing backends. */
|
||||||
async dispose(): Promise<void> {
|
async dispose(): Promise<void> {
|
||||||
|
this.stopReaper();
|
||||||
const entries = [...this.backends.values()];
|
const entries = [...this.backends.values()];
|
||||||
this.backends.clear();
|
this.backends.clear();
|
||||||
await Promise.allSettled(entries.map((b) => b.dispose()));
|
await Promise.allSettled(entries.map((e) => e.backend.dispose()));
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
/** Single shared instance — referenced only by the server's onClose hook in Phase 0. */
|
function errMsg(e: unknown): string {
|
||||||
|
return e instanceof Error ? e.message : String(e);
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* The shared opencode server is pooled under a FIXED sentinel (one server per
|
||||||
|
* BooCoder process, multiplexing all opencode sessions internally) rather than a
|
||||||
|
* chat id — so it is NOT torn down by `closeChat(chatId)` (only its per-chat
|
||||||
|
* session is closed). Exported so the dispatcher + the lifecycle close-hook agree
|
||||||
|
* on the key without drift.
|
||||||
|
*/
|
||||||
|
export const OPENCODE_POOL_KEY = '__opencode_server__';
|
||||||
|
|
||||||
|
/** Single shared instance — registered by the dispatcher, swept + drained by the
|
||||||
|
* server's onClose hook. */
|
||||||
export const agentPool = new AgentPool();
|
export const agentPool = new AgentPool();
|
||||||
|
|||||||
@@ -0,0 +1,176 @@
|
|||||||
|
import { describe, it, expect } from 'vitest';
|
||||||
|
import {
|
||||||
|
selectIdleEvictionTargets,
|
||||||
|
selectLruEvictionTargets,
|
||||||
|
decideRestart,
|
||||||
|
selectOrphanWorktreeTargets,
|
||||||
|
DEFAULT_IDLE_TTL_MS,
|
||||||
|
DEFAULT_MAX_LIVE_BACKENDS,
|
||||||
|
type PoolEntrySnapshot,
|
||||||
|
} from '../lifecycle-decisions.js';
|
||||||
|
|
||||||
|
/**
|
||||||
|
* v2.6 Phase 3 — pure lifecycle decisions. No DB, no children, no timers; `now`
|
||||||
|
* is injected. Models prune.ts:selectPruneTargets — the caller acts on the keys.
|
||||||
|
*/
|
||||||
|
|
||||||
|
const NOW = 1_000_000_000_000;
|
||||||
|
|
||||||
|
function entry(key: string, ageMs: number, busy = false): PoolEntrySnapshot {
|
||||||
|
return { key, lastActiveAt: NOW - ageMs, busy };
|
||||||
|
}
|
||||||
|
|
||||||
|
describe('selectIdleEvictionTargets (3.1)', () => {
|
||||||
|
it('evicts entries idle past the TTL', () => {
|
||||||
|
const entries = [
|
||||||
|
entry('a:opencode', DEFAULT_IDLE_TTL_MS + 1),
|
||||||
|
entry('b:goose', DEFAULT_IDLE_TTL_MS - 1),
|
||||||
|
];
|
||||||
|
expect(selectIdleEvictionTargets(entries, NOW)).toEqual(['a:opencode']);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('never evicts a busy entry even when idle past the TTL', () => {
|
||||||
|
const entries = [entry('a:opencode', DEFAULT_IDLE_TTL_MS * 10, /* busy */ true)];
|
||||||
|
expect(selectIdleEvictionTargets(entries, NOW)).toEqual([]);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('respects a custom TTL', () => {
|
||||||
|
const entries = [entry('a:goose', 5_000), entry('b:qwen', 500)];
|
||||||
|
expect(selectIdleEvictionTargets(entries, NOW, 1_000)).toEqual(['a:goose']);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('treats exactly-at-TTL as evictable (>=)', () => {
|
||||||
|
expect(selectIdleEvictionTargets([entry('a:x', 1_000)], NOW, 1_000)).toEqual(['a:x']);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('returns empty for an empty pool', () => {
|
||||||
|
expect(selectIdleEvictionTargets([], NOW)).toEqual([]);
|
||||||
|
});
|
||||||
|
});
|
||||||
|
|
||||||
|
describe('selectLruEvictionTargets (3.4)', () => {
|
||||||
|
it('returns nothing when at or under the cap', () => {
|
||||||
|
const entries = [entry('a:x', 10), entry('b:y', 20)];
|
||||||
|
expect(selectLruEvictionTargets(entries, 2)).toEqual([]);
|
||||||
|
expect(selectLruEvictionTargets(entries, 5)).toEqual([]);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('evicts the least-recently-used beyond the cap', () => {
|
||||||
|
// oldest first: c (300ms ago) is LRU, then a (100ms), then b (10ms).
|
||||||
|
const entries = [entry('a:x', 100), entry('b:y', 10), entry('c:z', 300)];
|
||||||
|
expect(selectLruEvictionTargets(entries, 2)).toEqual(['c:z']);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('evicts multiple LRU entries to reach the cap', () => {
|
||||||
|
const entries = [
|
||||||
|
entry('a:x', 100),
|
||||||
|
entry('b:y', 10),
|
||||||
|
entry('c:z', 300),
|
||||||
|
entry('d:w', 200),
|
||||||
|
];
|
||||||
|
// cap 1: must remove 3, oldest-first c(300), d(200), a(100).
|
||||||
|
expect(selectLruEvictionTargets(entries, 1)).toEqual(['c:z', 'd:w', 'a:x']);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('never evicts a busy entry even if it is the LRU', () => {
|
||||||
|
// c is LRU but busy → it cannot be evicted; fall to the next-oldest (a).
|
||||||
|
const entries = [entry('a:x', 100), entry('b:y', 10), entry('c:z', 300, true)];
|
||||||
|
expect(selectLruEvictionTargets(entries, 2)).toEqual(['a:x']);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('can transiently exceed the cap when too many are busy', () => {
|
||||||
|
// cap 1, but both old entries busy → only the single idle one is evictable.
|
||||||
|
const entries = [entry('a:x', 100, true), entry('c:z', 300, true), entry('b:y', 10)];
|
||||||
|
expect(selectLruEvictionTargets(entries, 1)).toEqual(['b:y']);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('uses the default cap when omitted', () => {
|
||||||
|
const entries = Array.from({ length: DEFAULT_MAX_LIVE_BACKENDS + 1 }, (_, i) =>
|
||||||
|
entry(`k${String(i).padStart(2, '0')}:a`, (i + 1) * 1000),
|
||||||
|
);
|
||||||
|
const evicted = selectLruEvictionTargets(entries);
|
||||||
|
// exactly one over the default cap → evict the single LRU (largest age).
|
||||||
|
expect(evicted).toHaveLength(1);
|
||||||
|
expect(evicted[0]).toBe(`k${String(DEFAULT_MAX_LIVE_BACKENDS).padStart(2, '0')}:a`);
|
||||||
|
});
|
||||||
|
});
|
||||||
|
|
||||||
|
describe('decideRestart (3.2, busy-aware)', () => {
|
||||||
|
const base = {
|
||||||
|
consecutiveFailures: 0,
|
||||||
|
busy: false,
|
||||||
|
unhealthyBusySince: 0,
|
||||||
|
now: NOW,
|
||||||
|
failureThreshold: 3,
|
||||||
|
staleBusyGraceMs: 120_000,
|
||||||
|
};
|
||||||
|
|
||||||
|
it('does nothing when healthy', () => {
|
||||||
|
expect(decideRestart({ ...base, processExited: false, healthy: true }))
|
||||||
|
.toEqual({ action: 'none', reason: 'healthy' });
|
||||||
|
});
|
||||||
|
|
||||||
|
it('restarts immediately when the process exited', () => {
|
||||||
|
expect(decideRestart({ ...base, processExited: true, busy: true }))
|
||||||
|
.toEqual({ action: 'restart', reason: 'process-exited' });
|
||||||
|
});
|
||||||
|
|
||||||
|
it('waits below the failure threshold', () => {
|
||||||
|
expect(decideRestart({ ...base, processExited: false, consecutiveFailures: 2 }))
|
||||||
|
.toEqual({ action: 'wait', reason: 'below-threshold' });
|
||||||
|
});
|
||||||
|
|
||||||
|
it('restarts at the threshold when idle', () => {
|
||||||
|
expect(decideRestart({ ...base, processExited: false, consecutiveFailures: 3 }))
|
||||||
|
.toEqual({ action: 'restart', reason: 'threshold' });
|
||||||
|
});
|
||||||
|
|
||||||
|
it('defers a restart while busy within the grace window', () => {
|
||||||
|
expect(decideRestart({
|
||||||
|
...base, processExited: false, consecutiveFailures: 5, busy: true,
|
||||||
|
unhealthyBusySince: NOW - 1_000,
|
||||||
|
})).toEqual({ action: 'wait', reason: 'busy-grace' });
|
||||||
|
});
|
||||||
|
|
||||||
|
it('force-restarts a busy backend after the stale-busy grace', () => {
|
||||||
|
expect(decideRestart({
|
||||||
|
...base, processExited: false, consecutiveFailures: 5, busy: true,
|
||||||
|
unhealthyBusySince: NOW - 120_001,
|
||||||
|
})).toEqual({ action: 'restart', reason: 'stale-busy-grace' });
|
||||||
|
});
|
||||||
|
|
||||||
|
it('waits (busy-grace) when busy + threshold but the window just started', () => {
|
||||||
|
// unhealthyBusySince === 0 means the caller is about to stamp it this cycle.
|
||||||
|
expect(decideRestart({
|
||||||
|
...base, processExited: false, consecutiveFailures: 5, busy: true,
|
||||||
|
unhealthyBusySince: 0,
|
||||||
|
})).toEqual({ action: 'wait', reason: 'busy-grace' });
|
||||||
|
});
|
||||||
|
});
|
||||||
|
|
||||||
|
describe('selectOrphanWorktreeTargets (3.4)', () => {
|
||||||
|
it('skips dirs tracked by a live worktrees row', () => {
|
||||||
|
const onDisk = [{ path: '/wt/sess-a', mtimeMs: NOW - 10_000_000 }];
|
||||||
|
expect(selectOrphanWorktreeTargets(onDisk, new Set(['/wt/sess-a']), NOW, 1000)).toEqual([]);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('reaps an untracked dir older than the grace', () => {
|
||||||
|
const onDisk = [{ path: '/wt/sess-orphan', mtimeMs: NOW - 5000 }];
|
||||||
|
expect(selectOrphanWorktreeTargets(onDisk, new Set(), NOW, 1000)).toEqual(['/wt/sess-orphan']);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('never reaps a dir younger than the grace (mid-create race)', () => {
|
||||||
|
const onDisk = [{ path: '/wt/sess-fresh', mtimeMs: NOW - 500 }];
|
||||||
|
expect(selectOrphanWorktreeTargets(onDisk, new Set(), NOW, 1000)).toEqual([]);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('mixes tracked, fresh, and orphaned correctly', () => {
|
||||||
|
const onDisk = [
|
||||||
|
{ path: '/wt/sess-live', mtimeMs: NOW - 10_000 },
|
||||||
|
{ path: '/wt/sess-fresh', mtimeMs: NOW - 100 },
|
||||||
|
{ path: '/wt/sess-orphan', mtimeMs: NOW - 10_000 },
|
||||||
|
];
|
||||||
|
expect(selectOrphanWorktreeTargets(onDisk, new Set(['/wt/sess-live']), NOW, 1000))
|
||||||
|
.toEqual(['/wt/sess-orphan']);
|
||||||
|
});
|
||||||
|
});
|
||||||
@@ -0,0 +1,59 @@
|
|||||||
|
import { describe, it, expect } from 'vitest';
|
||||||
|
import { shouldUseWarmBackend, isTurnOkForStopReason } from '../warm-acp-routing.js';
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Phase 2 routing predicate: which goose/qwen tasks go to the warm pool backend
|
||||||
|
* vs the existing one-shot ACP path.
|
||||||
|
*
|
||||||
|
* The warm backend is keyed (chat_id, agent) — the persistent context unit (same
|
||||||
|
* as opencode-server). A task only routes warm when it carries BOTH a session_id
|
||||||
|
* and a chat_id, i.e. it originates from a real chat tab (the coder message route
|
||||||
|
* stamps both). Session-less creators (arena, MCP-created, generic /api/tasks,
|
||||||
|
* new_task) lack chat_id/session_id and keep the one-shot worktree-per-task path,
|
||||||
|
* which never spawns a warm process.
|
||||||
|
*/
|
||||||
|
describe('shouldUseWarmBackend (Phase 2 routing)', () => {
|
||||||
|
it('routes a chat-tab task (session_id + chat_id) to the warm backend', () => {
|
||||||
|
expect(shouldUseWarmBackend({ agent: 'qwen', session_id: 's1', chat_id: 'c1' })).toBe(true);
|
||||||
|
expect(shouldUseWarmBackend({ agent: 'goose', session_id: 's1', chat_id: 'c1' })).toBe(true);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('keeps a session-less arena/MCP task on the one-shot path', () => {
|
||||||
|
expect(shouldUseWarmBackend({ agent: 'qwen', session_id: null, chat_id: null })).toBe(false);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('keeps a task with a session but no chat on the one-shot path', () => {
|
||||||
|
// chat_id is the warm-key half; without it ensureSession would get a degenerate
|
||||||
|
// (null, agent) key, so fall back to one-shot rather than synthesize a chat.
|
||||||
|
expect(shouldUseWarmBackend({ agent: 'goose', session_id: 's1', chat_id: null })).toBe(false);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('keeps a task with a chat but no session on the one-shot path', () => {
|
||||||
|
expect(shouldUseWarmBackend({ agent: 'qwen', session_id: null, chat_id: 'c1' })).toBe(false);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('only applies to warm-capable agents (goose, qwen); others never warm here', () => {
|
||||||
|
// opencode has its own dedicated warm path; native/claude/etc. are not ACP-warm.
|
||||||
|
expect(shouldUseWarmBackend({ agent: 'opencode', session_id: 's1', chat_id: 'c1' })).toBe(false);
|
||||||
|
expect(shouldUseWarmBackend({ agent: 'claude', session_id: 's1', chat_id: 'c1' })).toBe(false);
|
||||||
|
expect(shouldUseWarmBackend({ agent: null, session_id: 's1', chat_id: 'c1' })).toBe(false);
|
||||||
|
});
|
||||||
|
});
|
||||||
|
|
||||||
|
describe('isTurnOkForStopReason (ACP stop-reason → ok/fail)', () => {
|
||||||
|
it('treats normal completions as ok', () => {
|
||||||
|
expect(isTurnOkForStopReason('end_turn')).toBe(true);
|
||||||
|
expect(isTurnOkForStopReason('max_tokens')).toBe(true);
|
||||||
|
expect(isTurnOkForStopReason('max_turn_requests')).toBe(true);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('treats refusal and cancelled as failures', () => {
|
||||||
|
expect(isTurnOkForStopReason('refusal')).toBe(false);
|
||||||
|
expect(isTurnOkForStopReason('cancelled')).toBe(false);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('defaults an absent stop reason to a successful end_turn', () => {
|
||||||
|
expect(isTurnOkForStopReason(undefined)).toBe(true);
|
||||||
|
expect(isTurnOkForStopReason(null)).toBe(true);
|
||||||
|
});
|
||||||
|
});
|
||||||
197
apps/coder/src/services/backends/lifecycle-decisions.ts
Normal file
197
apps/coder/src/services/backends/lifecycle-decisions.ts
Normal file
@@ -0,0 +1,197 @@
|
|||||||
|
/**
|
||||||
|
* v2.6 Phase 3 — pure lifecycle decision helpers.
|
||||||
|
*
|
||||||
|
* The eviction / LRU-cap / busy-aware-restart / reaper-target logic, factored out
|
||||||
|
* of AgentPool + the backends + the periodic sweeper so it's unit-testable with no
|
||||||
|
* DB, no child processes, no timers (modeled on
|
||||||
|
* apps/server/src/services/inference/prune.ts:selectPruneTargets — a pure decision
|
||||||
|
* core the caller acts on).
|
||||||
|
*
|
||||||
|
* Three decisions live here:
|
||||||
|
* 1. selectIdleEvictionTargets — which warm backends to evict for being idle.
|
||||||
|
* 2. selectLruEvictionTargets — which warm backends to evict to honour a max-live
|
||||||
|
* cap (least-recently-used beyond the cap), NEVER a busy one.
|
||||||
|
* 3. shouldRestartCrashedBackend (busy-aware) — openchamber's skip-while-busy +
|
||||||
|
* stale-grace state machine, re-implemented for BooCode's per-(chat,agent) pool.
|
||||||
|
*
|
||||||
|
* "Busy" = the backend has an in-flight turn. The hard rule (design §6, decisions):
|
||||||
|
* never evict or force-restart a busy backend; defer with a stale-grace.
|
||||||
|
*/
|
||||||
|
|
||||||
|
// ─── Idle TTL eviction (3.1) ─────────────────────────────────────────────────
|
||||||
|
|
||||||
|
/** Default idle TTL before a warm backend/session is evicted (design §6 ~30 min). */
|
||||||
|
export const DEFAULT_IDLE_TTL_MS = 30 * 60 * 1000;
|
||||||
|
|
||||||
|
/** A pool entry as the decision helpers see it (no backend internals). */
|
||||||
|
export interface PoolEntrySnapshot {
|
||||||
|
/** Pool key `${primary}:${agent}` — opaque to the decision, used for selection. */
|
||||||
|
key: string;
|
||||||
|
/** Epoch ms of the last turn activity (start or settle) on this backend. */
|
||||||
|
lastActiveAt: number;
|
||||||
|
/** True iff a turn is in flight right now. Busy entries are never evicted. */
|
||||||
|
busy: boolean;
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Idle eviction: an entry is evictable when it has been idle (no turn) for longer
|
||||||
|
* than `ttlMs` AND is not currently busy. Returns the keys to evict.
|
||||||
|
*
|
||||||
|
* Pure: `now` is injected so tests don't depend on wall-clock. Busy entries are
|
||||||
|
* categorically excluded — a long-running turn that exceeds the TTL must NOT be
|
||||||
|
* torn down mid-stream (the §6 / openchamber busy rule).
|
||||||
|
*/
|
||||||
|
export function selectIdleEvictionTargets(
|
||||||
|
entries: ReadonlyArray<PoolEntrySnapshot>,
|
||||||
|
now: number,
|
||||||
|
ttlMs: number = DEFAULT_IDLE_TTL_MS,
|
||||||
|
): string[] {
|
||||||
|
const out: string[] = [];
|
||||||
|
for (const e of entries) {
|
||||||
|
if (e.busy) continue;
|
||||||
|
if (now - e.lastActiveAt >= ttlMs) out.push(e.key);
|
||||||
|
}
|
||||||
|
return out;
|
||||||
|
}
|
||||||
|
|
||||||
|
// ─── LRU cap (3.4) ───────────────────────────────────────────────────────────
|
||||||
|
|
||||||
|
/** Default max live warm backends/worktrees before the LRU cap evicts (env-overridable). */
|
||||||
|
export const DEFAULT_MAX_LIVE_BACKENDS = 10;
|
||||||
|
|
||||||
|
/**
|
||||||
|
* LRU cap: when more than `cap` non-busy entries are live, evict the
|
||||||
|
* least-recently-used ones (oldest `lastActiveAt` first) until at most `cap`
|
||||||
|
* remain. Busy entries are never evicted AND are not counted toward the cap's
|
||||||
|
* "kept" budget being freed — i.e. we only ever evict idle entries, so a burst of
|
||||||
|
* concurrent busy turns can transiently exceed the cap rather than kill live work.
|
||||||
|
*
|
||||||
|
* Returns the keys to evict, least-recently-used first. Pure / deterministic:
|
||||||
|
* ties broken by key for stable test output.
|
||||||
|
*/
|
||||||
|
export function selectLruEvictionTargets(
|
||||||
|
entries: ReadonlyArray<PoolEntrySnapshot>,
|
||||||
|
cap: number = DEFAULT_MAX_LIVE_BACKENDS,
|
||||||
|
): string[] {
|
||||||
|
if (cap < 0) cap = 0;
|
||||||
|
if (entries.length <= cap) return [];
|
||||||
|
// Only idle entries are eligible to be evicted.
|
||||||
|
const evictable = entries
|
||||||
|
.filter((e) => !e.busy)
|
||||||
|
.sort((a, b) => a.lastActiveAt - b.lastActiveAt || (a.key < b.key ? -1 : a.key > b.key ? 1 : 0));
|
||||||
|
// We must shrink total live count down to `cap`. Busy entries can't be evicted,
|
||||||
|
// so the number we CAN remove is bounded by the evictable pool; evict the oldest
|
||||||
|
// (total - cap) of them, never more than exist.
|
||||||
|
const overBy = entries.length - cap;
|
||||||
|
const toEvict = evictable.slice(0, Math.max(0, overBy));
|
||||||
|
return toEvict.map((e) => e.key);
|
||||||
|
}
|
||||||
|
|
||||||
|
// ─── Busy-aware crash restart (3.2) — openchamber lift ───────────────────────
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Default grace after which a backend that has stayed unhealthy WHILE busy is
|
||||||
|
* force-restarted anyway (openchamber's STALE_BUSY_GRACE_MS = 2 min). Guards
|
||||||
|
* against a permanently-stuck "busy" turn wedging recovery forever.
|
||||||
|
*/
|
||||||
|
export const DEFAULT_STALE_BUSY_GRACE_MS = 2 * 60 * 1000;
|
||||||
|
|
||||||
|
/** Default consecutive health-check failures before a restart is attempted. */
|
||||||
|
export const DEFAULT_HEALTH_FAILURE_THRESHOLD = 3;
|
||||||
|
|
||||||
|
export interface RestartDecisionInput {
|
||||||
|
/** True iff the process is actually dead (exited). A dead process restarts
|
||||||
|
* immediately regardless of busy/threshold — there's nothing to protect. */
|
||||||
|
processExited: boolean;
|
||||||
|
/** Consecutive failed health probes so far (including the current one). */
|
||||||
|
consecutiveFailures: number;
|
||||||
|
/** Whether the backend currently has an in-flight turn. */
|
||||||
|
busy: boolean;
|
||||||
|
/** Epoch ms when the unhealthy-while-busy window started, or 0 if not in one. */
|
||||||
|
unhealthyBusySince: number;
|
||||||
|
/** Injected clock. */
|
||||||
|
now: number;
|
||||||
|
failureThreshold?: number;
|
||||||
|
staleBusyGraceMs?: number;
|
||||||
|
}
|
||||||
|
|
||||||
|
export type RestartDecision =
|
||||||
|
| { action: 'restart'; reason: 'process-exited' | 'threshold' | 'stale-busy-grace' }
|
||||||
|
| { action: 'wait'; reason: 'below-threshold' | 'busy-grace' }
|
||||||
|
| { action: 'none'; reason: 'healthy' };
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Decide whether to restart a backend after a health probe. Mirrors
|
||||||
|
* openchamber's `runHealthCheckCycle` + `shouldSkipRestartForBusySessions`,
|
||||||
|
* re-implemented as a pure function over injected state (the caller owns the
|
||||||
|
* mutable counters + the actual restart side-effect).
|
||||||
|
*
|
||||||
|
* Order (matches openchamber):
|
||||||
|
* - process exited → restart now (nothing live to protect).
|
||||||
|
* - below failure threshold → wait (transient blip; the next probe re-checks).
|
||||||
|
* - threshold reached + idle → restart now.
|
||||||
|
* - threshold reached + busy → skip UNLESS the unhealthy-busy window exceeded
|
||||||
|
* the stale grace, then force restart.
|
||||||
|
*
|
||||||
|
* `healthy: true` callers don't reach here; included for completeness so the
|
||||||
|
* caller can pass through and reset counters on a single code path.
|
||||||
|
*/
|
||||||
|
export function decideRestart(input: RestartDecisionInput & { healthy?: boolean }): RestartDecision {
|
||||||
|
if (input.healthy) return { action: 'none', reason: 'healthy' };
|
||||||
|
if (input.processExited) return { action: 'restart', reason: 'process-exited' };
|
||||||
|
|
||||||
|
const threshold = input.failureThreshold ?? DEFAULT_HEALTH_FAILURE_THRESHOLD;
|
||||||
|
if (input.consecutiveFailures < threshold) {
|
||||||
|
return { action: 'wait', reason: 'below-threshold' };
|
||||||
|
}
|
||||||
|
|
||||||
|
if (!input.busy) {
|
||||||
|
return { action: 'restart', reason: 'threshold' };
|
||||||
|
}
|
||||||
|
|
||||||
|
// Busy + unhealthy at/over threshold: defer, but not forever.
|
||||||
|
const grace = input.staleBusyGraceMs ?? DEFAULT_STALE_BUSY_GRACE_MS;
|
||||||
|
if (input.unhealthyBusySince > 0 && input.now - input.unhealthyBusySince >= grace) {
|
||||||
|
return { action: 'restart', reason: 'stale-busy-grace' };
|
||||||
|
}
|
||||||
|
return { action: 'wait', reason: 'busy-grace' };
|
||||||
|
}
|
||||||
|
|
||||||
|
// ─── Orphan worktree reaper target selection (3.4) ───────────────────────────
|
||||||
|
|
||||||
|
/** Default TTL: an on-disk worktree dir with no live `worktrees` row is reaped
|
||||||
|
* only after it's been orphaned at least this long (mtime-based grace so a
|
||||||
|
* just-created dir mid-`ensureSessionWorktree` race is never swept). */
|
||||||
|
export const DEFAULT_ORPHAN_WORKTREE_GRACE_MS = 60 * 60 * 1000; // 1h
|
||||||
|
|
||||||
|
export interface OnDiskWorktree {
|
||||||
|
/** Absolute path of the worktree dir on disk. */
|
||||||
|
path: string;
|
||||||
|
/** Last-modified epoch ms of the dir (newest of dir + contents, caller's choice). */
|
||||||
|
mtimeMs: number;
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Reaper target selection: which on-disk worktree dirs are orphans safe to
|
||||||
|
* inspect-and-reap. An orphan is a dir under the worktree base that has NO live
|
||||||
|
* `worktrees` row (path not in `liveWorktreePaths`) AND whose mtime is older than
|
||||||
|
* the grace window (so an in-flight create isn't swept).
|
||||||
|
*
|
||||||
|
* Pure — the caller (the sweeper) then runs the at-risk preflight (dirty/unpushed)
|
||||||
|
* on each returned path and only physically removes the SAFE ones. This helper
|
||||||
|
* never decides to remove work-at-risk; it only narrows the candidate set.
|
||||||
|
*/
|
||||||
|
export function selectOrphanWorktreeTargets(
|
||||||
|
onDisk: ReadonlyArray<OnDiskWorktree>,
|
||||||
|
liveWorktreePaths: ReadonlySet<string>,
|
||||||
|
now: number,
|
||||||
|
graceMs: number = DEFAULT_ORPHAN_WORKTREE_GRACE_MS,
|
||||||
|
): string[] {
|
||||||
|
const out: string[] = [];
|
||||||
|
for (const w of onDisk) {
|
||||||
|
if (liveWorktreePaths.has(w.path)) continue; // tracked → not an orphan
|
||||||
|
if (now - w.mtimeMs < graceMs) continue; // too fresh → could be mid-create
|
||||||
|
out.push(w.path);
|
||||||
|
}
|
||||||
|
return out;
|
||||||
|
}
|
||||||
@@ -21,9 +21,9 @@
|
|||||||
* - promptAsync is fire-and-forget (204); the turn completes via a
|
* - promptAsync is fire-and-forget (204); the turn completes via a
|
||||||
* 'session.idle' event for that opencode session id.
|
* 'session.idle' event for that opencode session id.
|
||||||
*/
|
*/
|
||||||
import { spawn, type ChildProcess } from 'node:child_process';
|
import { spawn, spawnSync, type ChildProcess } from 'node:child_process';
|
||||||
import { createHash } from 'node:crypto';
|
import { createHash } from 'node:crypto';
|
||||||
import { createServer } from 'node:net';
|
import { createServer, connect as netConnect } from 'node:net';
|
||||||
import type { FastifyBaseLogger } from 'fastify';
|
import type { FastifyBaseLogger } from 'fastify';
|
||||||
import {
|
import {
|
||||||
createOpencodeClient,
|
createOpencodeClient,
|
||||||
@@ -39,6 +39,7 @@ import type { Sql } from '../../db.js';
|
|||||||
import type { AcpToolSnapshot } from '../acp-tool-snapshot.js';
|
import type { AcpToolSnapshot } from '../acp-tool-snapshot.js';
|
||||||
import { armAbortGuard, noteTurnActivity, consumeTerminal } from './turn-guard.js';
|
import { armAbortGuard, noteTurnActivity, consumeTerminal } from './turn-guard.js';
|
||||||
import { stepEndedToUsage, type StepUsage } from './opencode-usage.js';
|
import { stepEndedToUsage, type StepUsage } from './opencode-usage.js';
|
||||||
|
import { decideRestart, DEFAULT_HEALTH_FAILURE_THRESHOLD } from './lifecycle-decisions.js';
|
||||||
import type {
|
import type {
|
||||||
AgentBackend,
|
AgentBackend,
|
||||||
AgentEvent,
|
AgentEvent,
|
||||||
@@ -104,6 +105,11 @@ export class OpenCodeServerBackend implements AgentBackend {
|
|||||||
private port: number | null = null;
|
private port: number | null = null;
|
||||||
private up = false;
|
private up = false;
|
||||||
private serverStarting: Promise<void> | null = null;
|
private serverStarting: Promise<void> | null = null;
|
||||||
|
// Phase 3 busy-aware health monitor (openchamber lift): consecutive failed
|
||||||
|
// probes + the start of an unhealthy-while-busy window feed `decideRestart`.
|
||||||
|
private consecutiveHealthFailures = 0;
|
||||||
|
private unhealthyBusySince = 0;
|
||||||
|
private restarting: Promise<void> | null = null;
|
||||||
|
|
||||||
/** opencode session id → demux state. Maintained by ensureSession; read by the SSE loop. */
|
/** opencode session id → demux state. Maintained by ensureSession; read by the SSE loop. */
|
||||||
private readonly byOpencodeId = new Map<string, SessionState>();
|
private readonly byOpencodeId = new Map<string, SessionState>();
|
||||||
@@ -119,11 +125,30 @@ export class OpenCodeServerBackend implements AgentBackend {
|
|||||||
return this.up ? 'up' : 'down';
|
return this.up ? 'up' : 'down';
|
||||||
}
|
}
|
||||||
|
|
||||||
// ─── Server lifecycle (1.2: spawn once + client + ready) ─────────────────────
|
/** Phase 3: busy iff ANY pooled opencode session has an in-flight turn. The
|
||||||
|
* pool reads this to skip idle/LRU eviction and the health-monitor to defer a
|
||||||
|
* restart (never tear down a session mid-stream). */
|
||||||
|
isBusy(): boolean {
|
||||||
|
for (const st of this.byOpencodeId.values()) {
|
||||||
|
if (st.activeTurn) return true;
|
||||||
|
}
|
||||||
|
return false;
|
||||||
|
}
|
||||||
|
|
||||||
/** Lazy: start the single server on first use. Idempotent — one server per backend. */
|
// ─── Server lifecycle (1.2: spawn once + client + ready; Phase 3 crash-restart) ──
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Lazy: start the single server on first use; re-spawn after a crash. Idempotent
|
||||||
|
* within one live server — `serverStarting` caches the in-flight start, and is
|
||||||
|
* reset to null by the crash handler so the NEXT ensureServer re-spawns a fresh
|
||||||
|
* server (Phase 3 crash recovery). A dead-but-not-yet-reaped child (exit handler
|
||||||
|
* raced) is also treated as needing a restart.
|
||||||
|
*/
|
||||||
private ensureServer(): Promise<void> {
|
private ensureServer(): Promise<void> {
|
||||||
if (!this.serverStarting) this.serverStarting = this.startServer();
|
const childDead = this.child != null && (this.child.exitCode !== null || this.child.signalCode !== null);
|
||||||
|
if (!this.serverStarting || (!this.up && childDead)) {
|
||||||
|
this.serverStarting = this.startServer();
|
||||||
|
}
|
||||||
return this.serverStarting;
|
return this.serverStarting;
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -143,11 +168,15 @@ export class OpenCodeServerBackend implements AgentBackend {
|
|||||||
this.port = port;
|
this.port = port;
|
||||||
|
|
||||||
// Child lifetime is the backend's (the pool's), NOT a request's. We never tie
|
// Child lifetime is the backend's (the pool's), NOT a request's. We never tie
|
||||||
// it to a per-turn abort signal. On unexpected exit we mark down + log; crash
|
// it to a per-turn abort signal. Phase 3: on unexpected exit we recover —
|
||||||
// recovery is Phase 3.
|
// settle any in-flight turns as failed, mark their agent_sessions rows crashed,
|
||||||
|
// and reset `serverStarting` so the next ensureServer re-spawns. opencode keeps
|
||||||
|
// sessions on disk, but a fresh server's in-memory state is gone, so the next
|
||||||
|
// turn's ensureSession (rows now 'crashed') creates fresh opencode sessions.
|
||||||
child.on('exit', (code, signal) => {
|
child.on('exit', (code, signal) => {
|
||||||
this.up = false;
|
// Only react to THIS child's exit (a restart may have swapped in a new one).
|
||||||
this.log.warn({ code, signal, port }, 'opencode-server: child exited (recovery is Phase 3)');
|
if (this.child !== child) return;
|
||||||
|
this.handleServerCrash(code, signal, port);
|
||||||
});
|
});
|
||||||
|
|
||||||
await waitForReady(child, READY_TIMEOUT_MS);
|
await waitForReady(child, READY_TIMEOUT_MS);
|
||||||
@@ -157,6 +186,136 @@ export class OpenCodeServerBackend implements AgentBackend {
|
|||||||
this.log.info({ port }, 'opencode-server: ready');
|
this.log.info({ port }, 'opencode-server: ready');
|
||||||
}
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Crash handler (Phase 3, lift of openchamber's restart-on-exit path). The
|
||||||
|
* server died with N live opencode sessions; we can't restart it here (the next
|
||||||
|
* turn does, lazily — avoids a restart storm if the binary is broken). We:
|
||||||
|
* 1. fail every in-flight turn so its dispatcher unblocks + publishes an error,
|
||||||
|
* 2. mark each session's agent_sessions row 'crashed' so ensureSession won't
|
||||||
|
* resume a now-dead native session id (it creates fresh),
|
||||||
|
* 3. tear down the SSE loops + demux state (stale against the dead server),
|
||||||
|
* 4. reclaim the port + reset state so the next ensureServer re-spawns.
|
||||||
|
*/
|
||||||
|
private handleServerCrash(code: number | null, signal: NodeJS.Signals | null, port: number): void {
|
||||||
|
this.up = false;
|
||||||
|
const states = [...this.byOpencodeId.values()];
|
||||||
|
this.log.warn(
|
||||||
|
{ code, signal, port, liveSessions: states.length },
|
||||||
|
'opencode-server: child exited — recovering (fail in-flight, mark crashed, re-spawn next turn)',
|
||||||
|
);
|
||||||
|
|
||||||
|
const crashedIds: string[] = [];
|
||||||
|
for (const st of states) {
|
||||||
|
st.sseAbort?.abort();
|
||||||
|
if (st.activeTurn) {
|
||||||
|
st.activeTurn.settle({ ok: false, error: 'opencode server crashed mid-turn' });
|
||||||
|
st.activeTurn = null;
|
||||||
|
}
|
||||||
|
if (st.watchdog) {
|
||||||
|
clearTimeout(st.watchdog);
|
||||||
|
st.watchdog = null;
|
||||||
|
}
|
||||||
|
crashedIds.push(st.agentSessionId);
|
||||||
|
}
|
||||||
|
// Drop the demux map: every session id is stale against a fresh server.
|
||||||
|
this.byOpencodeId.clear();
|
||||||
|
this.client = null;
|
||||||
|
this.serverStarting = null; // force a re-spawn on the next ensureServer
|
||||||
|
|
||||||
|
if (crashedIds.length > 0) {
|
||||||
|
this.sql`
|
||||||
|
UPDATE agent_sessions SET status = 'crashed'
|
||||||
|
WHERE agent_session_id = ANY(${crashedIds}) AND status <> 'closed'
|
||||||
|
`.catch((err) => {
|
||||||
|
this.log.warn({ err: errMsg(err) }, 'opencode-server: failed to mark crashed sessions (non-fatal)');
|
||||||
|
});
|
||||||
|
}
|
||||||
|
|
||||||
|
// Reclaim the port so a re-spawn on a fixed/leaked port isn't blocked. Best
|
||||||
|
// effort; the next start uses a fresh ephemeral port anyway.
|
||||||
|
reclaimPort(port);
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Phase 3 proactive health monitor (openchamber `runHealthCheckCycle` lift,
|
||||||
|
* busy-aware). Probes the server's /global/health; on a sustained failure of a
|
||||||
|
* NON-busy server, force a restart so the next turn isn't blocked by a wedged
|
||||||
|
* (hung-but-not-exited) process. Busy servers are deferred via the stale-grace in
|
||||||
|
* `decideRestart` — never tear down live work. Driven by the pool's periodic
|
||||||
|
* sweep (best-effort; a crash-exit is already handled by `handleServerCrash` +
|
||||||
|
* lazy `ensureServer` re-spawn, so this only catches the hung case). No-op when
|
||||||
|
* the server was never started or a restart is already in flight.
|
||||||
|
*/
|
||||||
|
async tickHealth(now: number = Date.now()): Promise<void> {
|
||||||
|
if (!this.child || this.restarting) return;
|
||||||
|
const childExited = this.child.exitCode !== null || this.child.signalCode !== null;
|
||||||
|
// An exited child is recovered lazily by ensureServer; don't double-restart it.
|
||||||
|
if (childExited) return;
|
||||||
|
|
||||||
|
const healthy = await this.probeHealth();
|
||||||
|
if (healthy) {
|
||||||
|
this.consecutiveHealthFailures = 0;
|
||||||
|
this.unhealthyBusySince = 0;
|
||||||
|
return;
|
||||||
|
}
|
||||||
|
this.consecutiveHealthFailures += 1;
|
||||||
|
const busy = this.isBusy();
|
||||||
|
const decision = decideRestart({
|
||||||
|
processExited: false,
|
||||||
|
consecutiveFailures: this.consecutiveHealthFailures,
|
||||||
|
busy,
|
||||||
|
unhealthyBusySince: this.unhealthyBusySince,
|
||||||
|
now,
|
||||||
|
failureThreshold: DEFAULT_HEALTH_FAILURE_THRESHOLD,
|
||||||
|
});
|
||||||
|
// Stamp the start of an unhealthy-while-busy window so the stale-grace can fire.
|
||||||
|
if (busy && this.unhealthyBusySince === 0) this.unhealthyBusySince = now;
|
||||||
|
if (decision.action === 'restart') {
|
||||||
|
this.log.warn(
|
||||||
|
{ failures: this.consecutiveHealthFailures, busy, reason: decision.reason },
|
||||||
|
'opencode-server: health monitor forcing restart',
|
||||||
|
);
|
||||||
|
this.consecutiveHealthFailures = 0;
|
||||||
|
this.unhealthyBusySince = 0;
|
||||||
|
await this.restartServer();
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
private async probeHealth(): Promise<boolean> {
|
||||||
|
if (!this.client) return false;
|
||||||
|
try {
|
||||||
|
const res = await this.client.global.health();
|
||||||
|
return !res.error;
|
||||||
|
} catch {
|
||||||
|
return false;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
/** Force-kill the current server + reclaim its port; the next ensureServer
|
||||||
|
* re-spawns (lazy). Mirrors handleServerCrash's state reset but is initiated by
|
||||||
|
* the health monitor rather than the OS. */
|
||||||
|
private async restartServer(): Promise<void> {
|
||||||
|
if (this.restarting) return this.restarting;
|
||||||
|
this.restarting = (async () => {
|
||||||
|
const child = this.child;
|
||||||
|
const port = this.port;
|
||||||
|
this.up = false;
|
||||||
|
// Fail in-flight turns + mark sessions crashed via the same path as a crash.
|
||||||
|
if (child) {
|
||||||
|
this.handleServerCrash(null, null, port ?? 0);
|
||||||
|
if (!child.killed) child.kill('SIGTERM');
|
||||||
|
}
|
||||||
|
if (port) {
|
||||||
|
reclaimPort(port);
|
||||||
|
await waitForPortRelease(port, 3_000);
|
||||||
|
}
|
||||||
|
this.child = null;
|
||||||
|
})().finally(() => {
|
||||||
|
this.restarting = null;
|
||||||
|
});
|
||||||
|
return this.restarting;
|
||||||
|
}
|
||||||
|
|
||||||
// ─── SSE read loop + demux + translate (1.3) + dedup (1.4) ───────────────────
|
// ─── SSE read loop + demux + translate (1.3) + dedup (1.4) ───────────────────
|
||||||
|
|
||||||
/** Per-session SSE subscription, scoped to the session's worktree directory.
|
/** Per-session SSE subscription, scoped to the session's worktree directory.
|
||||||
@@ -756,6 +915,67 @@ function mapToolStatus(s: ToolState['status'] | undefined): ToolCallStatus | nul
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Reclaim a loopback port a dead opencode child may still hold (lift of
|
||||||
|
* openchamber `killProcessOnPort`). Best-effort, POSIX-only (`lsof`/`kill`); a
|
||||||
|
* failure is harmless because the next spawn allocates a fresh ephemeral port.
|
||||||
|
* Never kills this process. Synchronous + short-timeout so the crash handler
|
||||||
|
* doesn't block.
|
||||||
|
*/
|
||||||
|
function reclaimPort(port: number | null): void {
|
||||||
|
if (!port || process.platform === 'win32') return;
|
||||||
|
try {
|
||||||
|
const res = spawnSync('lsof', ['-ti', `:${port}`], { encoding: 'utf8', timeout: 3_000, windowsHide: true });
|
||||||
|
const out = res.stdout || '';
|
||||||
|
const myPid = process.pid;
|
||||||
|
for (const pidStr of out.split(/\s+/)) {
|
||||||
|
const pid = parseInt(pidStr.trim(), 10);
|
||||||
|
if (pid && pid !== myPid) {
|
||||||
|
try {
|
||||||
|
spawnSync('kill', ['-9', String(pid)], { stdio: 'ignore', timeout: 2_000 });
|
||||||
|
} catch {
|
||||||
|
// ignore — best effort
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
} catch {
|
||||||
|
// lsof absent or failed — the fresh-ephemeral-port spawn doesn't need this.
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Resolve true once nothing is listening on `port` (lift of openchamber
|
||||||
|
* `waitForPortRelease`). Used before re-spawning on a fixed port; with ephemeral
|
||||||
|
* ports it's a fast no-op. Probes 127.0.0.1; resolves false at the deadline.
|
||||||
|
*/
|
||||||
|
function waitForPortRelease(port: number, timeoutMs: number): Promise<boolean> {
|
||||||
|
const deadline = Date.now() + timeoutMs;
|
||||||
|
return new Promise((resolve) => {
|
||||||
|
const attempt = () => {
|
||||||
|
const socket = netConnect({ port, host: '127.0.0.1' });
|
||||||
|
let settled = false;
|
||||||
|
const finish = (released: boolean) => {
|
||||||
|
if (settled) return;
|
||||||
|
settled = true;
|
||||||
|
socket.removeAllListeners();
|
||||||
|
socket.destroy();
|
||||||
|
if (released || Date.now() >= deadline) {
|
||||||
|
resolve(released);
|
||||||
|
return;
|
||||||
|
}
|
||||||
|
setTimeout(attempt, 150);
|
||||||
|
};
|
||||||
|
socket.once('connect', () => finish(false));
|
||||||
|
socket.once('error', (err: NodeJS.ErrnoException) => {
|
||||||
|
if (err && (err.code === 'ECONNREFUSED' || err.code === 'EHOSTUNREACH')) finish(true);
|
||||||
|
else finish(false);
|
||||||
|
});
|
||||||
|
socket.setTimeout(500, () => finish(true));
|
||||||
|
};
|
||||||
|
attempt();
|
||||||
|
});
|
||||||
|
}
|
||||||
|
|
||||||
/** Bind-probe an ephemeral port on loopback. */
|
/** Bind-probe an ephemeral port on loopback. */
|
||||||
function freePort(): Promise<number> {
|
function freePort(): Promise<number> {
|
||||||
return new Promise((resolve, reject) => {
|
return new Promise((resolve, reject) => {
|
||||||
|
|||||||
41
apps/coder/src/services/backends/warm-acp-routing.ts
Normal file
41
apps/coder/src/services/backends/warm-acp-routing.ts
Normal file
@@ -0,0 +1,41 @@
|
|||||||
|
/**
|
||||||
|
* v2.6 Phase 2 — warm-vs-one-shot routing predicate for goose/qwen.
|
||||||
|
*
|
||||||
|
* The warm ACP backend keys its persistent process + ACP session on (chat_id,
|
||||||
|
* agent) — exactly like the opencode-server backend. A task therefore only routes
|
||||||
|
* to the warm pool when it carries BOTH a `session_id` and a `chat_id`, i.e. it
|
||||||
|
* came from a real chat tab (the coder message route + skills route stamp both).
|
||||||
|
*
|
||||||
|
* Session-less creators — arena contestants, MCP-created tasks, generic
|
||||||
|
* `POST /api/tasks`, `new_task` — leave one or both null. Those keep the existing
|
||||||
|
* one-shot worktree-per-task ACP path (`runExternalAgent`), which spawns a fresh
|
||||||
|
* `goose acp` / `qwen --acp` per turn and never holds a warm process. Routing them
|
||||||
|
* warm would either synthesize a degenerate (null, agent) key or create a chat per
|
||||||
|
* arena contestant — neither is wanted, so they stay one-shot.
|
||||||
|
*
|
||||||
|
* Pure, so it's unit-testable; the dispatcher consumes it.
|
||||||
|
*/
|
||||||
|
const WARM_CAPABLE_AGENTS = new Set(['goose', 'qwen']);
|
||||||
|
|
||||||
|
export function shouldUseWarmBackend(task: {
|
||||||
|
agent: string | null;
|
||||||
|
session_id: string | null;
|
||||||
|
chat_id: string | null;
|
||||||
|
}): boolean {
|
||||||
|
if (!task.agent || !WARM_CAPABLE_AGENTS.has(task.agent)) return false;
|
||||||
|
return task.session_id != null && task.chat_id != null;
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Map an ACP prompt `stopReason` to the backend's ok/fail contract (TurnResult.ok).
|
||||||
|
*
|
||||||
|
* ACP's `StopReason` union includes normal completions (`end_turn`, `max_tokens`,
|
||||||
|
* `max_turn_requests`) and abnormal ones (`refusal`, `cancelled`). Only the latter
|
||||||
|
* two read as a failed turn; everything else (including an undefined/absent reason,
|
||||||
|
* which we default to `end_turn`) is a successful completion. Pure so it's testable
|
||||||
|
* independently of the warm process.
|
||||||
|
*/
|
||||||
|
export function isTurnOkForStopReason(stopReason: string | null | undefined): boolean {
|
||||||
|
const reason = stopReason ?? 'end_turn';
|
||||||
|
return reason !== 'refusal' && reason !== 'cancelled';
|
||||||
|
}
|
||||||
417
apps/coder/src/services/backends/warm-acp.ts
Normal file
417
apps/coder/src/services/backends/warm-acp.ts
Normal file
@@ -0,0 +1,417 @@
|
|||||||
|
/**
|
||||||
|
* v2.6 Phase 2 — WarmAcpBackend (goose, qwen).
|
||||||
|
*
|
||||||
|
* One persistent stdio process + ONE `ClientSideConnection` per (chat, agent),
|
||||||
|
* `initialize` + `session/new` done ONCE, reused across every turn — the warm
|
||||||
|
* analogue of the previous one-shot `acp-dispatch.ts` (which spawned/torn-down a
|
||||||
|
* fresh `goose acp` / `qwen --acp` per turn). Mirrors Paseo's `SpawnedACPProcess`.
|
||||||
|
*
|
||||||
|
* Implements the Phase 0 `AgentBackend` interface (same contract as
|
||||||
|
* `OpenCodeServerBackend`). Emits transport-agnostic `AgentEvent`s via the SHARED
|
||||||
|
* `mapSessionUpdate` (reused verbatim from the one-shot stack); the dispatcher maps
|
||||||
|
* those to WS frames + `persistExternalAgentTurn`, unchanged.
|
||||||
|
*
|
||||||
|
* Lifecycle decisions (design.md §2b / §10):
|
||||||
|
* - **Child lifetime is the pool's, not a request's.** Spawned once; never tied
|
||||||
|
* to a per-turn abort signal. Only the in-flight `prompt` gets `ctx.signal` —
|
||||||
|
* abort = ACP `session/cancel`, NOT killing the child.
|
||||||
|
* - **Per-turn abort** cancels the prompt on the warm connection so the SAME
|
||||||
|
* process serves the next turn.
|
||||||
|
* - **Crash** (child exit) marks `agent_sessions.status='crashed'` + logs; the
|
||||||
|
* next `ensureSession` re-spawns + re-`session/new` (Phase 3 hardens auto-restart).
|
||||||
|
* - **Resume across a process restart is NOT attempted in Phase 2.** goose ACP
|
||||||
|
* advertises no `loadSession`/`session.resume`; qwen does, but cross-restart
|
||||||
|
* resume is Phase 3. Within ONE live process the ACP session persists across
|
||||||
|
* turns (the whole point of "warm"); a restart re-`session/new` (memory loss
|
||||||
|
* across restart, accepted per §10). The agent's resume capabilities ARE
|
||||||
|
* probed and logged for forward-compat.
|
||||||
|
*
|
||||||
|
* Each WarmAcpBackend instance owns exactly one (chat, agent) — the dispatcher
|
||||||
|
* pools them under `agentPool.register(chatId, agent, backend)`.
|
||||||
|
*
|
||||||
|
* SDK note (@agentclientprotocol/sdk@^0.22.1, cross-checked against the design's
|
||||||
|
* `^0.14` worry): the resume method is the STABLE `resumeSession` (`session/resume`,
|
||||||
|
* gated by `agentCapabilities.sessionCapabilities.resume`), NOT the `^0.14`
|
||||||
|
* `unstable_resumeSession`. `loadSession` is gated by `agentCapabilities.loadSession`.
|
||||||
|
*/
|
||||||
|
import { spawn, type ChildProcess } from 'node:child_process';
|
||||||
|
import type { FastifyBaseLogger } from 'fastify';
|
||||||
|
import {
|
||||||
|
ClientSideConnection,
|
||||||
|
type Client,
|
||||||
|
type SessionNotification,
|
||||||
|
type RequestPermissionRequest,
|
||||||
|
type RequestPermissionResponse,
|
||||||
|
type ReadTextFileRequest,
|
||||||
|
type ReadTextFileResponse,
|
||||||
|
type WriteTextFileRequest,
|
||||||
|
type WriteTextFileResponse,
|
||||||
|
type CreateTerminalRequest,
|
||||||
|
type CreateTerminalResponse,
|
||||||
|
type CreateElicitationRequest,
|
||||||
|
type CreateElicitationResponse,
|
||||||
|
} from '@agentclientprotocol/sdk';
|
||||||
|
import type { Sql } from '../../db.js';
|
||||||
|
import { resolveLaunchSpec } from '../acp-spawn.js';
|
||||||
|
import { isTurnOkForStopReason } from './warm-acp-routing.js';
|
||||||
|
import { getResolvedRegistry, type ResolvedProviderDef } from '../provider-config-registry.js';
|
||||||
|
import { createAcpNdJsonStream } from '../acp-stream.js';
|
||||||
|
import { mapSessionUpdate } from '../acp-event-map.js';
|
||||||
|
import { readWorktreeTextFile, writeWorktreeTextFile } from '../acp-client-fs.js';
|
||||||
|
import { waitForPermissionResponse, waitForElicitationResponse, cancelPendingPermission } from '../permission-waiter.js';
|
||||||
|
import { type AcpToolSnapshot, synthesizeCanceledSnapshots } from '../acp-tool-snapshot.js';
|
||||||
|
import type {
|
||||||
|
AgentBackend,
|
||||||
|
AgentEvent,
|
||||||
|
AgentSessionHandle,
|
||||||
|
EnsureSessionOpts,
|
||||||
|
PromptCtx,
|
||||||
|
TurnResult,
|
||||||
|
} from '../agent-backend.js';
|
||||||
|
|
||||||
|
/** State for one in-flight turn (only one at a time per backend — turns serialize). */
|
||||||
|
interface TurnState {
|
||||||
|
/** Per-turn task id, for routing permission prompts back to the UI. */
|
||||||
|
taskId: string | undefined;
|
||||||
|
/** BooCode session id for permission-waiter's broker frames. */
|
||||||
|
sessionId: string;
|
||||||
|
/** Per-turn mode id (autonomous-mode gate in permission-waiter). */
|
||||||
|
modeId: string | undefined;
|
||||||
|
onEvent: (e: AgentEvent) => void;
|
||||||
|
/** Tool-call snapshot accumulator for this turn — merge across tool_call_update. */
|
||||||
|
snapshots: Map<string, AcpToolSnapshot>;
|
||||||
|
}
|
||||||
|
|
||||||
|
export interface WarmAcpBackendDeps {
|
||||||
|
sql: Sql;
|
||||||
|
log: FastifyBaseLogger;
|
||||||
|
/** The (chat, agent) this backend serves — its pool identity + DB key. */
|
||||||
|
chatId: string;
|
||||||
|
agent: string;
|
||||||
|
/** Resolved binary for the agent (from available_agents.install_path), or null. */
|
||||||
|
installPath: string | null;
|
||||||
|
/** Optional override of the resolved registry def (defaults to a live lookup). */
|
||||||
|
resolved?: ResolvedProviderDef;
|
||||||
|
}
|
||||||
|
|
||||||
|
export class WarmAcpBackend implements AgentBackend {
|
||||||
|
readonly backend = 'acp_warm' as const;
|
||||||
|
|
||||||
|
private readonly sql: Sql;
|
||||||
|
private readonly log: FastifyBaseLogger;
|
||||||
|
private readonly chatId: string;
|
||||||
|
private readonly agent: string;
|
||||||
|
private readonly installPath: string | null;
|
||||||
|
private readonly resolvedOverride: ResolvedProviderDef | undefined;
|
||||||
|
|
||||||
|
private child: ChildProcess | null = null;
|
||||||
|
private connection: ClientSideConnection | null = null;
|
||||||
|
/** The single ACP session id for this warm process; null until session/new. */
|
||||||
|
private acpSessionId: string | null = null;
|
||||||
|
private up = false;
|
||||||
|
/** Idempotent spawn guard — one warm process per backend, started lazily. */
|
||||||
|
private starting: Promise<void> | null = null;
|
||||||
|
/** Resume capabilities probed at initialize, logged for forward-compat (Phase 3). */
|
||||||
|
private supportsLoadSession = false;
|
||||||
|
private supportsResumeSession = false;
|
||||||
|
|
||||||
|
/** The current in-flight turn; the Client closures read it. Null between turns. */
|
||||||
|
private activeTurn: TurnState | null = null;
|
||||||
|
|
||||||
|
constructor(deps: WarmAcpBackendDeps) {
|
||||||
|
this.sql = deps.sql;
|
||||||
|
this.log = deps.log;
|
||||||
|
this.chatId = deps.chatId;
|
||||||
|
this.agent = deps.agent;
|
||||||
|
this.installPath = deps.installPath;
|
||||||
|
this.resolvedOverride = deps.resolved;
|
||||||
|
}
|
||||||
|
|
||||||
|
/** §2: liveness for the health endpoint + dispatcher fallback decision. */
|
||||||
|
health(): 'up' | 'down' {
|
||||||
|
return this.up ? 'up' : 'down';
|
||||||
|
}
|
||||||
|
|
||||||
|
/** Phase 3: busy iff this backend's single session has an in-flight turn. The
|
||||||
|
* pool reads this to skip idle/LRU eviction (never kill the child mid-prompt). */
|
||||||
|
isBusy(): boolean {
|
||||||
|
return this.activeTurn != null;
|
||||||
|
}
|
||||||
|
|
||||||
|
// ─── warm-process lifecycle (2.1 spawn + initialize + session/new ONCE) ───────
|
||||||
|
|
||||||
|
/** Lazy: spawn the warm process on first use. Idempotent — one process per backend. */
|
||||||
|
private ensureProcess(worktreePath: string): Promise<void> {
|
||||||
|
if (this.up && this.connection && this.acpSessionId) return Promise.resolve();
|
||||||
|
if (!this.starting) {
|
||||||
|
this.starting = this.startProcess(worktreePath).catch((err) => {
|
||||||
|
// Reset so a later ensureSession can retry the spawn after a failed start.
|
||||||
|
this.starting = null;
|
||||||
|
throw err;
|
||||||
|
});
|
||||||
|
}
|
||||||
|
return this.starting;
|
||||||
|
}
|
||||||
|
|
||||||
|
private async startProcess(worktreePath: string): Promise<void> {
|
||||||
|
const resolved = this.resolvedOverride ?? getResolvedRegistry().get(this.agent);
|
||||||
|
const spec = resolved ? resolveLaunchSpec(resolved, this.installPath) : null;
|
||||||
|
if (!spec) throw new Error(`warm-acp: agent '${this.agent}' does not support ACP (no launch spec)`);
|
||||||
|
|
||||||
|
this.log.info({ agent: this.agent, chatId: this.chatId, binary: spec.binary, worktreePath }, 'warm-acp: spawning warm process');
|
||||||
|
// Child lifetime is the pool's. NOT tied to any per-turn abort signal — only
|
||||||
|
// the in-flight prompt is cancellable (via ACP session/cancel in prompt()).
|
||||||
|
const child = spawn(spec.binary, spec.args, {
|
||||||
|
cwd: worktreePath,
|
||||||
|
stdio: ['pipe', 'pipe', 'pipe'],
|
||||||
|
env: { ...process.env, ...spec.env },
|
||||||
|
});
|
||||||
|
this.child = child;
|
||||||
|
|
||||||
|
// 2.3: supervise the child; react to its exit, never let a request scope kill it.
|
||||||
|
child.on('exit', (code, signal) => {
|
||||||
|
this.up = false;
|
||||||
|
this.connection = null;
|
||||||
|
this.acpSessionId = null;
|
||||||
|
this.starting = null;
|
||||||
|
this.log.warn({ agent: this.agent, chatId: this.chatId, code, signal }, 'warm-acp: warm process exited — marking crashed (rebuild on next turn)');
|
||||||
|
void this.markCrashed();
|
||||||
|
});
|
||||||
|
// A spawn error (e.g. ENOENT) surfaces here, not as an exit.
|
||||||
|
child.on('error', (err) => {
|
||||||
|
this.up = false;
|
||||||
|
this.log.error({ agent: this.agent, chatId: this.chatId, err: errMsg(err) }, 'warm-acp: warm process error');
|
||||||
|
});
|
||||||
|
|
||||||
|
const stream = createAcpNdJsonStream(child);
|
||||||
|
const connection = new ClientSideConnection(() => this.buildClient(worktreePath), stream);
|
||||||
|
|
||||||
|
const init = await connection.initialize({
|
||||||
|
protocolVersion: 1,
|
||||||
|
clientInfo: { name: 'boocoder', version: '2.6.0' },
|
||||||
|
clientCapabilities: {},
|
||||||
|
});
|
||||||
|
const caps = init.agentCapabilities;
|
||||||
|
this.supportsLoadSession = caps?.loadSession === true;
|
||||||
|
this.supportsResumeSession = caps?.sessionCapabilities?.resume != null;
|
||||||
|
|
||||||
|
const session = await connection.newSession({ cwd: worktreePath, mcpServers: [] });
|
||||||
|
this.connection = connection;
|
||||||
|
this.acpSessionId = session.sessionId;
|
||||||
|
this.up = true;
|
||||||
|
this.log.info(
|
||||||
|
{
|
||||||
|
agent: this.agent,
|
||||||
|
chatId: this.chatId,
|
||||||
|
acpSessionId: session.sessionId,
|
||||||
|
loadSession: this.supportsLoadSession,
|
||||||
|
resumeSession: this.supportsResumeSession,
|
||||||
|
},
|
||||||
|
'warm-acp: warm session ready',
|
||||||
|
);
|
||||||
|
}
|
||||||
|
|
||||||
|
/** Build the ACP Client callbacks ONCE per connection. They read `this.activeTurn`
|
||||||
|
* so each turn's events/permissions route to the right place — exactly the
|
||||||
|
* opencode-server `activeTurn` pattern. Worktree-scoped FS like AcpStreamContext. */
|
||||||
|
private buildClient(worktreePath: string): Client {
|
||||||
|
return {
|
||||||
|
sessionUpdate: async (params: SessionNotification): Promise<void> => {
|
||||||
|
const turn = this.activeTurn;
|
||||||
|
if (!turn) return; // between turns — drop (no orphan settles a future turn)
|
||||||
|
for (const event of mapSessionUpdate(params, turn.snapshots)) {
|
||||||
|
turn.onEvent(event);
|
||||||
|
}
|
||||||
|
},
|
||||||
|
requestPermission: async (params: RequestPermissionRequest): Promise<RequestPermissionResponse> => {
|
||||||
|
const turn = this.activeTurn;
|
||||||
|
if (turn?.taskId) {
|
||||||
|
// Route to the UI via the per-turn task id (same as the one-shot path).
|
||||||
|
return waitForPermissionResponse(turn.taskId, turn.sessionId, this.agent, turn.modeId, params);
|
||||||
|
}
|
||||||
|
const firstOption = params.options[0];
|
||||||
|
if (firstOption) return { outcome: { outcome: 'selected', optionId: firstOption.optionId } };
|
||||||
|
return { outcome: { outcome: 'cancelled' } };
|
||||||
|
},
|
||||||
|
readTextFile: async (params: ReadTextFileRequest): Promise<ReadTextFileResponse> => {
|
||||||
|
const content = await readWorktreeTextFile(worktreePath, params.path, params.line, params.limit);
|
||||||
|
return { content };
|
||||||
|
},
|
||||||
|
writeTextFile: async (params: WriteTextFileRequest): Promise<WriteTextFileResponse> => {
|
||||||
|
await writeWorktreeTextFile(worktreePath, params.path, params.content);
|
||||||
|
return {};
|
||||||
|
},
|
||||||
|
createTerminal: async (_params: CreateTerminalRequest): Promise<CreateTerminalResponse> => {
|
||||||
|
return { terminalId: 'noop' };
|
||||||
|
},
|
||||||
|
unstable_createElicitation: async (params: CreateElicitationRequest): Promise<CreateElicitationResponse> => {
|
||||||
|
const turn = this.activeTurn;
|
||||||
|
if (turn?.taskId) {
|
||||||
|
return waitForElicitationResponse(turn.taskId, turn.sessionId, this.agent, turn.modeId, params);
|
||||||
|
}
|
||||||
|
return { action: 'decline' };
|
||||||
|
},
|
||||||
|
};
|
||||||
|
}
|
||||||
|
|
||||||
|
// ─── ensureSession: create-or-reuse the warm session (2.1) ───────────────────
|
||||||
|
|
||||||
|
async ensureSession(sessionId: string, opts: EnsureSessionOpts): Promise<AgentSessionHandle> {
|
||||||
|
await this.ensureProcess(opts.worktreePath);
|
||||||
|
if (!this.acpSessionId) throw new Error('warm-acp: session not ready after ensureProcess');
|
||||||
|
|
||||||
|
// P1.5-b: agent_sessions keys on (chat_id, agent). The ACP session id is the
|
||||||
|
// resume handle WITHIN the live process; across a process restart it's stale,
|
||||||
|
// so ensureProcess re-`session/new` and we upsert the fresh id here.
|
||||||
|
await this.sql`
|
||||||
|
INSERT INTO agent_sessions
|
||||||
|
(chat_id, session_id, worktree_id, agent, backend, agent_session_id, server_port, status, last_active_at)
|
||||||
|
VALUES
|
||||||
|
(${opts.chatId}, ${sessionId}, ${opts.worktreeId}, ${opts.agent}, 'acp_warm', ${this.acpSessionId}, NULL, 'active', clock_timestamp())
|
||||||
|
ON CONFLICT (chat_id, agent) DO UPDATE SET
|
||||||
|
session_id = EXCLUDED.session_id,
|
||||||
|
worktree_id = EXCLUDED.worktree_id,
|
||||||
|
backend = 'acp_warm',
|
||||||
|
agent_session_id = EXCLUDED.agent_session_id,
|
||||||
|
server_port = NULL,
|
||||||
|
status = 'active',
|
||||||
|
last_active_at = clock_timestamp()
|
||||||
|
`.catch((err) => {
|
||||||
|
this.log.warn({ err: errMsg(err), chatId: opts.chatId, agent: opts.agent }, 'warm-acp: agent_sessions upsert failed (non-fatal)');
|
||||||
|
});
|
||||||
|
|
||||||
|
return {
|
||||||
|
sessionId,
|
||||||
|
agent: opts.agent,
|
||||||
|
backend: 'acp_warm',
|
||||||
|
chatId: opts.chatId,
|
||||||
|
worktreeId: opts.worktreeId,
|
||||||
|
agentSessionId: this.acpSessionId,
|
||||||
|
serverPort: null,
|
||||||
|
};
|
||||||
|
}
|
||||||
|
|
||||||
|
// ─── prompt: one turn on the warm connection (2.2) ───────────────────────────
|
||||||
|
|
||||||
|
async prompt(handle: AgentSessionHandle, input: string, ctx: PromptCtx): Promise<TurnResult> {
|
||||||
|
// The warm process may have crashed between ensureSession and here, or this
|
||||||
|
// backend was rebuilt — re-establish before prompting.
|
||||||
|
await this.ensureProcess(ctx.worktreePath);
|
||||||
|
const connection = this.connection;
|
||||||
|
const acpSessionId = this.acpSessionId;
|
||||||
|
if (!connection || !acpSessionId) {
|
||||||
|
return { ok: false, error: 'warm-acp: no live ACP connection' };
|
||||||
|
}
|
||||||
|
|
||||||
|
const snapshots = new Map<string, AcpToolSnapshot>();
|
||||||
|
// taskId routes permission/elicitation prompts back to the UI. The dispatcher
|
||||||
|
// passes it (plus mode) on the per-turn PromptCtx; permission-waiter keys on it.
|
||||||
|
const turn: TurnState = {
|
||||||
|
taskId: ctx.taskId,
|
||||||
|
sessionId: handle.sessionId,
|
||||||
|
modeId: ctx.modeId,
|
||||||
|
onEvent: ctx.onEvent,
|
||||||
|
snapshots,
|
||||||
|
};
|
||||||
|
this.activeTurn = turn;
|
||||||
|
|
||||||
|
// Per-turn abort: cancel the in-flight prompt on the SAME connection — never
|
||||||
|
// kill the child (that's the pool's lifetime). On cancel we also synthesize
|
||||||
|
// 'canceled' updates for any still-running tool calls so the UI doesn't leave
|
||||||
|
// them spinning (mirrors AcpStreamContext.markAborted).
|
||||||
|
let aborted = false;
|
||||||
|
const onAbort = () => {
|
||||||
|
if (aborted) return;
|
||||||
|
aborted = true;
|
||||||
|
connection.cancel({ sessionId: acpSessionId }).catch(() => {});
|
||||||
|
if (ctx.taskId) cancelPendingPermission(ctx.taskId);
|
||||||
|
for (const snap of synthesizeCanceledSnapshots(snapshots.values())) {
|
||||||
|
snapshots.set(snap.toolCallId, snap);
|
||||||
|
ctx.onEvent({ type: 'tool_update', toolCall: snap });
|
||||||
|
}
|
||||||
|
};
|
||||||
|
|
||||||
|
if (ctx.signal.aborted) {
|
||||||
|
this.activeTurn = null;
|
||||||
|
return { ok: false, error: 'aborted' };
|
||||||
|
}
|
||||||
|
ctx.signal.addEventListener('abort', onAbort, { once: true });
|
||||||
|
|
||||||
|
try {
|
||||||
|
const result = await connection.prompt({
|
||||||
|
sessionId: acpSessionId,
|
||||||
|
prompt: [{ type: 'text', text: input }],
|
||||||
|
});
|
||||||
|
if (aborted) return { ok: false, error: 'aborted' };
|
||||||
|
const stopReason = result.stopReason ?? 'end_turn';
|
||||||
|
return isTurnOkForStopReason(stopReason)
|
||||||
|
? { ok: true }
|
||||||
|
: { ok: false, error: `stop_reason: ${stopReason}` };
|
||||||
|
} catch (err) {
|
||||||
|
if (aborted) return { ok: false, error: 'aborted' };
|
||||||
|
return { ok: false, error: errMsg(err) };
|
||||||
|
} finally {
|
||||||
|
ctx.signal.removeEventListener('abort', onAbort);
|
||||||
|
this.activeTurn = null;
|
||||||
|
await this.sql`
|
||||||
|
UPDATE agent_sessions SET status = 'idle', last_active_at = clock_timestamp()
|
||||||
|
WHERE chat_id = ${this.chatId} AND agent = ${this.agent}
|
||||||
|
`.catch(() => {});
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
// ─── teardown ────────────────────────────────────────────────────────────────
|
||||||
|
|
||||||
|
async closeSession(handle: AgentSessionHandle): Promise<void> {
|
||||||
|
// Gracefully close the ACP session if the agent supports it; then kill the child.
|
||||||
|
if (this.connection && this.acpSessionId) {
|
||||||
|
await this.connection.closeSession({ sessionId: this.acpSessionId }).catch(() => {});
|
||||||
|
}
|
||||||
|
await this.killChild();
|
||||||
|
await this.sql`
|
||||||
|
UPDATE agent_sessions SET status = 'closed'
|
||||||
|
WHERE chat_id = ${handle.chatId} AND agent = ${handle.agent}
|
||||||
|
`.catch(() => {});
|
||||||
|
}
|
||||||
|
|
||||||
|
async dispose(): Promise<void> {
|
||||||
|
this.up = false;
|
||||||
|
this.activeTurn = null;
|
||||||
|
if (this.connection && this.acpSessionId) {
|
||||||
|
await this.connection.closeSession({ sessionId: this.acpSessionId }).catch(() => {});
|
||||||
|
}
|
||||||
|
await this.killChild();
|
||||||
|
this.connection = null;
|
||||||
|
this.acpSessionId = null;
|
||||||
|
this.starting = null;
|
||||||
|
}
|
||||||
|
|
||||||
|
private async killChild(): Promise<void> {
|
||||||
|
const child = this.child;
|
||||||
|
this.child = null;
|
||||||
|
if (!child || child.killed) return;
|
||||||
|
child.kill('SIGTERM');
|
||||||
|
await new Promise<void>((resolve) => {
|
||||||
|
const t = setTimeout(() => {
|
||||||
|
if (!child.killed) child.kill('SIGKILL');
|
||||||
|
resolve();
|
||||||
|
}, 5_000);
|
||||||
|
t.unref?.();
|
||||||
|
child.once('close', () => {
|
||||||
|
clearTimeout(t);
|
||||||
|
resolve();
|
||||||
|
});
|
||||||
|
});
|
||||||
|
}
|
||||||
|
|
||||||
|
private async markCrashed(): Promise<void> {
|
||||||
|
await this.sql`
|
||||||
|
UPDATE agent_sessions SET status = 'crashed'
|
||||||
|
WHERE chat_id = ${this.chatId} AND agent = ${this.agent}
|
||||||
|
`.catch(() => {});
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
function errMsg(e: unknown): string {
|
||||||
|
return e instanceof Error ? e.message : String(e);
|
||||||
|
}
|
||||||
@@ -12,8 +12,10 @@ import { clearTaskCommands, setTaskCommands } from './agent-commands-cache.js';
|
|||||||
import { getManifestCommands } from './provider-commands.js';
|
import { getManifestCommands } from './provider-commands.js';
|
||||||
import { persistExternalAgentTurn } from './agent-turn-persist.js';
|
import { persistExternalAgentTurn } from './agent-turn-persist.js';
|
||||||
import { snapshotToWireToolCall, type AcpToolSnapshot } from './acp-tool-snapshot.js';
|
import { snapshotToWireToolCall, type AcpToolSnapshot } from './acp-tool-snapshot.js';
|
||||||
import { agentPool } from './agent-pool.js';
|
import { agentPool, OPENCODE_POOL_KEY } from './agent-pool.js';
|
||||||
import { OpenCodeServerBackend } from './backends/opencode-server.js';
|
import { OpenCodeServerBackend } from './backends/opencode-server.js';
|
||||||
|
import { WarmAcpBackend } from './backends/warm-acp.js';
|
||||||
|
import { shouldUseWarmBackend } from './backends/warm-acp-routing.js';
|
||||||
import type { AgentBackend, AgentEvent } from './agent-backend.js';
|
import type { AgentBackend, AgentEvent } from './agent-backend.js';
|
||||||
|
|
||||||
interface InferenceRunner {
|
interface InferenceRunner {
|
||||||
@@ -121,10 +123,15 @@ export function createDispatcher(deps: Deps): { start(): void; stop(): Promise<v
|
|||||||
SELECT name, supports_acp, install_path FROM available_agents WHERE name = ${task.agent}
|
SELECT name, supports_acp, install_path FROM available_agents WHERE name = ${task.agent}
|
||||||
`;
|
`;
|
||||||
if (agentRow) {
|
if (agentRow) {
|
||||||
// v2.6 (1.7): opencode routes to the warm pool backend; every other
|
// v2.6 (1.7): opencode routes to its warm HTTP-server backend.
|
||||||
// external agent keeps the existing one-shot ACP/PTY path untouched.
|
// v2.6 Phase 2 (2.4): goose/qwen route to the warm ACP backend WHEN the
|
||||||
|
// task came from a real chat tab (session_id + chat_id) — shouldUseWarmBackend.
|
||||||
|
// Session-less creators (arena, MCP, new_task, generic /api/tasks) keep the
|
||||||
|
// existing one-shot worktree-per-task ACP/PTY path untouched.
|
||||||
if (task.agent === 'opencode') {
|
if (task.agent === 'opencode') {
|
||||||
await runOpenCodeServerTask(task, agentRow.install_path);
|
await runOpenCodeServerTask(task, agentRow.install_path);
|
||||||
|
} else if (shouldUseWarmBackend(task)) {
|
||||||
|
await runWarmAcpTask(task, agentRow.install_path);
|
||||||
} else {
|
} else {
|
||||||
await runExternalAgent(task, agentRow.supports_acp, agentRow.install_path);
|
await runExternalAgent(task, agentRow.supports_acp, agentRow.install_path);
|
||||||
}
|
}
|
||||||
@@ -492,9 +499,8 @@ export function createDispatcher(deps: Deps): { start(): void; stop(): Promise<v
|
|||||||
|
|
||||||
// OpenCode runs ONE server per BooCoder process, shared across all sessions
|
// OpenCode runs ONE server per BooCoder process, shared across all sessions
|
||||||
// (the backend multiplexes sessions internally), so it's pooled under a fixed
|
// (the backend multiplexes sessions internally), so it's pooled under a fixed
|
||||||
// key rather than per-session. Warm ACP backends (Phase 2) will be per-session.
|
// key (OPENCODE_POOL_KEY, shared with the lifecycle close-hook) rather than
|
||||||
const OPENCODE_POOL_KEY = '__opencode_server__';
|
// per-session. Warm ACP backends (Phase 2) are per (chat, agent).
|
||||||
|
|
||||||
function getOpenCodeBackend(installPath: string | null): AgentBackend {
|
function getOpenCodeBackend(installPath: string | null): AgentBackend {
|
||||||
let backend = agentPool.get(OPENCODE_POOL_KEY, 'opencode');
|
let backend = agentPool.get(OPENCODE_POOL_KEY, 'opencode');
|
||||||
if (!backend) {
|
if (!backend) {
|
||||||
@@ -703,6 +709,9 @@ export function createDispatcher(deps: Deps): { start(): void; stop(): Promise<v
|
|||||||
signal: ac.signal,
|
signal: ac.signal,
|
||||||
onEvent,
|
onEvent,
|
||||||
});
|
});
|
||||||
|
// Phase 3: keep the pooled backend's slot warm across this (possibly long)
|
||||||
|
// turn so the idle sweep measures from turn END, not start.
|
||||||
|
agentPool.touch(OPENCODE_POOL_KEY, agent);
|
||||||
|
|
||||||
// Flush any text held back mid-tag at stream end (complete tags stripped).
|
// Flush any text held back mid-tag at stream end (complete tags stripped).
|
||||||
const dcpTail = dcp.flush();
|
const dcpTail = dcp.flush();
|
||||||
@@ -788,6 +797,247 @@ export function createDispatcher(deps: Deps): { start(): void; stop(): Promise<v
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
|
// ─── Path B (warm ACP): goose / qwen warm backend (v2.6 Phase 2) ─────────────
|
||||||
|
|
||||||
|
// Warm ACP backends are per (chat, agent): each owns ONE stdio process + ACP
|
||||||
|
// connection + session. Pool key = chatId; the AgentPool's secondary key is the
|
||||||
|
// agent. This mirrors agent_sessions' (chat_id, agent) PK.
|
||||||
|
function getWarmAcpBackend(chatId: string, agent: string, installPath: string | null): WarmAcpBackend {
|
||||||
|
let backend = agentPool.get(chatId, agent);
|
||||||
|
if (!backend) {
|
||||||
|
backend = new WarmAcpBackend({
|
||||||
|
sql,
|
||||||
|
log,
|
||||||
|
chatId,
|
||||||
|
agent,
|
||||||
|
installPath,
|
||||||
|
resolved: getResolvedRegistry().get(agent),
|
||||||
|
});
|
||||||
|
agentPool.register(chatId, agent, backend);
|
||||||
|
}
|
||||||
|
return backend as WarmAcpBackend;
|
||||||
|
}
|
||||||
|
|
||||||
|
async function runWarmAcpTask(
|
||||||
|
task: {
|
||||||
|
id: string;
|
||||||
|
project_id: string;
|
||||||
|
input: string;
|
||||||
|
agent: string | null;
|
||||||
|
model: string | null;
|
||||||
|
mode_id: string | null;
|
||||||
|
thinking_option_id: string | null;
|
||||||
|
session_id: string | null;
|
||||||
|
chat_id: string | null;
|
||||||
|
},
|
||||||
|
installPath: string | null,
|
||||||
|
): Promise<void> {
|
||||||
|
const taskId = task.id;
|
||||||
|
const agent = task.agent!;
|
||||||
|
// shouldUseWarmBackend guarantees both non-null before we get here.
|
||||||
|
const sessionId = task.session_id!;
|
||||||
|
const chatId = task.chat_id!;
|
||||||
|
log.info({ taskId, agent, chatId }, 'dispatcher: starting task (path B — warm ACP)');
|
||||||
|
|
||||||
|
const [project] = await sql<{ path: string | null }[]>`
|
||||||
|
SELECT path FROM projects WHERE id = ${task.project_id}
|
||||||
|
`;
|
||||||
|
const projectPath = project?.path;
|
||||||
|
if (!projectPath) {
|
||||||
|
await sql`
|
||||||
|
UPDATE tasks
|
||||||
|
SET state = 'failed', ended_at = clock_timestamp(), output_summary = 'Project has no path — cannot create worktree'
|
||||||
|
WHERE id = ${taskId}
|
||||||
|
`;
|
||||||
|
return;
|
||||||
|
}
|
||||||
|
|
||||||
|
const ac = new AbortController();
|
||||||
|
|
||||||
|
try {
|
||||||
|
await sql`
|
||||||
|
UPDATE tasks
|
||||||
|
SET state = 'running', started_at = clock_timestamp(), execution_path = 'acp'
|
||||||
|
WHERE id = ${taskId}
|
||||||
|
`;
|
||||||
|
|
||||||
|
// Persistent, session-keyed worktree (shared across turns + agents; NOT torn
|
||||||
|
// down per turn — Phase 3 reaps it). Same as the opencode-server path so a
|
||||||
|
// chat that switches opencode↔goose↔qwen shares one worktree.
|
||||||
|
const { worktreeId, worktreePath, baseCommit } = await ensureSessionWorktree(sql, projectPath, sessionId, {
|
||||||
|
signal: ac.signal,
|
||||||
|
});
|
||||||
|
log.info({ taskId, worktreePath }, 'dispatcher: session worktree ready (warm ACP)');
|
||||||
|
|
||||||
|
const [assistantMsg] = await sql<{ id: string }[]>`
|
||||||
|
INSERT INTO messages (session_id, chat_id, role, content, status, created_at)
|
||||||
|
VALUES (${sessionId}, ${chatId}, 'assistant', '', 'streaming', clock_timestamp())
|
||||||
|
RETURNING id
|
||||||
|
`;
|
||||||
|
const assistantId = assistantMsg!.id;
|
||||||
|
|
||||||
|
broker.publishFrame(sessionId, {
|
||||||
|
type: 'message_started',
|
||||||
|
message_id: assistantId,
|
||||||
|
chat_id: chatId,
|
||||||
|
role: 'assistant',
|
||||||
|
} as WsFrame);
|
||||||
|
|
||||||
|
const manifestCommands = getManifestCommands(agent);
|
||||||
|
if (manifestCommands.length > 0) {
|
||||||
|
setTaskCommands(taskId, manifestCommands);
|
||||||
|
broker.publishFrame(sessionId, {
|
||||||
|
type: 'agent_commands',
|
||||||
|
task_id: taskId,
|
||||||
|
session_id: sessionId,
|
||||||
|
commands: manifestCommands,
|
||||||
|
} as WsFrame);
|
||||||
|
}
|
||||||
|
|
||||||
|
// Accumulate the turn's stream for persistence + the final message content.
|
||||||
|
const textChunks: string[] = [];
|
||||||
|
const reasoningChunks: string[] = [];
|
||||||
|
const toolSnaps = new Map<string, AcpToolSnapshot>();
|
||||||
|
|
||||||
|
// Map transport-agnostic AgentEvents → the SAME WS frames the one-shot ACP
|
||||||
|
// path emits (identical to runOpenCodeServerTask's onEvent). No dcp stripping:
|
||||||
|
// that's an opencode-plugin artifact; goose/qwen don't emit dcp tags.
|
||||||
|
const onEvent = (e: AgentEvent): void => {
|
||||||
|
switch (e.type) {
|
||||||
|
case 'text':
|
||||||
|
textChunks.push(e.text);
|
||||||
|
broker.publishFrame(sessionId, {
|
||||||
|
type: 'delta',
|
||||||
|
message_id: assistantId,
|
||||||
|
chat_id: chatId,
|
||||||
|
content: e.text,
|
||||||
|
} as WsFrame);
|
||||||
|
break;
|
||||||
|
case 'reasoning':
|
||||||
|
reasoningChunks.push(e.text);
|
||||||
|
broker.publishFrame(sessionId, {
|
||||||
|
type: 'reasoning_delta',
|
||||||
|
message_id: assistantId,
|
||||||
|
chat_id: chatId,
|
||||||
|
content: e.text,
|
||||||
|
} as WsFrame);
|
||||||
|
break;
|
||||||
|
case 'tool_call':
|
||||||
|
case 'tool_update':
|
||||||
|
toolSnaps.set(e.toolCall.toolCallId, e.toolCall);
|
||||||
|
broker.publishFrame(sessionId, {
|
||||||
|
type: 'tool_call',
|
||||||
|
message_id: assistantId,
|
||||||
|
chat_id: chatId,
|
||||||
|
tool_call: snapshotToWireToolCall(e.toolCall),
|
||||||
|
} as WsFrame);
|
||||||
|
break;
|
||||||
|
case 'commands':
|
||||||
|
if (e.commands.length > 0) {
|
||||||
|
setTaskCommands(taskId, e.commands);
|
||||||
|
broker.publishFrame(sessionId, {
|
||||||
|
type: 'agent_commands',
|
||||||
|
task_id: taskId,
|
||||||
|
session_id: sessionId,
|
||||||
|
commands: e.commands,
|
||||||
|
} as WsFrame);
|
||||||
|
}
|
||||||
|
break;
|
||||||
|
}
|
||||||
|
};
|
||||||
|
|
||||||
|
const model = task.model ?? undefined;
|
||||||
|
const backend = getWarmAcpBackend(chatId, agent, installPath);
|
||||||
|
const handle = await backend.ensureSession(sessionId, {
|
||||||
|
agent,
|
||||||
|
model: model ?? '',
|
||||||
|
chatId,
|
||||||
|
worktreePath,
|
||||||
|
worktreeId,
|
||||||
|
projectId: task.project_id,
|
||||||
|
});
|
||||||
|
const result = await backend.prompt(handle, task.input, {
|
||||||
|
worktreePath,
|
||||||
|
model: model ?? '',
|
||||||
|
signal: ac.signal,
|
||||||
|
onEvent,
|
||||||
|
taskId,
|
||||||
|
modeId: task.mode_id ?? undefined,
|
||||||
|
});
|
||||||
|
// Phase 3: keep the pooled (chat,agent) backend warm across the turn.
|
||||||
|
agentPool.touch(chatId, agent);
|
||||||
|
|
||||||
|
const assistantContent = textChunks.join('').slice(0, 50_000);
|
||||||
|
const reasoningText = reasoningChunks.join('').slice(0, 200_000);
|
||||||
|
const outputSummary = (result.ok ? textChunks.join('') : result.error ?? 'warm ACP turn failed').slice(0, 500);
|
||||||
|
|
||||||
|
await persistExternalAgentTurn(sql, assistantId, [...toolSnaps.values()], reasoningText);
|
||||||
|
|
||||||
|
await sql`
|
||||||
|
UPDATE messages
|
||||||
|
SET content = ${assistantContent}, status = 'complete', finished_at = clock_timestamp()
|
||||||
|
WHERE id = ${assistantId}
|
||||||
|
`;
|
||||||
|
broker.publishFrame(sessionId, {
|
||||||
|
type: 'message_complete',
|
||||||
|
message_id: assistantId,
|
||||||
|
chat_id: chatId,
|
||||||
|
} as WsFrame);
|
||||||
|
|
||||||
|
if (stopping) {
|
||||||
|
await sql`UPDATE tasks SET state = 'cancelled', ended_at = clock_timestamp() WHERE id = ${taskId}`;
|
||||||
|
return; // worktree persists (no cleanup); backend stays warm
|
||||||
|
}
|
||||||
|
|
||||||
|
// Diff the persistent worktree against its captured baseline and SUPERSEDE
|
||||||
|
// the session's prior pending row (latest-wins) — identical to opencode.
|
||||||
|
const diff = await diffWorktree(worktreePath, projectPath, {
|
||||||
|
signal: ac.signal,
|
||||||
|
baseRef: baseCommit ?? 'HEAD',
|
||||||
|
});
|
||||||
|
if (diff) {
|
||||||
|
await sql`
|
||||||
|
DELETE FROM pending_changes WHERE session_id = ${sessionId} AND status = 'pending'
|
||||||
|
`;
|
||||||
|
await sql`
|
||||||
|
INSERT INTO pending_changes (session_id, task_id, file_path, operation, diff, agent)
|
||||||
|
VALUES (${sessionId}, ${taskId}, ${projectPath}, 'edit', ${diff}, ${agent})
|
||||||
|
`;
|
||||||
|
log.info({ taskId, diffLength: diff.length }, 'dispatcher: diff superseded prior pending change (warm ACP)');
|
||||||
|
} else {
|
||||||
|
log.info({ taskId }, 'dispatcher: no changes detected in session worktree (warm ACP)');
|
||||||
|
}
|
||||||
|
|
||||||
|
// NO worktree cleanup — persistent (Phase 3 reaps it). Backend stays warm.
|
||||||
|
|
||||||
|
const [extCostRow] = await sql<{ total: number | null }[]>`
|
||||||
|
SELECT SUM(tokens_used)::int AS total
|
||||||
|
FROM messages
|
||||||
|
WHERE session_id = ${sessionId} AND tokens_used IS NOT NULL
|
||||||
|
`;
|
||||||
|
const extCostTokens = extCostRow?.total ?? null;
|
||||||
|
|
||||||
|
const finalState = result.ok ? 'completed' : 'failed';
|
||||||
|
await sql`
|
||||||
|
UPDATE tasks
|
||||||
|
SET state = ${finalState}, ended_at = clock_timestamp(), output_summary = ${outputSummary}, cost_tokens = ${extCostTokens}
|
||||||
|
WHERE id = ${taskId}
|
||||||
|
`;
|
||||||
|
log.info({ taskId, agent, finalState }, 'dispatcher: task finished (warm ACP)');
|
||||||
|
clearTaskCommands(taskId);
|
||||||
|
} catch (err) {
|
||||||
|
const errMsg = err instanceof Error ? err.message : String(err);
|
||||||
|
log.error({ taskId, agent, err: errMsg }, 'dispatcher: warm ACP error');
|
||||||
|
await sql`
|
||||||
|
UPDATE tasks
|
||||||
|
SET state = 'failed', ended_at = clock_timestamp(), output_summary = ${errMsg.slice(0, 500)}
|
||||||
|
WHERE id = ${taskId}
|
||||||
|
`.catch(() => {});
|
||||||
|
clearTaskCommands(taskId);
|
||||||
|
// No worktree cleanup (persistent); backend stays warm for the next turn.
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
// ─── Helpers ────────────────────────────────────────────────────────────────
|
// ─── Helpers ────────────────────────────────────────────────────────────────
|
||||||
|
|
||||||
async function waitForCompletion(assistantId: string): Promise<string> {
|
async function waitForCompletion(assistantId: string): Promise<string> {
|
||||||
|
|||||||
170
apps/coder/src/services/orphan-worktree-reaper.ts
Normal file
170
apps/coder/src/services/orphan-worktree-reaper.ts
Normal file
@@ -0,0 +1,170 @@
|
|||||||
|
/**
|
||||||
|
* v2.6 Phase 3 (3.4) — orphan worktree reaper.
|
||||||
|
*
|
||||||
|
* Reclaims on-disk session worktree dirs under WORKTREE_BASE that have NO live
|
||||||
|
* (`status='active'`) row in the `worktrees` table — leaks from a crash between
|
||||||
|
* `git worktree add` and the DB insert, a missed chat-close hook, or a manual rm
|
||||||
|
* of the DB row. Extends the periodic-sweeper pattern (apps/server's truncation +
|
||||||
|
* stale-streaming reaper).
|
||||||
|
*
|
||||||
|
* SAFETY (Paseo worktree-archive cascade + superset destroy-saga lift): before
|
||||||
|
* removing ANY dir, run `checkWorktreeWorkAtRisk` — a dirty / unpushed / unmerged
|
||||||
|
* worktree is SKIPPED (logged), never force-removed. The pure orphan-target
|
||||||
|
* selection (which dirs are candidates) lives in
|
||||||
|
* `backends/lifecycle-decisions.ts:selectOrphanWorktreeTargets` and is unit-tested;
|
||||||
|
* this module does the DB read + fs stat + git preflight + removal side-effects.
|
||||||
|
*
|
||||||
|
* The mtime grace (default 1h) means a dir mid-`ensureSessionWorktree` (created on
|
||||||
|
* disk, row not yet committed) is never swept — the grace window covers the gap.
|
||||||
|
*/
|
||||||
|
import { readdir, stat } from 'node:fs/promises';
|
||||||
|
import { join } from 'node:path';
|
||||||
|
import type { FastifyBaseLogger } from 'fastify';
|
||||||
|
import type { Sql } from '../db.js';
|
||||||
|
import { WORKTREE_BASE, checkWorktreeWorkAtRisk } from './worktrees.js';
|
||||||
|
import { hostExec } from './host-exec.js';
|
||||||
|
import {
|
||||||
|
selectOrphanWorktreeTargets,
|
||||||
|
DEFAULT_ORPHAN_WORKTREE_GRACE_MS,
|
||||||
|
} from './backends/lifecycle-decisions.js';
|
||||||
|
|
||||||
|
export interface OrphanWorktreeReaperDeps {
|
||||||
|
sql: Sql;
|
||||||
|
log: FastifyBaseLogger;
|
||||||
|
intervalMs: number;
|
||||||
|
graceMs?: number;
|
||||||
|
}
|
||||||
|
|
||||||
|
export interface OrphanReaperResult {
|
||||||
|
scanned: number;
|
||||||
|
candidates: number;
|
||||||
|
reaped: string[];
|
||||||
|
skippedAtRisk: string[];
|
||||||
|
}
|
||||||
|
|
||||||
|
/** Single-pass reap: select orphan candidates, preflight at-risk, remove the safe. */
|
||||||
|
export async function reapOrphanWorktrees(
|
||||||
|
sql: Sql,
|
||||||
|
log: FastifyBaseLogger,
|
||||||
|
graceMs: number = DEFAULT_ORPHAN_WORKTREE_GRACE_MS,
|
||||||
|
now: number = Date.now(),
|
||||||
|
): Promise<OrphanReaperResult> {
|
||||||
|
// Enumerate on-disk session worktree dirs (`sess-*`). Per-task worktrees
|
||||||
|
// (arena/new_task/MCP) are cleaned up inline by the one-shot path, so we only
|
||||||
|
// own the persistent session dirs the warm paths leave behind.
|
||||||
|
let dirents: string[];
|
||||||
|
try {
|
||||||
|
dirents = await readdir(WORKTREE_BASE);
|
||||||
|
} catch {
|
||||||
|
return { scanned: 0, candidates: 0, reaped: [], skippedAtRisk: [] }; // base absent → nothing to do
|
||||||
|
}
|
||||||
|
const onDisk: { path: string; mtimeMs: number }[] = [];
|
||||||
|
for (const name of dirents) {
|
||||||
|
if (!name.startsWith('sess-')) continue; // only persistent session worktrees
|
||||||
|
const path = join(WORKTREE_BASE, name);
|
||||||
|
try {
|
||||||
|
const s = await stat(path);
|
||||||
|
if (!s.isDirectory()) continue;
|
||||||
|
onDisk.push({ path, mtimeMs: s.mtimeMs });
|
||||||
|
} catch {
|
||||||
|
// vanished between readdir and stat — skip
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
// Live worktree paths from the DB (active rows only — archived/removed rows are
|
||||||
|
// not "live", so their leftover dirs are reapable orphans).
|
||||||
|
const liveRows = await sql<{ path: string }[]>`
|
||||||
|
SELECT path FROM worktrees WHERE status = 'active'
|
||||||
|
`;
|
||||||
|
const live = new Set(liveRows.map((r) => r.path));
|
||||||
|
|
||||||
|
const candidates = selectOrphanWorktreeTargets(onDisk, live, now, graceMs);
|
||||||
|
const reaped: string[] = [];
|
||||||
|
const skippedAtRisk: string[] = [];
|
||||||
|
|
||||||
|
for (const path of candidates) {
|
||||||
|
// Preflight: never reap work at risk. A git error forces atRisk=true (fail
|
||||||
|
// closed), so a half-broken worktree is kept, not silently destroyed.
|
||||||
|
const risk = await checkWorktreeWorkAtRisk(path);
|
||||||
|
if (risk.atRisk) {
|
||||||
|
skippedAtRisk.push(path);
|
||||||
|
log.warn({ path, dirty: risk.dirty, unmerged: risk.unmerged, error: risk.error }, 'orphan-reaper: skipping at-risk orphan worktree');
|
||||||
|
continue;
|
||||||
|
}
|
||||||
|
const removed = await removeOrphanDir(path);
|
||||||
|
if (removed) reaped.push(path);
|
||||||
|
}
|
||||||
|
|
||||||
|
if (reaped.length > 0 || skippedAtRisk.length > 0) {
|
||||||
|
log.info({ scanned: onDisk.length, candidates: candidates.length, reaped, skippedAtRisk }, 'orphan-reaper: pass complete');
|
||||||
|
}
|
||||||
|
return { scanned: onDisk.length, candidates: candidates.length, reaped, skippedAtRisk };
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Remove a single orphan worktree dir. Resolve its main repo via the git
|
||||||
|
* common-dir, run `worktree remove --force` from there + prune, then rm the dir as
|
||||||
|
* a backstop. Best-effort: every step is independently fault-tolerant so a partial
|
||||||
|
* state (dir present, git untracked) still gets reclaimed.
|
||||||
|
*/
|
||||||
|
async function removeOrphanDir(path: string): Promise<boolean> {
|
||||||
|
// Find the owning repo (the common git dir's parent). When the dir isn't a valid
|
||||||
|
// worktree anymore, this fails and we fall back to a plain rm.
|
||||||
|
const common = await hostExec(
|
||||||
|
`git -C ${shellEscape(path)} rev-parse --path-format=absolute --git-common-dir`,
|
||||||
|
{ timeoutMs: 10_000 },
|
||||||
|
).catch(() => null);
|
||||||
|
const commonDir = common && common.exitCode === 0 ? common.stdout.trim() : '';
|
||||||
|
// The repo worktree root is the parent of the .git common dir (strip trailing /.git).
|
||||||
|
const repoRoot = commonDir.replace(/\/\.git\/?$/, '').replace(/\/\.git$/, '');
|
||||||
|
|
||||||
|
if (repoRoot && repoRoot !== commonDir) {
|
||||||
|
await hostExec(
|
||||||
|
`git -C ${shellEscape(repoRoot)} worktree remove ${shellEscape(path)} --force`,
|
||||||
|
{ timeoutMs: 15_000 },
|
||||||
|
).catch(() => {});
|
||||||
|
await hostExec(
|
||||||
|
`git -C ${shellEscape(repoRoot)} worktree prune`,
|
||||||
|
{ timeoutMs: 10_000 },
|
||||||
|
).catch(() => {});
|
||||||
|
}
|
||||||
|
// Backstop: ensure the dir is gone even if the git remove no-op'd.
|
||||||
|
const rm = await hostExec(`rm -rf ${shellEscape(path)}`, { timeoutMs: 15_000 }).catch(() => null);
|
||||||
|
return rm != null && rm.exitCode === 0;
|
||||||
|
}
|
||||||
|
|
||||||
|
/** Minimal single-quote shell escape (mirrors worktrees.ts). */
|
||||||
|
function shellEscape(s: string): string {
|
||||||
|
return "'" + s.replace(/'/g, "'\\''") + "'";
|
||||||
|
}
|
||||||
|
|
||||||
|
/** Periodic orphan-worktree reaper, started/stopped by the bootstrap. Unref'd. */
|
||||||
|
export function createOrphanWorktreeReaper(deps: OrphanWorktreeReaperDeps): { start(): void; stop(): void } {
|
||||||
|
const { sql, log, intervalMs } = deps;
|
||||||
|
const graceMs = deps.graceMs ?? DEFAULT_ORPHAN_WORKTREE_GRACE_MS;
|
||||||
|
let timer: ReturnType<typeof setInterval> | null = null;
|
||||||
|
let running = false;
|
||||||
|
|
||||||
|
return {
|
||||||
|
start() {
|
||||||
|
if (timer) return;
|
||||||
|
timer = setInterval(() => {
|
||||||
|
if (running) return; // a slow pass must not overlap the next tick
|
||||||
|
running = true;
|
||||||
|
void reapOrphanWorktrees(sql, log, graceMs)
|
||||||
|
.catch((err) => log.warn({ err: err instanceof Error ? err.message : String(err) }, 'orphan-reaper: pass error'))
|
||||||
|
.finally(() => {
|
||||||
|
running = false;
|
||||||
|
});
|
||||||
|
}, intervalMs);
|
||||||
|
timer.unref?.();
|
||||||
|
log.info({ intervalMs, graceMs }, 'orphan-reaper: started');
|
||||||
|
},
|
||||||
|
stop() {
|
||||||
|
if (timer) {
|
||||||
|
clearInterval(timer);
|
||||||
|
timer = null;
|
||||||
|
}
|
||||||
|
},
|
||||||
|
};
|
||||||
|
}
|
||||||
@@ -9,7 +9,7 @@
|
|||||||
import type { Sql } from '../db.js';
|
import type { Sql } from '../db.js';
|
||||||
import { hostExec } from './host-exec.js';
|
import { hostExec } from './host-exec.js';
|
||||||
|
|
||||||
const WORKTREE_BASE = '/tmp/booworktrees';
|
export const WORKTREE_BASE = '/tmp/booworktrees';
|
||||||
|
|
||||||
/**
|
/**
|
||||||
* Create a git worktree for a task on the host.
|
* Create a git worktree for a task on the host.
|
||||||
@@ -197,6 +197,187 @@ export async function ensureSessionWorktree(
|
|||||||
};
|
};
|
||||||
}
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* v2.6 Phase 3 (3.3 / 3.4): physically remove a session's persistent worktree —
|
||||||
|
* the git worktree dir + its branch — and archive its `worktrees` row. Used by the
|
||||||
|
* chat/session-close hook (when the last chat in a session closes) and the orphan
|
||||||
|
* reaper. Best-effort on the git side (a dir already gone is not an error); the DB
|
||||||
|
* row is flipped to 'archived' (soft-delete, Paseo's worktree-archive pattern) so
|
||||||
|
* history/attribution survives and a re-run is idempotent.
|
||||||
|
*
|
||||||
|
* SAFETY: callers MUST run `checkWorktreeWorkAtRisk` first and skip at-risk
|
||||||
|
* worktrees — this function force-removes (`--force`), so it never silently drops
|
||||||
|
* uncommitted/unmerged work unless the caller already cleared/accepted the risk.
|
||||||
|
*/
|
||||||
|
export async function removeSessionWorktree(
|
||||||
|
sql: Sql,
|
||||||
|
projectPath: string,
|
||||||
|
worktree: { id: string; path: string; branch?: string | null },
|
||||||
|
opts?: { signal?: AbortSignal },
|
||||||
|
): Promise<void> {
|
||||||
|
await hostExec(
|
||||||
|
`git -C ${shellEscape(projectPath)} worktree remove ${shellEscape(worktree.path)} --force`,
|
||||||
|
{ signal: opts?.signal, timeoutMs: 15_000 },
|
||||||
|
).catch(() => {});
|
||||||
|
const branch = worktree.branch ?? null;
|
||||||
|
if (branch) {
|
||||||
|
await hostExec(
|
||||||
|
`git -C ${shellEscape(projectPath)} branch -D ${shellEscape(branch)}`,
|
||||||
|
{ signal: opts?.signal, timeoutMs: 10_000 },
|
||||||
|
).catch(() => {});
|
||||||
|
}
|
||||||
|
// Prune any stale worktree administrative entries left behind by a partial remove.
|
||||||
|
await hostExec(
|
||||||
|
`git -C ${shellEscape(projectPath)} worktree prune`,
|
||||||
|
{ signal: opts?.signal, timeoutMs: 10_000 },
|
||||||
|
).catch(() => {});
|
||||||
|
await sql`UPDATE worktrees SET status = 'archived' WHERE id = ${worktree.id}`.catch(() => {});
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* v2.6 Phase 3 (3.3): the chat-close cleanup. Mark every `agent_sessions` row for
|
||||||
|
* the chat 'closed', then — only if this was the session's LAST open chat — remove
|
||||||
|
* the shared session worktree (a worktree is one-per-session, shared across the
|
||||||
|
* session's chat tabs, so closing one tab must not pull the rug from sibling tabs).
|
||||||
|
*
|
||||||
|
* Returns what it did so the route can report it. The actual backend (process /
|
||||||
|
* server-session) teardown is the pool's job (`agentPool.closeChat` +
|
||||||
|
* `backend.closeSession`); this owns the DB + git truth.
|
||||||
|
*
|
||||||
|
* `worktreeRemoved` is false when other open chats remain (worktree kept) OR when
|
||||||
|
* the worktree held work at risk (preflight blocked it — never silently dropped).
|
||||||
|
*/
|
||||||
|
export interface ChatCloseResult {
|
||||||
|
agentRowsClosed: number;
|
||||||
|
worktreeRemoved: boolean;
|
||||||
|
worktreeAtRisk: boolean;
|
||||||
|
}
|
||||||
|
|
||||||
|
export async function closeChatBackendState(
|
||||||
|
sql: Sql,
|
||||||
|
chatId: string,
|
||||||
|
opts?: { signal?: AbortSignal; force?: boolean },
|
||||||
|
): Promise<ChatCloseResult> {
|
||||||
|
// Resolve the chat's session (and that session's project path) before we touch
|
||||||
|
// anything — a deleted chat row leaves agent_sessions/worktrees pointing nowhere.
|
||||||
|
const [chatRow] = await sql<{ session_id: string | null }[]>`
|
||||||
|
SELECT session_id FROM chats WHERE id = ${chatId}
|
||||||
|
`;
|
||||||
|
// chat row may already be gone (delete fired first); fall back to agent_sessions'
|
||||||
|
// session_id link, which SET NULLs only on session delete, not chat delete.
|
||||||
|
let sessionId = chatRow?.session_id ?? null;
|
||||||
|
if (!sessionId) {
|
||||||
|
const [as] = await sql<{ session_id: string | null }[]>`
|
||||||
|
SELECT session_id FROM agent_sessions WHERE chat_id = ${chatId} AND session_id IS NOT NULL LIMIT 1
|
||||||
|
`;
|
||||||
|
sessionId = as?.session_id ?? null;
|
||||||
|
}
|
||||||
|
|
||||||
|
// Mark this chat's (chat,agent) backend rows closed (idempotent).
|
||||||
|
const closedRows = await sql<{ agent: string }[]>`
|
||||||
|
UPDATE agent_sessions SET status = 'closed'
|
||||||
|
WHERE chat_id = ${chatId} AND status <> 'closed'
|
||||||
|
RETURNING agent
|
||||||
|
`;
|
||||||
|
|
||||||
|
let worktreeRemoved = false;
|
||||||
|
let worktreeAtRisk = false;
|
||||||
|
|
||||||
|
if (sessionId) {
|
||||||
|
// Other open chats still sharing the session worktree? If so, keep it.
|
||||||
|
const openRows = await sql<{ open_count: number }[]>`
|
||||||
|
SELECT COUNT(*)::int AS open_count FROM chats
|
||||||
|
WHERE session_id = ${sessionId} AND status = 'open' AND id <> ${chatId}
|
||||||
|
`;
|
||||||
|
const openCount = openRows[0]?.open_count ?? 0;
|
||||||
|
if (openCount === 0) {
|
||||||
|
const [wt] = await sql<{ id: string; path: string; branch: string | null }[]>`
|
||||||
|
SELECT id, path, branch FROM worktrees
|
||||||
|
WHERE session_id = ${sessionId} AND status = 'active' LIMIT 1
|
||||||
|
`;
|
||||||
|
if (wt) {
|
||||||
|
const projRows = await sql<{ path: string | null }[]>`
|
||||||
|
SELECT p.path FROM sessions s JOIN projects p ON p.id = s.project_id WHERE s.id = ${sessionId}
|
||||||
|
`;
|
||||||
|
const projectPath = projRows[0]?.path ?? null;
|
||||||
|
// Preflight (close-hook semantics): a DELIBERATE chat/session close — the
|
||||||
|
// server's session-delete already ran the full work-at-risk gate
|
||||||
|
// (dirty/unpushed/unmerged) before calling us, and chat-close discards the
|
||||||
|
// tab's staged review intentionally. So here we only block on UNCOMMITTED
|
||||||
|
// working-tree changes (`dirty`) — work the user never even staged into the
|
||||||
|
// review diff. The session branch's own commits (the diff-staging
|
||||||
|
// mechanism) are NOT a block; treating them as "unmerged risk" would make
|
||||||
|
// the worktree un-removable on every real session (the orphan reaper keeps
|
||||||
|
// the full at-risk gate because it runs unattended). `force` skips this.
|
||||||
|
if (!opts?.force) {
|
||||||
|
const risk = await checkWorktreeWorkAtRisk(wt.path, opts);
|
||||||
|
worktreeAtRisk = risk.dirty || risk.error != null;
|
||||||
|
}
|
||||||
|
if (projectPath && (opts?.force || !worktreeAtRisk)) {
|
||||||
|
await removeSessionWorktree(sql, projectPath, wt, opts);
|
||||||
|
worktreeRemoved = true;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
return { agentRowsClosed: closedRows.length, worktreeRemoved, worktreeAtRisk };
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* v2.6 Phase 3 (3.5): re-baseline a session's worktree diff after a successful
|
||||||
|
* `apply_pending`. The applied changes were written to the PROJECT ROOT; the
|
||||||
|
* worktree branch still holds the same delta against the ORIGINAL `base_commit`,
|
||||||
|
* so the next turn's `diffWorktree(base_commit...worktree-HEAD)` would re-surface
|
||||||
|
* the already-applied changes as "pending" — a confusing double-count.
|
||||||
|
*
|
||||||
|
* Fix: advance the stored `base_commit` to the worktree's CURRENT HEAD (the
|
||||||
|
* `diffWorktree` path commits the worktree's accumulated changes before diffing,
|
||||||
|
* so HEAD already encodes the applied state). The next turn then diffs against
|
||||||
|
* that, surfacing only edits made AFTER the apply. Idempotent: if the worktree has
|
||||||
|
* no new commits, the base is unchanged.
|
||||||
|
*
|
||||||
|
* Diff-baseline-correctness note (design §7): we re-baseline to the worktree's own
|
||||||
|
* HEAD, NOT to a moving project HEAD — so an out-of-band edit to the project root
|
||||||
|
* after apply doesn't corrupt the baseline. The trade-off is that a manual project
|
||||||
|
* edit isn't reflected as "already there"; acceptable, and matches the stored-base
|
||||||
|
* (not moving-target) decision in §7.
|
||||||
|
*/
|
||||||
|
export async function rebaselineWorktreeAfterApply(
|
||||||
|
sql: Sql,
|
||||||
|
sessionId: string,
|
||||||
|
opts?: { signal?: AbortSignal },
|
||||||
|
): Promise<{ rebaselined: boolean; newBaseCommit: string | null }> {
|
||||||
|
const [wt] = await sql<{ id: string; path: string; base_commit: string | null }[]>`
|
||||||
|
SELECT id, path, base_commit FROM worktrees
|
||||||
|
WHERE session_id = ${sessionId} AND status = 'active' LIMIT 1
|
||||||
|
`;
|
||||||
|
if (!wt) return { rebaselined: false, newBaseCommit: null };
|
||||||
|
|
||||||
|
// Make sure the worktree's accumulated edits are committed so HEAD encodes the
|
||||||
|
// just-applied state (the diff path normally does this, but apply may run with no
|
||||||
|
// prior diff this turn). Commit ONLY when something is staged — NO --allow-empty,
|
||||||
|
// so a re-baseline with no new edits doesn't advance HEAD and stays idempotent.
|
||||||
|
await hostExec(
|
||||||
|
`cd ${shellEscape(wt.path)} && git add -A && ` +
|
||||||
|
`git diff --cached --quiet || ` +
|
||||||
|
`git -c user.email=boocoder@local -c user.name=BooCoder commit -q -m "rebaseline after apply"`,
|
||||||
|
{ signal: opts?.signal, timeoutMs: 15_000 },
|
||||||
|
).catch(() => {});
|
||||||
|
|
||||||
|
const headRes = await hostExec(
|
||||||
|
`git -C ${shellEscape(wt.path)} rev-parse HEAD`,
|
||||||
|
{ signal: opts?.signal, timeoutMs: 10_000 },
|
||||||
|
).catch(() => null);
|
||||||
|
const newBase = headRes && headRes.exitCode === 0 ? headRes.stdout.trim() || null : null;
|
||||||
|
if (!newBase || newBase === wt.base_commit) {
|
||||||
|
return { rebaselined: false, newBaseCommit: wt.base_commit };
|
||||||
|
}
|
||||||
|
|
||||||
|
await sql`UPDATE worktrees SET base_commit = ${newBase} WHERE id = ${wt.id}`;
|
||||||
|
return { rebaselined: true, newBaseCommit: newBase };
|
||||||
|
}
|
||||||
|
|
||||||
// ─── Session-delete work-loss guard ─────────────────────────────────────────
|
// ─── Session-delete work-loss guard ─────────────────────────────────────────
|
||||||
|
|
||||||
/**
|
/**
|
||||||
|
|||||||
@@ -4,6 +4,7 @@ import type { Sql } from '../db.js';
|
|||||||
import type { Broker } from '../services/broker.js';
|
import type { Broker } from '../services/broker.js';
|
||||||
import type { Chat, Message } from '../types/api.js';
|
import type { Chat, Message } from '../types/api.js';
|
||||||
import { getModelContext } from '../services/model-context.js';
|
import { getModelContext } from '../services/model-context.js';
|
||||||
|
import { notifyCoderClose } from '../services/coder-notify.js';
|
||||||
|
|
||||||
const CreateBody = z.object({
|
const CreateBody = z.object({
|
||||||
name: z.string().min(1).max(200).optional(),
|
name: z.string().min(1).max(200).optional(),
|
||||||
@@ -167,6 +168,9 @@ export function registerChatRoutes(
|
|||||||
chat_id: id,
|
chat_id: id,
|
||||||
session_id: req.params.id,
|
session_id: req.params.id,
|
||||||
});
|
});
|
||||||
|
// Fire-and-forget per archived chat: tear down its warm agent backends
|
||||||
|
// on the coder. Best-effort — never blocks/fails the bulk archive.
|
||||||
|
void notifyCoderClose('chat', id, req.log);
|
||||||
}
|
}
|
||||||
return { archived: ids.length, ids };
|
return { archived: ids.length, ids };
|
||||||
}
|
}
|
||||||
@@ -208,6 +212,9 @@ export function registerChatRoutes(
|
|||||||
chat_id: row.id,
|
chat_id: row.id,
|
||||||
session_id: row.session_id,
|
session_id: row.session_id,
|
||||||
});
|
});
|
||||||
|
// Fire-and-forget: tear down this chat's warm agent backends + (last-chat)
|
||||||
|
// worktree on the coder. Best-effort — never blocks/fails the archive.
|
||||||
|
void notifyCoderClose('chat', row.id, req.log);
|
||||||
reply.code(204);
|
reply.code(204);
|
||||||
return null;
|
return null;
|
||||||
}
|
}
|
||||||
@@ -248,6 +255,9 @@ export function registerChatRoutes(
|
|||||||
chat_id: row.id,
|
chat_id: row.id,
|
||||||
session_id: row.session_id,
|
session_id: row.session_id,
|
||||||
});
|
});
|
||||||
|
// Fire-and-forget: tear down this chat's warm agent backends + (last-chat)
|
||||||
|
// worktree on the coder. Best-effort — never blocks/fails the delete.
|
||||||
|
void notifyCoderClose('chat', row.id, req.log);
|
||||||
reply.code(204);
|
reply.code(204);
|
||||||
return null;
|
return null;
|
||||||
}
|
}
|
||||||
|
|||||||
@@ -5,6 +5,7 @@ import type { Config } from '../config.js';
|
|||||||
import type { Broker } from '../services/broker.js';
|
import type { Broker } from '../services/broker.js';
|
||||||
import type { Session, WorktreeRiskReport } from '../types/api.js';
|
import type { Session, WorktreeRiskReport } from '../types/api.js';
|
||||||
import { getSetting } from './settings.js';
|
import { getSetting } from './settings.js';
|
||||||
|
import { notifyCoderClose } from '../services/coder-notify.js';
|
||||||
|
|
||||||
const CreateBody = z.object({
|
const CreateBody = z.object({
|
||||||
name: z.string().min(1).max(200).optional(),
|
name: z.string().min(1).max(200).optional(),
|
||||||
@@ -513,6 +514,10 @@ export function registerSessionRoutes(
|
|||||||
}
|
}
|
||||||
const project_id = deleted[0]!.project_id;
|
const project_id = deleted[0]!.project_id;
|
||||||
broker.publishUserFrame('default', { type: 'session_deleted', session_id: id, project_id });
|
broker.publishUserFrame('default', { type: 'session_deleted', session_id: id, project_id });
|
||||||
|
// Fire-and-forget: ask BooCoder to tear down this session's warm agent
|
||||||
|
// backends + worktree immediately. Best-effort — never blocks/fails the
|
||||||
|
// delete; the coder's idle-evict + orphan reaper backstop a missed call.
|
||||||
|
void notifyCoderClose('session', id, req.log);
|
||||||
reply.code(204);
|
reply.code(204);
|
||||||
return null;
|
return null;
|
||||||
}
|
}
|
||||||
|
|||||||
67
apps/server/src/services/__tests__/coder-notify.test.ts
Normal file
67
apps/server/src/services/__tests__/coder-notify.test.ts
Normal file
@@ -0,0 +1,67 @@
|
|||||||
|
// v2.6.10 Phase 3 (server wiring) — notifyCoderClose fire-and-forget helper.
|
||||||
|
//
|
||||||
|
// The guarantee under test: the helper NEVER throws (so it can't break the
|
||||||
|
// user's delete/archive path), targets the correct coder URL shape, and folds
|
||||||
|
// every failure mode (non-2xx, network error) into a `false` result.
|
||||||
|
|
||||||
|
import { describe, it, expect, vi, beforeEach, afterEach } from 'vitest';
|
||||||
|
import { notifyCoderClose } from '../coder-notify.js';
|
||||||
|
|
||||||
|
const ORIGINAL_BOOCODER_URL = process.env.BOOCODER_URL;
|
||||||
|
|
||||||
|
describe('notifyCoderClose', () => {
|
||||||
|
beforeEach(() => {
|
||||||
|
delete process.env.BOOCODER_URL;
|
||||||
|
});
|
||||||
|
afterEach(() => {
|
||||||
|
if (ORIGINAL_BOOCODER_URL === undefined) delete process.env.BOOCODER_URL;
|
||||||
|
else process.env.BOOCODER_URL = ORIGINAL_BOOCODER_URL;
|
||||||
|
});
|
||||||
|
|
||||||
|
it('POSTs the chat close hook at the default coder origin and resolves true on 2xx', async () => {
|
||||||
|
const fetcher = vi.fn().mockResolvedValue(new Response(null, { status: 200 }));
|
||||||
|
const ok = await notifyCoderClose('chat', 'chat-123', undefined, fetcher as unknown as typeof fetch);
|
||||||
|
expect(ok).toBe(true);
|
||||||
|
expect(fetcher).toHaveBeenCalledTimes(1);
|
||||||
|
const [url, init] = fetcher.mock.calls[0]!;
|
||||||
|
expect(url).toBe('http://boocoder:3000/api/chats/chat-123/close');
|
||||||
|
expect(init).toEqual({ method: 'POST' });
|
||||||
|
});
|
||||||
|
|
||||||
|
it('POSTs the session close hook with the sessions segment', async () => {
|
||||||
|
const fetcher = vi.fn().mockResolvedValue(new Response(null, { status: 200 }));
|
||||||
|
const ok = await notifyCoderClose('session', 'sess-abc', undefined, fetcher as unknown as typeof fetch);
|
||||||
|
expect(ok).toBe(true);
|
||||||
|
expect(fetcher.mock.calls[0]![0]).toBe('http://boocoder:3000/api/sessions/sess-abc/close');
|
||||||
|
});
|
||||||
|
|
||||||
|
it('honors BOOCODER_URL for the origin', async () => {
|
||||||
|
process.env.BOOCODER_URL = 'http://100.114.205.53:9502';
|
||||||
|
const fetcher = vi.fn().mockResolvedValue(new Response(null, { status: 200 }));
|
||||||
|
await notifyCoderClose('chat', 'c1', undefined, fetcher as unknown as typeof fetch);
|
||||||
|
expect(fetcher.mock.calls[0]![0]).toBe('http://100.114.205.53:9502/api/chats/c1/close');
|
||||||
|
});
|
||||||
|
|
||||||
|
it('resolves false on a non-2xx response (does not throw)', async () => {
|
||||||
|
const fetcher = vi.fn().mockResolvedValue(new Response(null, { status: 500 }));
|
||||||
|
const log = { debug: vi.fn() };
|
||||||
|
const ok = await notifyCoderClose('chat', 'c1', log, fetcher as unknown as typeof fetch);
|
||||||
|
expect(ok).toBe(false);
|
||||||
|
expect(log.debug).toHaveBeenCalledTimes(1);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('resolves false on a network error (coder unreachable) — never rejects', async () => {
|
||||||
|
const fetcher = vi.fn().mockRejectedValue(new Error('ECONNREFUSED'));
|
||||||
|
const log = { debug: vi.fn() };
|
||||||
|
const ok = await notifyCoderClose('session', 's1', log, fetcher as unknown as typeof fetch);
|
||||||
|
expect(ok).toBe(false);
|
||||||
|
expect(log.debug).toHaveBeenCalledTimes(1);
|
||||||
|
});
|
||||||
|
|
||||||
|
it('does not require a logger', async () => {
|
||||||
|
const fetcher = vi.fn().mockRejectedValue(new Error('boom'));
|
||||||
|
await expect(
|
||||||
|
notifyCoderClose('chat', 'c1', undefined, fetcher as unknown as typeof fetch),
|
||||||
|
).resolves.toBe(false);
|
||||||
|
});
|
||||||
|
});
|
||||||
64
apps/server/src/services/coder-notify.ts
Normal file
64
apps/server/src/services/coder-notify.ts
Normal file
@@ -0,0 +1,64 @@
|
|||||||
|
// v2.6.10 Phase 3 (server wiring) — fire-and-forget BooCoder close hooks.
|
||||||
|
//
|
||||||
|
// BooCoder (apps/coder, host systemd) added close hooks in
|
||||||
|
// apps/coder/src/routes/lifecycle.ts:
|
||||||
|
// POST /api/chats/:chatId/close — evict the chat's warm (chat,agent)
|
||||||
|
// backends, close its opencode session,
|
||||||
|
// mark agent_sessions closed, and remove
|
||||||
|
// the shared worktree on the last chat.
|
||||||
|
// POST /api/sessions/:sessionId/close — loop the chat-close path for every
|
||||||
|
// chat in the session.
|
||||||
|
//
|
||||||
|
// apps/server (Docker) can't see the host worktree dirs or reach the warm agent
|
||||||
|
// processes, so — exactly like the existing `worktree-risk` guard in
|
||||||
|
// routes/sessions.ts — it signals the coder over HTTP and the coder does the
|
||||||
|
// real teardown. This call is BEST-EFFORT: the coder's idle-pool eviction and
|
||||||
|
// the orphan-worktree reaper backstop a missed/failed call. It MUST NEVER block
|
||||||
|
// or fail the user's delete/archive — hence fire-and-forget with a swallowed
|
||||||
|
// catch. We do not await the returned promise at the call sites.
|
||||||
|
|
||||||
|
import type { FastifyBaseLogger } from 'fastify';
|
||||||
|
|
||||||
|
export type CoderCloseKind = 'chat' | 'session';
|
||||||
|
|
||||||
|
function coderOrigin(): string {
|
||||||
|
// Same env + default as routes/sessions.ts' worktree-risk fetch.
|
||||||
|
return process.env.BOOCODER_URL ?? 'http://boocoder:3000';
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Fire-and-forget POST to the BooCoder close hook for a chat or session.
|
||||||
|
*
|
||||||
|
* Resolves to `true` if the coder acknowledged (HTTP 2xx), `false` otherwise
|
||||||
|
* (non-2xx or network error). Callers SHOULD NOT await this — invoke it and
|
||||||
|
* move on. The returned promise never rejects: every failure path is caught,
|
||||||
|
* logged at debug, and folded into a `false` result so an unreachable or
|
||||||
|
* erroring coder can't surface to the user's delete/archive request.
|
||||||
|
*/
|
||||||
|
export async function notifyCoderClose(
|
||||||
|
kind: CoderCloseKind,
|
||||||
|
id: string,
|
||||||
|
log?: Pick<FastifyBaseLogger, 'debug'>,
|
||||||
|
fetcher: typeof fetch = fetch,
|
||||||
|
): Promise<boolean> {
|
||||||
|
const segment = kind === 'chat' ? 'chats' : 'sessions';
|
||||||
|
const url = `${coderOrigin()}/api/${segment}/${id}/close`;
|
||||||
|
try {
|
||||||
|
const res = await fetcher(url, { method: 'POST' });
|
||||||
|
if (!res.ok) {
|
||||||
|
log?.debug(
|
||||||
|
{ kind, id, status: res.status },
|
||||||
|
'coder close hook returned non-2xx (best-effort; reaper backstops)',
|
||||||
|
);
|
||||||
|
return false;
|
||||||
|
}
|
||||||
|
log?.debug({ kind, id }, 'coder close hook acknowledged');
|
||||||
|
return true;
|
||||||
|
} catch (err) {
|
||||||
|
log?.debug(
|
||||||
|
{ kind, id, err: err instanceof Error ? err.message : String(err) },
|
||||||
|
'coder close hook unreachable (best-effort; reaper backstops)',
|
||||||
|
);
|
||||||
|
return false;
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -388,12 +388,14 @@ function usePendingChanges(sessionId: string) {
|
|||||||
function DiffPanel({
|
function DiffPanel({
|
||||||
changes,
|
changes,
|
||||||
loading,
|
loading,
|
||||||
|
currentProvider,
|
||||||
onRefresh,
|
onRefresh,
|
||||||
onApprove,
|
onApprove,
|
||||||
onReject,
|
onReject,
|
||||||
}: {
|
}: {
|
||||||
changes: PendingChange[];
|
changes: PendingChange[];
|
||||||
loading: boolean;
|
loading: boolean;
|
||||||
|
currentProvider: string;
|
||||||
onRefresh: () => void;
|
onRefresh: () => void;
|
||||||
onApprove: (id: string) => void;
|
onApprove: (id: string) => void;
|
||||||
onReject: (id: string) => void;
|
onReject: (id: string) => void;
|
||||||
@@ -409,6 +411,29 @@ function DiffPanel({
|
|||||||
? `Changes from ${distinctAgents.map((a) => providerLabel(a)).join(', ')}`
|
? `Changes from ${distinctAgents.map((a) => providerLabel(a)).join(', ')}`
|
||||||
: null;
|
: null;
|
||||||
|
|
||||||
|
// v2.6 §9c: staging-boundary caveat. External agents (opencode/goose/qwen/
|
||||||
|
// claude) edit *inside their worktree*; native boocode reads/writes the
|
||||||
|
// *project root* via pending_changes. Unapplied edits don't cross that
|
||||||
|
// boundary. When the currently-selected provider can't see another side's
|
||||||
|
// staged-but-unapplied edits, surface a muted one-liner. agent===null
|
||||||
|
// (manual) is boundary-neutral. Pure derivation — no new state/fetch.
|
||||||
|
const isNativeProvider = currentProvider === 'boocode';
|
||||||
|
const boundaryHint = (() => {
|
||||||
|
if (isNativeProvider) {
|
||||||
|
// Native boocode is selected: it won't see external-worktree edits.
|
||||||
|
const external = distinctAgents.filter((a) => a !== null && a !== 'boocode');
|
||||||
|
if (external.length === 0) return null;
|
||||||
|
const who =
|
||||||
|
external.length === 1
|
||||||
|
? providerLabel(external[0]!)
|
||||||
|
: external.map((a) => providerLabel(a)).join(', ');
|
||||||
|
return `${who}'s edits live in its worktree — BooCode won't see them until applied.`;
|
||||||
|
}
|
||||||
|
// An external agent is selected: it won't see boocode's project-root edits.
|
||||||
|
if (!distinctAgents.includes('boocode')) return null;
|
||||||
|
return `BooCode's edits live in the project root — ${providerLabel(currentProvider)} won't see them until applied.`;
|
||||||
|
})();
|
||||||
|
|
||||||
return (
|
return (
|
||||||
<div className="flex flex-col h-full border-t border-border">
|
<div className="flex flex-col h-full border-t border-border">
|
||||||
<div className="flex items-center justify-between px-3 py-1.5 border-b border-border bg-muted/30">
|
<div className="flex items-center justify-between px-3 py-1.5 border-b border-border bg-muted/30">
|
||||||
@@ -430,6 +455,14 @@ function DiffPanel({
|
|||||||
{mixedNote}
|
{mixedNote}
|
||||||
</div>
|
</div>
|
||||||
)}
|
)}
|
||||||
|
{boundaryHint && (
|
||||||
|
<div
|
||||||
|
className="px-3 py-1 border-b border-border bg-muted/10 text-xs text-muted-foreground"
|
||||||
|
title={boundaryHint}
|
||||||
|
>
|
||||||
|
{boundaryHint}
|
||||||
|
</div>
|
||||||
|
)}
|
||||||
<div className="flex-1 overflow-y-auto">
|
<div className="flex-1 overflow-y-auto">
|
||||||
{pending.length === 0 ? (
|
{pending.length === 0 ? (
|
||||||
<div className="flex items-center justify-center h-full text-sm text-muted-foreground">
|
<div className="flex items-center justify-center h-full text-sm text-muted-foreground">
|
||||||
@@ -914,6 +947,7 @@ export function CoderPane({
|
|||||||
<DiffPanel
|
<DiffPanel
|
||||||
changes={changes}
|
changes={changes}
|
||||||
loading={loading}
|
loading={loading}
|
||||||
|
currentProvider={agentConfig.provider}
|
||||||
onRefresh={refresh}
|
onRefresh={refresh}
|
||||||
onApprove={approve}
|
onApprove={approve}
|
||||||
onReject={reject}
|
onReject={reject}
|
||||||
|
|||||||
@@ -348,7 +348,7 @@ Per-session Docker sandbox spawned by BooCoder on first write. Only project path
|
|||||||
|
|
||||||
-----
|
-----
|
||||||
|
|
||||||
## Shipped (v2.2.2–v2.6.8 — interactive ACP, provider lifecycle, persistent agent sessions, workspace UX)
|
## Shipped (v2.2.2–v2.6.11 — interactive ACP, provider lifecycle, persistent agent sessions, workspace UX)
|
||||||
|
|
||||||
All tags `vMAJOR.MINOR.PATCH-slug`, monotonic per minor, assigned at ship time (planning slugs differ — see the numbering-discipline note below). `CHANGELOG.md` is the canonical per-tag record. **Note on numbering divergence:** the *planned-feature* "v2.3 — Provider lifecycle" actually shipped under the **v2.5.4–v2.5.13** tags; the *planned-feature* "v2.4 — BooCoder as ACP agent" remains **unshipped** even though v2.4.0/v2.4.1 *tags* shipped unrelated content (Unsloth lifts, sidecar routing). The patch-tag thread and the conceptual-milestone thread have diverged — read tags as the ship record, the `## v2.x` feature sections below as the milestone plan. The v2.3.0–v2.5.1 tags were never CHANGELOG-backfilled; summarized here from commit bodies.
|
All tags `vMAJOR.MINOR.PATCH-slug`, monotonic per minor, assigned at ship time (planning slugs differ — see the numbering-discipline note below). `CHANGELOG.md` is the canonical per-tag record. **Note on numbering divergence:** the *planned-feature* "v2.3 — Provider lifecycle" actually shipped under the **v2.5.4–v2.5.13** tags; the *planned-feature* "v2.4 — BooCoder as ACP agent" remains **unshipped** even though v2.4.0/v2.4.1 *tags* shipped unrelated content (Unsloth lifts, sidecar routing). The patch-tag thread and the conceptual-milestone thread have diverged — read tags as the ship record, the `## v2.x` feature sections below as the milestone plan. The v2.3.0–v2.5.1 tags were never CHANGELOG-backfilled; summarized here from commit bodies.
|
||||||
|
|
||||||
@@ -382,7 +382,10 @@ All tags `vMAJOR.MINOR.PATCH-slug`, monotonic per minor, assigned at ship time (
|
|||||||
- `v2.6.5-panes-tabs-composer` — **workspace UX batch (BooChat panes/tabs/composer + the persistence that backs it).** *Panes/tabs:* open a chat in a fresh pane (ChatTabBar "Open in new pane" + fork-beside-original via a new `open_chat_in_new_pane` event), per-pane `[+]` → New BooChat/BooTerm/BooCode menu, closing a chat pane relocates its tabs (in order) to the oldest chat/empty pane (reopen strips restored chatIds from every live pane first → no dup), stable session-scoped tab numbers (assigned on open, retired on close, never reused, map-keyed render), and the empty/landing pane became a real session history (open + separately-fetched archived chats). Removed the per-message "Open in pane" artifact button. *Persistence:* `sessions.workspace_panes` widened from bare `WorkspacePane[]` → a `WorkspaceState` envelope (`panes` + `tabNumbers`/`nextTabNumber` + `closedPaneStack`); PATCH validator zod-unions legacy-array-or-envelope and migrates on write; `session_workspace_updated` WS frame widened (web+server byte-identical, parity test green). *Composer:* morphing **Send → Stop → Queue** button keyed on `sending || activeTaskId` (folds in the standalone Stop pill, adds `cancelTask`); pasted chips trail the typed text so a leading slash stays first. *Tooling:* new read-only `read_tab_by_number` tool + an optional `ToolExecCtx` (`{ sql, sessionId }`) 4th arg on `ToolDef.execute`
|
- `v2.6.5-panes-tabs-composer` — **workspace UX batch (BooChat panes/tabs/composer + the persistence that backs it).** *Panes/tabs:* open a chat in a fresh pane (ChatTabBar "Open in new pane" + fork-beside-original via a new `open_chat_in_new_pane` event), per-pane `[+]` → New BooChat/BooTerm/BooCode menu, closing a chat pane relocates its tabs (in order) to the oldest chat/empty pane (reopen strips restored chatIds from every live pane first → no dup), stable session-scoped tab numbers (assigned on open, retired on close, never reused, map-keyed render), and the empty/landing pane became a real session history (open + separately-fetched archived chats). Removed the per-message "Open in pane" artifact button. *Persistence:* `sessions.workspace_panes` widened from bare `WorkspacePane[]` → a `WorkspaceState` envelope (`panes` + `tabNumbers`/`nextTabNumber` + `closedPaneStack`); PATCH validator zod-unions legacy-array-or-envelope and migrates on write; `session_workspace_updated` WS frame widened (web+server byte-identical, parity test green). *Composer:* morphing **Send → Stop → Queue** button keyed on `sending || activeTaskId` (folds in the standalone Stop pill, adds `cancelTask`); pasted chips trail the typed text so a leading slash stays first. *Tooling:* new read-only `read_tab_by_number` tool + an optional `ToolExecCtx` (`{ sql, sessionId }`) 4th arg on `ToolDef.execute`
|
||||||
- `v2.6.6-claude-md` — docs-only CLAUDE.md session-learnings from the v2.6.5 batch: the `WorkspaceState` envelope migration, the `ToolExecCtx` plumb (`read_tab_by_number` as reference), the two-schema-files-one-DB ownership split + idempotent `confdeltype` FK-action-flip pattern, and React-StrictMode nested-`setState` idempotency
|
- `v2.6.6-claude-md` — docs-only CLAUDE.md session-learnings from the v2.6.5 batch: the `WorkspaceState` envelope migration, the `ToolExecCtx` plumb (`read_tab_by_number` as reference), the two-schema-files-one-DB ownership split + idempotent `confdeltype` FK-action-flip pattern, and React-StrictMode nested-`setState` idempotency
|
||||||
- `v2.6.7-interrupt-guard` — **F.1 fix:** post-interrupt stale-terminal bug in the opencode warm-server backend (one-click reachable since `v2.6.5`'s Stop button). opencode emits one trailing `session.idle`/`session.error` for a cancelled turn (sessionID only, no turn id) that settled the *next* turn early as success. Pure per-session guard (`backends/turn-guard.ts` — arm-on-abort / swallow-one-orphan / self-heal-on-activity) wired into `opencode-server.ts`; 3 regression tests (TDD). First item of the v2.6 openspec "remaining" plan; Phase 1-UX / 2 / 3 still open
|
- `v2.6.7-interrupt-guard` — **F.1 fix:** post-interrupt stale-terminal bug in the opencode warm-server backend (one-click reachable since `v2.6.5`'s Stop button). opencode emits one trailing `session.idle`/`session.error` for a cancelled turn (sessionID only, no turn id) that settled the *next* turn early as success. Pure per-session guard (`backends/turn-guard.ts` — arm-on-abort / swallow-one-orphan / self-heal-on-activity) wired into `opencode-server.ts`; 3 regression tests (TDD). First item of the v2.6 openspec "remaining" plan; Phase 1-UX / 2 / 3 still open
|
||||||
- `v2.6.8-agent-attribution` — **v2.6 Phase 1-UX** (U.1–U.6), built by 3 parallel subagents over disjoint files. Backend: `pending_changes.agent` stamped at every queue site + flows through `listPending`; new `GET /api/sessions/:id/agent-sessions` route; opencode warm-server consumes `session.next.step.ended` → accumulates `input_tokens`/`output_tokens`/`cost` on `agent_sessions`. Frontend: DiffPanel per-row agent badges + multi-agent note; AgentComposerBar resumed/history/new-session chip (gated on optional `sessionId`, BooChat unaffected); shared `providerIcons.tsx` + `useAgentSessions` hook. 9 new tests; web+coder tsc clean. **Backend deploys via boocoder restart; frontend awaits the `boocode` Docker rebuild.** Phase 2/3 remain
|
- `v2.6.8-agent-attribution` — **v2.6 Phase 1-UX** (U.1–U.6), built by 3 parallel subagents over disjoint files. Backend: `pending_changes.agent` stamped at every queue site + flows through `listPending`; new `GET /api/sessions/:id/agent-sessions` route; opencode warm-server consumes `session.next.step.ended` → accumulates `input_tokens`/`output_tokens`/`cost` on `agent_sessions`. Frontend: DiffPanel per-row agent badges + multi-agent note; AgentComposerBar resumed/history/new-session chip (gated on optional `sessionId`, BooChat unaffected); shared `providerIcons.tsx` + `useAgentSessions` hook. 9 new tests; web+coder tsc clean. Both surfaces deployed (boocoder restart + `boocode` Docker rebuild). Phase 2/3 remain
|
||||||
|
- `v2.6.9-warm-acp` — **v2.6 Phase 2:** goose/qwen run as **warm ACP backends** (one persistent `goose acp`/`qwen --acp` child + `ClientSideConnection` + ACP session per `(chat,agent)`, `initialize`+`session/new` once, reused across turns) instead of one-shot. New `WarmAcpBackend` (same `AgentBackend` interface as opencode); abort = `session/cancel` the prompt only (never kills the child); dispatcher routes goose/qwen chat-tab tasks via pure `shouldUseWarmBackend` (one-shot fallback kept for arena/MCP/`new_task`); `handleSessionUpdate` extracted to a shared pure `acp-event-map.ts` (one-shot path byte-identical). SDK concern resolved (`@agentclientprotocol/sdk@^0.22.1` has stable resume; moot warm, deferred to Phase 3). 15 new tests, 180 coder tests pass. Backend-only deploy (boocoder restart). **Smoke 2/2b pending live.** Phase 3 (lifecycle hardening) is the last v2.6 phase
|
||||||
|
- `v2.6.10-lifecycle-hardening` — **v2.6 Phase 3 (final phase — completes v2.6).** Idle TTL eviction (`AGENT_POOL_IDLE_TTL_MS`=30min) + LRU cap (`AGENT_POOL_MAX_LIVE`=10), busy backends never evicted; pure `lifecycle-decisions.ts`. Crash recovery via openchamber's health-monitor + busy-aware-restart + stale-grace state machine in `opencode-server.ts` (+ port reclaim) + `warm-acp.ts` (opencode → fresh sessions; ACP → re-`session/new`; F.1 guard + U.6 usage preserved). Orphan worktree reaper (1h grace, superset-style dirty/unpushed preflight, Paseo soft-delete) + close hooks + re-baseline after apply. 35 new tests + DB-opt-in reconnect test; 215 coder tests pass. Backend-only deploy. **Follow-ups (out of v2.6 scope): apps/server close-hook caller, 3.7 DiffPanel staging hint (frontend), live Smoke 2/2b/3.** With this, **v2.6 persistent agent sessions is complete** (Phase 0–3 + F.1 + Phase 1-UX)
|
||||||
|
- `v2.6.11-close-hooks-staging` — the two v2.6 follow-ups. **apps/server close-hook caller:** BooChat fire-and-forgets BooCoder's Phase-3 close hooks (new `coder-notify.ts`, never-rejects) on session-delete + chat archive/delete, so warm backends + worktrees tear down immediately (the idle-evict/reaper was the backstop). **Task 3.7 staging hint:** BooCoder DiffPanel shows a muted one-liner when the selected provider can't see another agent's unapplied worktree edits (pure derivation from per-change `agent` + current provider). 6 new server tests; web+server tsc/build clean; deploys via the `boocode` Docker container. **The v2.6 openspec is now fully closed** — only live Smoke 2/2b/3 remain (manual)
|
||||||
|
|
||||||
-----
|
-----
|
||||||
|
|
||||||
|
|||||||
@@ -40,36 +40,31 @@ ACP follows; hardening last.
|
|||||||
- [ ] **Smoke U:** stage edits with opencode then boocode → DiffPanel badges each row to the
|
- [ ] **Smoke U:** stage edits with opencode then boocode → DiffPanel badges each row to the
|
||||||
right agent; composer shows "resumed" when re-selecting opencode, "new session" for goose. *(pending live frontend deploy — Docker container rebuild)*
|
right agent; composer shows "resumed" when re-selecting opencode, "new session" for goose. *(pending live frontend deploy — Docker container rebuild)*
|
||||||
|
|
||||||
## Phase 2 — Warm ACP backend (goose, qwen) — ⬜ REMAINING
|
## Phase 2 — Warm ACP backend (goose, qwen) — ✅ SHIPPED `v2.6.9-warm-acp` (Smoke 2/2b pending live)
|
||||||
|
|
||||||
> **Lift (design §10):** `qwen --acp` is a validated reference (real stdio multi-session, `loadSession`/resume) — wire qwen into the existing `acp-dispatch.ts` stack. **goose ACP has no `loadSession`/resume** → cross-restart resume needs a different design (re-`session/new` + accept memory loss, or replay). Cross-check qwen `@agentclientprotocol/sdk@^0.14` vs BooCode `^0.22` before relying on `unstable_resumeSession`. Do **qwen first** to de-risk.
|
> **Lift (design §10):** `qwen --acp` is a validated reference (real stdio multi-session, `loadSession`/resume) — wire qwen into the existing `acp-dispatch.ts` stack. **goose ACP has no `loadSession`/resume** → cross-restart resume needs a different design (re-`session/new` + accept memory loss, or replay). Cross-check qwen `@agentclientprotocol/sdk@^0.14` vs BooCode `^0.22` before relying on `unstable_resumeSession`. Do **qwen first** to de-risk.
|
||||||
|
|
||||||
- [ ] 2.1 `backends/warm-acp.ts`: persistent spawn + `ClientSideConnection`; `initialize` +
|
- [x] 2.1 `backends/warm-acp.ts` `WarmAcpBackend` — persistent spawn + `ClientSideConnection`; `initialize` + `session/new` once per `(chat,agent)`. `handleSessionUpdate` extracted to a shared pure `acp-event-map.ts` (one-shot path byte-identical).
|
||||||
`session/new` once; reuse `acp-dispatch.ts` `handleSessionUpdate`.
|
- [x] 2.2 `prompt`: `session/prompt` on the warm connection per turn; abort = `session/cancel` the prompt only (never kills the child).
|
||||||
- [ ] 2.2 `prompt`: `session/prompt` on the warm connection per turn; per-turn abort signal only.
|
- [x] 2.3 Child supervision: pool-owned lifetime; `exit` marks `agent_sessions.status='crashed'` → re-spawn next turn.
|
||||||
- [ ] 2.3 Child supervision: detached lifetime, exit handler marks `status='crashed'`.
|
- [x] 2.4 Dispatcher routes `goose`/`qwen` chat-tab tasks to the warm backend via pure `shouldUseWarmBackend(task)` (needs `session_id`+`chat_id`); one-shot `runExternalAgent` fallback kept for arena/MCP/`new_task`. *(SDK note resolved: installed `@agentclientprotocol/sdk@^0.22.1` has stable `resumeSession`/`loadSession`; resume moot in the warm hot path, deferred to Phase 3.)*
|
||||||
- [ ] 2.4 Dispatcher routes `goose`/`qwen` to warm backend; keep one-shot fallback for arena/MCP
|
|
||||||
(or opt those into pool too — decide in review).
|
|
||||||
- [ ] **Smoke 2:** two messages in a goose chat reuse the same process + ACP session + worktree;
|
- [ ] **Smoke 2:** two messages in a goose chat reuse the same process + ACP session + worktree;
|
||||||
reasoning still renders; no per-turn respawn.
|
reasoning still renders; no per-turn respawn.
|
||||||
- [ ] **Smoke 2b (switch round-trip):** opencode → boocode → opencode in one chat — opencode
|
- [ ] **Smoke 2b (switch round-trip):** opencode → boocode → opencode in one chat — opencode
|
||||||
resumes the SAME `agent_session_id` (memory intact), boocode saw opencode's turns as
|
resumes the SAME `agent_session_id` (memory intact), boocode saw opencode's turns as
|
||||||
history, all three shared the one worktree, and no agent was locked to the chat.
|
history, all three shared the one worktree, and no agent was locked to the chat.
|
||||||
|
|
||||||
## Phase 3 — Lifecycle hardening — ⬜ REMAINING
|
## Phase 3 — Lifecycle hardening — ✅ COMPLETE (`v2.6.10` 3.1–3.6; `v2.6.11` closed 3.7 + the apps/server close-hook caller)
|
||||||
|
|
||||||
> **Lift (design §10):** hardening from **openchamber** (MIT, same warm-opencode-server architecture) — health-monitor + crash auto-restart + busy-aware restart + port reclaim (`killProcessOnPort`/`waitForPortRelease`) + stall-SSE = a concrete state machine for 3.1/3.2/3.6. Reaper (3.3/3.4): Paseo worktree-archive cascade + superset destroy-saga (preflight dirty/unpushed inspect) + LRU cap on warm-server Maps. Do crash-recovery + reaper together (shared supervision loop).
|
> **Lift (design §10):** hardening from **openchamber** (MIT, same warm-opencode-server architecture) — health-monitor + crash auto-restart + busy-aware restart + port reclaim (`killProcessOnPort`/`waitForPortRelease`) + stall-SSE = a concrete state machine for 3.1/3.2/3.6. Reaper (3.3/3.4): Paseo worktree-archive cascade + superset destroy-saga (preflight dirty/unpushed inspect) + LRU cap on warm-server Maps. Do crash-recovery + reaper together (shared supervision loop).
|
||||||
|
|
||||||
- [ ] 3.1 Idle TTL eviction keyed per `(chat, agent)`; reattach-on-next-turn from `agent_sessions`.
|
- [x] 3.1 Idle TTL eviction per `(chat, agent)` (`AGENT_POOL_IDLE_TTL_MS`=30min) + LRU cap (`AGENT_POOL_MAX_LIVE`=10), busy never evicted; reattach next turn. Pure `lifecycle-decisions.ts` (TDD).
|
||||||
- [ ] 3.2 Crash recovery: opencode server restart recreates sessions; ACP re-`session/new`.
|
- [x] 3.2 Crash recovery: openchamber health-monitor + busy-aware-restart + stale-grace state machine in `opencode-server.ts` (+ port reclaim) + `warm-acp.ts`. opencode → fresh sessions; ACP → re-`session/new`. F.1 guard + U.6 usage preserved.
|
||||||
- [ ] 3.3 Chat close/archive hook → `closeSession` for every `(chat, agent)` + remove the
|
- [x] 3.3 Close hooks (`/api/chats/:id/close`, `/api/sessions/:id/close`) → `closeChat` evicts backends + archives the `worktrees` row + removes the worktree. **apps/server caller wired in `v2.6.11`** (`coder-notify.ts`, fire-and-forget on session-delete + chat archive/delete).
|
||||||
chat's **`worktrees`** row + worktree (NOT `session_worktrees` — superseded P1.5-b); mark agent rows `status='closed'`.
|
- [x] 3.4 Orphan worktree reaper (periodic, 1h grace, superset-style dirty/unpushed preflight, Paseo soft-delete) + LRU cap on the pool.
|
||||||
- [ ] 3.4 Orphan worktree reaper (extend periodic sweeper) + max-live-worktrees LRU cap.
|
- [x] 3.5 Re-baseline `worktrees.base_commit` after a successful `apply_pending` (both apply routes).
|
||||||
- [ ] 3.5 Re-baseline worktree diff after `apply_pending`.
|
- [x] 3.6 Reconnect integration test (DB-opt-in): restart mid-session → next turn reattaches/recreates from `agent_sessions`/`worktrees`.
|
||||||
- [ ] 3.6 Reconnect test: restart BooCoder mid-session → next turn reattaches/recreates cleanly.
|
- [x] 3.7 Staging-boundary hint in DiffPanel (§9c) — `v2.6.11`: muted one-liner when the selected provider can't see another agent's unapplied worktree edits (derived from per-change `agent` + current provider; no new state).
|
||||||
- [ ] 3.7 Staging-boundary hint in DiffPanel (§9c): muted one-liner when the selected
|
|
||||||
provider can't see another agent's unapplied worktree edits (derived from per-change
|
|
||||||
`agent` + current provider; no new state).
|
|
||||||
|
|
||||||
## Tests — ⬜ REMAINING (none of T.1–T.3 exist yet)
|
## Tests — ⬜ REMAINING (none of T.1–T.3 exist yet)
|
||||||
|
|
||||||
@@ -99,7 +94,7 @@ ACP follows; hardening last.
|
|||||||
|
|
||||||
1. ~~**F.1 interrupt-bug fix**~~ — ✅ shipped `v2.6.7-interrupt-guard` (3 regression tests, TDD).
|
1. ~~**F.1 interrupt-bug fix**~~ — ✅ shipped `v2.6.7-interrupt-guard` (3 regression tests, TDD).
|
||||||
2. ~~**Phase 1-UX** (U.1–U.6)~~ — ✅ shipped `v2.6.8-agent-attribution` (3 parallel agents, disjoint files; 9 new tests). Smoke U pending the frontend Docker rebuild.
|
2. ~~**Phase 1-UX** (U.1–U.6)~~ — ✅ shipped `v2.6.8-agent-attribution` (3 parallel agents, disjoint files; 9 new tests). Smoke U pending the frontend Docker rebuild.
|
||||||
3. **Phase 2 — warm ACP, qwen first then goose** — qwen has a validated `--acp` reference; goose's missing resume is the open design question, so qwen de-risks the pattern. Smoke 2 + 2b (the switch round-trip success criterion).
|
3. ~~**Phase 2 — warm ACP, qwen first then goose**~~ — ✅ shipped `v2.6.9-warm-acp` (15 new tests; one-shot path preserved). Smoke 2 + 2b pending live exercise post-deploy.
|
||||||
4. **Phase 3 — lifecycle hardening** — lift openchamber's state machine; do crash-recovery (3.1/3.2/3.6) + worktree reaper (3.3/3.4 + LRU) together (shared supervision loop). Closes the two ⬜ success criteria (server-crash recovery, close→cleanup).
|
4. **Phase 3 — lifecycle hardening** — lift openchamber's state machine; do crash-recovery (3.1/3.2/3.6) + worktree reaper (3.3/3.4 + LRU) together (shared supervision loop). Closes the two ⬜ success criteria (server-crash recovery, close→cleanup).
|
||||||
5. **Tests T.1–T.3 + `BOOCODER.md` (D.1 remainder)** — backfill alongside each phase, not at the end.
|
5. **Tests T.1–T.3 + `BOOCODER.md` (D.1 remainder)** — backfill alongside each phase, not at the end.
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user