mirror of
https://gh-proxy.org/https://github.com/klinsmaya/multica.git
synced 2026-11-09 01:46:46 +08:00
* fix(daemon): enforce runtime ownership on daemon routes (MUL-8154) /api/daemon/* accepts any workspace member's PAT/JWT, and authorization only checked workspace membership. Any member could claim another member's tasks (receiving the agent's custom_env, MCP config and an owner-scoped task token), write task results/messages, and take a runtime over by re-registering its daemon_id. - Runtime-level check on every runtime/task daemon route, HTTP heartbeat, deregister, batch claim (and so the WS claim RPC) and the WS handshake: user credentials must own the runtime (NULL owner fails closed); daemon tokens must match a non-empty runtime daemon_id. - Register: pre-check that every existing row on the daemon_id belongs to the caller, plus a required_owner_id fence in both upserts (incl. the failed-profile path) so a concurrent registration cannot win the row. Daemon-token registration keeps the existing owner. - Legacy merge: only for user-credential registrations, and only when the caller owns both rows, verified on the FOR UPDATE-locked rows. - Tasks without a runtime are not writable through daemon routes; status stays readable. - GetTaskStatus / WS lease queries carry runtime owner/daemon so the hot paths keep one round trip. Co-authored-by: multica-agent <[email protected]> * test(daemon): authenticate fixtures as the runtime owner (MUL-8154) Most handler tests drove daemon routes with a daemon token whose daemon_id did not match the fixture runtime, relying on the workspace-wide token scope this fix removes. They now authenticate the way real daemons do, with the runtime owner's user credential (newOwnerDaemonRequest). Tests about daemon token scoping keep mdt_ and get fixtures with a matching daemon_id; the ownerless-runtime tests also assert that a user credential is refused. Co-authored-by: multica-agent <[email protected]> * fix(daemon): serialize registration per daemon and keep Qoder WS claims working (MUL-8154) Review of #9423: - P1: the owner pre-check and the per-provider/profile upserts hit different conflict keys, so two members registering different providers of the same daemon could both pass the pre-check and both insert, leaving one daemon with two owners (and a daemon token for either runtime reaching the other's). Registration now runs the pre-check and every runtime write in one transaction under a pg_advisory_xact_lock on (workspace_id, daemon_id), on a single connection so queued registrations cannot starve the holder. Legacy merges, analytics and the register event run after commit; failed-profile records use savepoints so they stay best-effort. - P2: the Qoder revocation check read the Authorization header, which the WS RPC bridge's in-process request does not carry, so valid Qoder WS claims silently returned nothing. DaemonAuth now records the mdt_ token hash in the request context, the WS identity keeps it, the RPC bridge re-attaches it, and the check validates that hash on every call (revocation still applies to an open connection). - Regression tests for cross-provider and provider+profile concurrent registration, and for valid/revoked Qoder credentials over WS RPC. Co-authored-by: multica-agent <[email protected]> * fix(daemon): bind daemon tokens to the runtime owner they were issued for (MUL-8154) Second review of #9423: a daemon_id can be re-registered by another member after its runtimes are deleted, and a daemon token was bound only to (workspace, daemon_id), so the previous owner's Remote MCP token reached the new owner's runtime (heartbeat, claim, owner-scoped task token). - daemon_token.owner_id (migration 588). Remote MCP tokens are bound to the locked runtime owner inside FinalizeTaskClaim; live tokens are backfilled only where their daemon has exactly one owner. - DaemonAuth carries the owner binding (DB and cache; cache key bumped to v2 so pre-upgrade entries are never read), the WS identity keeps it and the RPC bridge replays it. - Daemon-token authorization now also requires token owner == runtime owner. Qoder-managed tokens stay unbound (governed by cloud_agent_connection), and user credentials can no longer register the reserved qoder-managed-* ids. - Tests: the reuse lifecycle over HTTP, a new WS handshake and an already open WS connection; the reserved daemon_id; the concurrency barrier now hooks the registration transaction (TxStarter) so the interleaving is real. Co-authored-by: multica-agent <[email protected]> * fix(daemon): owner-bind daemon-token registration; drop unsafe token backfill (MUL-8154) Third review of #9423: - Migration 588 no longer backfills daemon_token.owner_id from the daemon's current owner: that owner may be a later re-registrant, which re-bound the previous owner's live token to them. Existing non-Qoder tokens stay NULL and are refused (24h Remote MCP credentials, re-issued on the next claim). - owner_id is a plain UUID column, no foreign key / cascade (AGENTS.md). - Register via a non-Qoder daemon token now uses the token's owner for the in-transaction pre-check and the SQL owner fence, and refuses unbound tokens. Qoder keeps its connection-based check; daemon tokens still never trigger legacy merges. - Tests: an old owner's bound token and an unbound legacy token can neither register over nor heartbeat the replacement owner's runtime. Co-authored-by: multica-agent <[email protected]> * fix(daemon): grant the Qoder registration exemption only with a live connection (MUL-8154) Fourth review of #9423: register skipped the token owner binding for any qoder-managed-* daemon token, but checked the Qoder connection only when the body declared a qoder_cloud runtime. A pre-upgrade Remote MCP token under that prefix (no owner, no connection) could register type=claude and rewrite another member's runtime. Register now verifies the token against a live cloud_agent_connection before anything else whenever the token is in the Qoder namespace, regardless of the declared runtimes, and restricts that namespace to the bridge's own shape: a built-in qoder_cloud runtime, no custom profiles, no failed_profiles. Test covers built-in, custom-profile, failed-profiles-only and qoder_cloud bodies with an unconnected token, plus the connected token's allowed and refused shapes. Co-authored-by: multica-agent <[email protected]> --------- Co-authored-by: multica-eve <[email protected]> Co-authored-by: multica-agent <[email protected]>
1052 lines
41 KiB
Go
1052 lines
41 KiB
Go
package handler
|
|
|
|
import (
|
|
"context"
|
|
"encoding/json"
|
|
"net/http"
|
|
"net/http/httptest"
|
|
"strings"
|
|
"testing"
|
|
"time"
|
|
|
|
"github.com/go-chi/chi/v5"
|
|
|
|
"github.com/jackc/pgx/v5/pgtype"
|
|
db "github.com/multica-ai/multica/server/pkg/db/generated"
|
|
"github.com/multica-ai/multica/server/pkg/protocol"
|
|
)
|
|
|
|
func localDirRef(t *testing.T, path, daemonID, mode string) json.RawMessage {
|
|
t.Helper()
|
|
raw, err := json.Marshal(map[string]string{
|
|
"local_path": path, "daemon_id": daemonID, "execution_mode": mode,
|
|
})
|
|
if err != nil {
|
|
t.Fatalf("marshal ref: %v", err)
|
|
}
|
|
return raw
|
|
}
|
|
|
|
func runtimeWithVersion(daemonID, cliVersion string) db.AgentRuntime {
|
|
rt := db.AgentRuntime{DaemonID: pgtype.Text{String: daemonID, Valid: daemonID != ""}}
|
|
if cliVersion != "" {
|
|
rt.Metadata, _ = json.Marshal(map[string]string{"cli_version": cliVersion})
|
|
}
|
|
return rt
|
|
}
|
|
|
|
// The save-time gate cannot cover a machine downgraded after the resource was
|
|
// written, and an old daemon json-skips execution_mode entirely — it would run
|
|
// the task IN PLACE, editing the working copy the user asked to isolate. This
|
|
// is the last point where that can be stopped.
|
|
func TestWorktreeClaimBlockReason(t *testing.T) {
|
|
const daemon = "daemon-a"
|
|
|
|
worktreeRes := []ProjectResourceData{{
|
|
ID: "r1", ResourceType: "local_directory",
|
|
ResourceRef: localDirRef(t, "/Users/dev/game", daemon, "worktree"),
|
|
}}
|
|
|
|
t.Run("blocks a runtime that does not advertise the capability", func(t *testing.T) {
|
|
reason := worktreeClaimBlockReason(worktreeRes, runtimeWithVersion(daemon, "0.4.10"), false)
|
|
if reason == "" {
|
|
t.Fatal("an outdated runtime was allowed to claim a worktree task")
|
|
}
|
|
if !strings.Contains(reason, "/Users/dev/game") || !strings.Contains(reason, "Update the Multica app") {
|
|
t.Errorf("reason should name the directory and tell the user to update, got: %q", reason)
|
|
}
|
|
})
|
|
|
|
t.Run("blocks a runtime that advertises nothing at all", func(t *testing.T) {
|
|
// Fail closed: "no version" is what a daemon far older than the field
|
|
// looks like, which is exactly the dangerous case.
|
|
if worktreeClaimBlockReason(worktreeRes, runtimeWithVersion(daemon, ""), false) == "" {
|
|
t.Error("a runtime advertising nothing was allowed to claim")
|
|
}
|
|
})
|
|
|
|
t.Run("allows a runtime that advertises the capability", func(t *testing.T) {
|
|
if reason := worktreeClaimBlockReason(worktreeRes, runtimeWithVersion(daemon, "9.9.9"), true); reason != "" {
|
|
t.Errorf("a capable runtime was blocked: %q", reason)
|
|
}
|
|
})
|
|
|
|
t.Run("ignores in_place and absent modes", func(t *testing.T) {
|
|
for _, mode := range []string{"in_place", ""} {
|
|
res := []ProjectResourceData{{
|
|
ID: "r1", ResourceType: "local_directory",
|
|
ResourceRef: localDirRef(t, "/Users/dev/game", daemon, mode),
|
|
}}
|
|
if reason := worktreeClaimBlockReason(res, runtimeWithVersion(daemon, "0.1.0"), false); reason != "" {
|
|
t.Errorf("mode %q blocked a daemon that can run it fine: %q", mode, reason)
|
|
}
|
|
}
|
|
})
|
|
|
|
// A project may carry one local_directory per machine. Another machine's
|
|
// worktree resource says nothing about this runtime's ability to run.
|
|
t.Run("ignores a resource bound to a different daemon", func(t *testing.T) {
|
|
other := []ProjectResourceData{{
|
|
ID: "r1", ResourceType: "local_directory",
|
|
ResourceRef: localDirRef(t, "/Users/dev/game", "daemon-b", "worktree"),
|
|
}}
|
|
if reason := worktreeClaimBlockReason(other, runtimeWithVersion(daemon, "0.1.0"), false); reason != "" {
|
|
t.Errorf("another machine's resource blocked this claim: %q", reason)
|
|
}
|
|
})
|
|
|
|
t.Run("ignores non-local_directory resources", func(t *testing.T) {
|
|
repo := []ProjectResourceData{{
|
|
ID: "r1", ResourceType: "github_repo",
|
|
ResourceRef: json.RawMessage(`{"url":"https://github.com/a/b"}`),
|
|
}}
|
|
if reason := worktreeClaimBlockReason(repo, runtimeWithVersion(daemon, "0.1.0"), false); reason != "" {
|
|
t.Errorf("github_repo resource blocked a claim: %q", reason)
|
|
}
|
|
})
|
|
|
|
t.Run("ignores a runtime with no daemon id", func(t *testing.T) {
|
|
if reason := worktreeClaimBlockReason(worktreeRes, runtimeWithVersion("", "0.1.0"), false); reason != "" {
|
|
t.Errorf("cloud runtime blocked: %q", reason)
|
|
}
|
|
})
|
|
|
|
t.Run("survives a malformed ref", func(t *testing.T) {
|
|
bad := []ProjectResourceData{{
|
|
ID: "r1", ResourceType: "local_directory",
|
|
ResourceRef: json.RawMessage(`{"local_path": 42}`),
|
|
}}
|
|
if reason := worktreeClaimBlockReason(bad, runtimeWithVersion(daemon, "0.1.0"), false); reason != "" {
|
|
t.Errorf("malformed ref produced a block: %q", reason)
|
|
}
|
|
})
|
|
}
|
|
|
|
// Worktree delivery metadata has to survive the whole way to the task row on
|
|
// BOTH terminal paths. branch_name locates the commit, while durable_work_dir
|
|
// records the directory that remains usable after the task worktree is gone.
|
|
func TestWorktreeDeliveryMetadataRoundTripsThroughBothTerminalPaths(t *testing.T) {
|
|
if testHandler == nil {
|
|
t.Skip("database not available")
|
|
}
|
|
ctx := context.Background()
|
|
|
|
var agentID, runtimeID string
|
|
if err := testPool.QueryRow(ctx, `
|
|
SELECT a.id, a.runtime_id FROM agent a WHERE a.workspace_id = $1 LIMIT 1
|
|
`, testWorkspaceID).Scan(&agentID, &runtimeID); err != nil {
|
|
t.Fatalf("setup: get agent: %v", err)
|
|
}
|
|
|
|
// The terminal handlers resolve the task's workspace through its issue, so
|
|
// a bare task row reads as "failed to load task".
|
|
var issueID string
|
|
if err := testPool.QueryRow(ctx, `
|
|
INSERT INTO issue (workspace_id, title, status, priority, creator_id, creator_type, number, position)
|
|
VALUES ($1, 'branch name round-trip fixture', 'in_progress', 'none', $2, 'member', 993310, 0)
|
|
RETURNING id
|
|
`, testWorkspaceID, testUserID).Scan(&issueID); err != nil {
|
|
t.Fatalf("setup: create issue: %v", err)
|
|
}
|
|
t.Cleanup(func() { testPool.Exec(ctx, `DELETE FROM issue WHERE id = $1`, issueID) })
|
|
|
|
newRunningTask := func(t *testing.T) string {
|
|
t.Helper()
|
|
var taskID string
|
|
if err := testPool.QueryRow(ctx, `
|
|
INSERT INTO agent_task_queue (agent_id, runtime_id, issue_id, status, priority, started_at)
|
|
VALUES ($1, $2, $3, 'running', 0, now())
|
|
RETURNING id
|
|
`, agentID, runtimeID, issueID).Scan(&taskID); err != nil {
|
|
t.Fatalf("setup: create task: %v", err)
|
|
}
|
|
t.Cleanup(func() { testPool.Exec(ctx, `DELETE FROM agent_task_queue WHERE id = $1`, taskID) })
|
|
return taskID
|
|
}
|
|
|
|
post := func(t *testing.T, taskID, endpoint string, body map[string]any, call func(http.ResponseWriter, *http.Request)) {
|
|
t.Helper()
|
|
w := httptest.NewRecorder()
|
|
req := newOwnerDaemonRequest("POST", "/api/daemon/tasks/"+taskID+"/"+endpoint,
|
|
body)
|
|
rctx := chi.NewRouteContext()
|
|
rctx.URLParams.Add("taskId", taskID)
|
|
req = req.WithContext(context.WithValue(req.Context(), chi.RouteCtxKey, rctx))
|
|
call(w, req)
|
|
if w.Code != http.StatusOK {
|
|
t.Fatalf("%s: expected 200, got %d: %s", endpoint, w.Code, w.Body.String())
|
|
}
|
|
}
|
|
|
|
readBranch := func(t *testing.T, taskID string) string {
|
|
t.Helper()
|
|
var branch pgtype.Text
|
|
if err := testPool.QueryRow(ctx,
|
|
`SELECT branch_name FROM agent_task_queue WHERE id = $1`, taskID).Scan(&branch); err != nil {
|
|
t.Fatalf("read branch_name: %v", err)
|
|
}
|
|
return branch.String
|
|
}
|
|
readDurableWorkDir := func(t *testing.T, taskID string) string {
|
|
t.Helper()
|
|
var durableWorkDir pgtype.Text
|
|
if err := testPool.QueryRow(ctx,
|
|
`SELECT durable_work_dir FROM agent_task_queue WHERE id = $1`, taskID).Scan(&durableWorkDir); err != nil {
|
|
t.Fatalf("read durable_work_dir: %v", err)
|
|
}
|
|
return durableWorkDir.String
|
|
}
|
|
|
|
t.Run("complete", func(t *testing.T) {
|
|
taskID := newRunningTask(t)
|
|
post(t, taskID, "complete", map[string]any{
|
|
"output": "done", "branch_name": "agent/j/abc12345",
|
|
"durable_work_dir": "/Users/dev/project",
|
|
}, testHandler.CompleteTask)
|
|
if got := readBranch(t, taskID); got != "agent/j/abc12345" {
|
|
t.Errorf("branch_name = %q, want it persisted from the complete callback", got)
|
|
}
|
|
if got := readDurableWorkDir(t, taskID); got != "/Users/dev/project" {
|
|
t.Errorf("durable_work_dir = %q, want daemon-confirmed project path", got)
|
|
}
|
|
})
|
|
|
|
t.Run("fail", func(t *testing.T) {
|
|
taskID := newRunningTask(t)
|
|
post(t, taskID, "fail", map[string]any{
|
|
"error": "agent crashed", "branch_name": "agent/j/def67890",
|
|
"durable_work_dir": "/Users/dev/project",
|
|
}, testHandler.FailTask)
|
|
if got := readBranch(t, taskID); got != "agent/j/def67890" {
|
|
t.Errorf("branch_name = %q, want the partial work still findable after a failure", got)
|
|
}
|
|
if got := readDurableWorkDir(t, taskID); got != "/Users/dev/project" {
|
|
t.Errorf("durable_work_dir = %q, want daemon-confirmed project path", got)
|
|
}
|
|
})
|
|
|
|
t.Run("absent stays empty for non-worktree tasks", func(t *testing.T) {
|
|
taskID := newRunningTask(t)
|
|
post(t, taskID, "complete", map[string]any{"output": "done"}, testHandler.CompleteTask)
|
|
if got := readBranch(t, taskID); got != "" {
|
|
t.Errorf("branch_name = %q, want empty when the daemon reports none", got)
|
|
}
|
|
if got := readDurableWorkDir(t, taskID); got != "" {
|
|
t.Errorf("durable_work_dir = %q, want empty when the daemon reports none", got)
|
|
}
|
|
})
|
|
}
|
|
|
|
// Every terminal path that can carry worktree delivery metadata must carry it.
|
|
// A worktree run finalizes before it learns its fate, so both the branch and
|
|
// durable handoff are equally real after completion, failure, reroute, or
|
|
// cancellation.
|
|
func TestWorktreeDeliveryMetadataSurvivesEveryTerminalPath(t *testing.T) {
|
|
if testHandler == nil {
|
|
t.Skip("database not available")
|
|
}
|
|
ctx := context.Background()
|
|
|
|
var agentID, runtimeID string
|
|
if err := testPool.QueryRow(ctx, `
|
|
SELECT a.id, a.runtime_id FROM agent a WHERE a.workspace_id = $1 LIMIT 1
|
|
`, testWorkspaceID).Scan(&agentID, &runtimeID); err != nil {
|
|
t.Fatalf("setup: get agent: %v", err)
|
|
}
|
|
var issueID string
|
|
if err := testPool.QueryRow(ctx, `
|
|
INSERT INTO issue (workspace_id, title, status, priority, creator_id, creator_type, number, position)
|
|
VALUES ($1, 'terminal path branch fixture', 'in_progress', 'none', $2, 'member', 993311, 0)
|
|
RETURNING id
|
|
`, testWorkspaceID, testUserID).Scan(&issueID); err != nil {
|
|
t.Fatalf("setup: create issue: %v", err)
|
|
}
|
|
t.Cleanup(func() { testPool.Exec(ctx, `DELETE FROM issue WHERE id = $1`, issueID) })
|
|
|
|
newTask := func(t *testing.T, status string) string {
|
|
t.Helper()
|
|
var taskID string
|
|
if err := testPool.QueryRow(ctx, `
|
|
INSERT INTO agent_task_queue (agent_id, runtime_id, issue_id, status, priority, started_at)
|
|
VALUES ($1, $2, $3, $4, 0, now())
|
|
RETURNING id
|
|
`, agentID, runtimeID, issueID, status).Scan(&taskID); err != nil {
|
|
t.Fatalf("setup: create task: %v", err)
|
|
}
|
|
t.Cleanup(func() { testPool.Exec(ctx, `DELETE FROM agent_task_queue WHERE id = $1`, taskID) })
|
|
return taskID
|
|
}
|
|
post := func(t *testing.T, taskID, endpoint string, body map[string]any, call func(http.ResponseWriter, *http.Request)) {
|
|
t.Helper()
|
|
w := httptest.NewRecorder()
|
|
req := newOwnerDaemonRequest("POST", "/api/daemon/tasks/"+taskID+"/"+endpoint,
|
|
body)
|
|
rctx := chi.NewRouteContext()
|
|
rctx.URLParams.Add("taskId", taskID)
|
|
req = req.WithContext(context.WithValue(req.Context(), chi.RouteCtxKey, rctx))
|
|
call(w, req)
|
|
if w.Code != http.StatusOK {
|
|
t.Fatalf("%s: expected 200, got %d: %s", endpoint, w.Code, w.Body.String())
|
|
}
|
|
}
|
|
readBranch := func(t *testing.T, taskID string) string {
|
|
t.Helper()
|
|
var branch pgtype.Text
|
|
if err := testPool.QueryRow(ctx,
|
|
`SELECT branch_name FROM agent_task_queue WHERE id = $1`, taskID).Scan(&branch); err != nil {
|
|
t.Fatalf("read branch_name: %v", err)
|
|
}
|
|
return branch.String
|
|
}
|
|
readDurableWorkDir := func(t *testing.T, taskID string) string {
|
|
t.Helper()
|
|
var durableWorkDir pgtype.Text
|
|
if err := testPool.QueryRow(ctx,
|
|
`SELECT durable_work_dir FROM agent_task_queue WHERE id = $1`, taskID).Scan(&durableWorkDir); err != nil {
|
|
t.Fatalf("read durable_work_dir: %v", err)
|
|
}
|
|
return durableWorkDir.String
|
|
}
|
|
|
|
// A context-exhausted "success" is rerouted to the failure path server-side.
|
|
// The run still delivered a branch; the reroute must not eat it.
|
|
t.Run("context-exhausted reroute keeps the branch", func(t *testing.T) {
|
|
taskID := newTask(t, "running")
|
|
post(t, taskID, "complete", map[string]any{
|
|
"output": "Prompt is too long and cannot be compacted further.",
|
|
"branch_name": "agent/j/ctx11111",
|
|
"durable_work_dir": "/Users/dev/project",
|
|
}, testHandler.CompleteTask)
|
|
|
|
var status string
|
|
if err := testPool.QueryRow(ctx,
|
|
`SELECT status FROM agent_task_queue WHERE id = $1`, taskID).Scan(&status); err != nil {
|
|
t.Fatalf("read status: %v", err)
|
|
}
|
|
if status != "failed" {
|
|
t.Fatalf("precondition: expected the reroute to record a failure, got %q", status)
|
|
}
|
|
if got := readBranch(t, taskID); got != "agent/j/ctx11111" {
|
|
t.Errorf("branch_name = %q, want it carried across the complete→fail reroute", got)
|
|
}
|
|
if got := readDurableWorkDir(t, taskID); got != "/Users/dev/project" {
|
|
t.Errorf("durable_work_dir = %q, want it carried across the complete→fail reroute", got)
|
|
}
|
|
})
|
|
|
|
// Cancellation discards the whole result payload, but the worktree was
|
|
// finalized before the daemon learned of the cancel — so the branch exists
|
|
// and the ack is the only channel left to report it.
|
|
t.Run("cancel ack records the branch", func(t *testing.T) {
|
|
taskID := newTask(t, "cancelled")
|
|
post(t, taskID, "cancel-ack", map[string]any{
|
|
"branch_name": "agent/j/cancel11",
|
|
"durable_work_dir": "/Users/dev/project",
|
|
}, testHandler.AckTaskCancelled)
|
|
if got := readBranch(t, taskID); got != "agent/j/cancel11" {
|
|
t.Errorf("branch_name = %q, want the cancelled run's committed work discoverable", got)
|
|
}
|
|
if got := readDurableWorkDir(t, taskID); got != "/Users/dev/project" {
|
|
t.Errorf("durable_work_dir = %q, want the cancelled run's project path", got)
|
|
}
|
|
})
|
|
|
|
// Older daemons post an empty body here; that must stay a valid ack.
|
|
t.Run("cancel ack without a branch still succeeds", func(t *testing.T) {
|
|
taskID := newTask(t, "cancelled")
|
|
post(t, taskID, "cancel-ack", map[string]any{}, testHandler.AckTaskCancelled)
|
|
if got := readBranch(t, taskID); got != "" {
|
|
t.Errorf("branch_name = %q, want empty", got)
|
|
}
|
|
})
|
|
|
|
// A name recorded by a terminal callback is authoritative; a later ack must
|
|
// not clobber it.
|
|
t.Run("cancel ack does not overwrite an existing branch", func(t *testing.T) {
|
|
taskID := newTask(t, "running")
|
|
post(t, taskID, "complete", map[string]any{
|
|
"output": "done", "branch_name": "agent/j/original",
|
|
}, testHandler.CompleteTask)
|
|
post(t, taskID, "cancel-ack", map[string]any{
|
|
"branch_name": "agent/j/latecomer",
|
|
}, testHandler.AckTaskCancelled)
|
|
if got := readBranch(t, taskID); got != "agent/j/original" {
|
|
t.Errorf("branch_name = %q, want the original preserved", got)
|
|
}
|
|
})
|
|
|
|
readError := func(t *testing.T, taskID string) (string, string) {
|
|
t.Helper()
|
|
var errText, failureReason pgtype.Text
|
|
if err := testPool.QueryRow(ctx,
|
|
`SELECT error, failure_reason FROM agent_task_queue WHERE id = $1`, taskID).Scan(&errText, &failureReason); err != nil {
|
|
t.Fatalf("read error columns: %v", err)
|
|
}
|
|
return errText.String, failureReason.String
|
|
}
|
|
|
|
// Cancel + Finalize-abort: no branch exists, and the error naming the
|
|
// preserved worktree is the only pointer left to the agent's work. The ack
|
|
// must land it on the row for the UI to show.
|
|
t.Run("cancel ack records a preserved-worktree error", func(t *testing.T) {
|
|
taskID := newTask(t, "cancelled")
|
|
const preserved = "local_directory worktree: could not commit; the work is preserved in the worktree at /env/worktree"
|
|
post(t, taskID, "cancel-ack", map[string]any{
|
|
"error_message": preserved,
|
|
"failure_reason": "local_directory_error",
|
|
}, testHandler.AckTaskCancelled)
|
|
gotErr, gotReason := readError(t, taskID)
|
|
if gotErr != preserved {
|
|
t.Errorf("error = %q, want the preserved-worktree message", gotErr)
|
|
}
|
|
if gotReason != "local_directory_error" {
|
|
t.Errorf("failure_reason = %q, want local_directory_error", gotReason)
|
|
}
|
|
})
|
|
|
|
// A reason already recorded (fail callback, claim gate) is authoritative;
|
|
// a replayed or late ack must not clobber it.
|
|
t.Run("cancel ack does not overwrite an existing error", func(t *testing.T) {
|
|
taskID := newTask(t, "cancelled")
|
|
if _, err := testPool.Exec(ctx,
|
|
`UPDATE agent_task_queue SET error = 'original reason', failure_reason = 'timeout' WHERE id = $1`,
|
|
taskID); err != nil {
|
|
t.Fatalf("seed existing error: %v", err)
|
|
}
|
|
post(t, taskID, "cancel-ack", map[string]any{
|
|
"error_message": "latecomer",
|
|
"failure_reason": "local_directory_error",
|
|
}, testHandler.AckTaskCancelled)
|
|
gotErr, gotReason := readError(t, taskID)
|
|
if gotErr != "original reason" || gotReason != "timeout" {
|
|
t.Errorf("error/failure_reason = %q/%q, want the original pair preserved", gotErr, gotReason)
|
|
}
|
|
})
|
|
|
|
// Replaying the same ack (the daemon retries on transient errors) must be
|
|
// idempotent: same row state, still a 200.
|
|
t.Run("cancel ack replay is idempotent", func(t *testing.T) {
|
|
taskID := newTask(t, "cancelled")
|
|
body := map[string]any{
|
|
"branch_name": "agent/j/replay11",
|
|
"durable_work_dir": "/Users/dev/project",
|
|
"error_message": "preserved at /env/worktree",
|
|
"failure_reason": "local_directory_error",
|
|
}
|
|
post(t, taskID, "cancel-ack", body, testHandler.AckTaskCancelled)
|
|
post(t, taskID, "cancel-ack", body, testHandler.AckTaskCancelled)
|
|
if got := readBranch(t, taskID); got != "agent/j/replay11" {
|
|
t.Errorf("branch_name = %q after replay, want agent/j/replay11", got)
|
|
}
|
|
if got := readDurableWorkDir(t, taskID); got != "/Users/dev/project" {
|
|
t.Errorf("durable_work_dir = %q after replay, want unchanged", got)
|
|
}
|
|
gotErr, _ := readError(t, taskID)
|
|
if gotErr != "preserved at /env/worktree" {
|
|
t.Errorf("error = %q after replay, want unchanged", gotErr)
|
|
}
|
|
})
|
|
|
|
// The daemon acks on EVERY terminal status it observes, so a stale run's
|
|
// late ack can arrive for a row that completed or failed WITHOUT a branch.
|
|
// Those rows' own complete/fail callbacks are the authoritative channel —
|
|
// the ack's status CAS must keep it from backfilling them.
|
|
t.Run("late cancel ack leaves a completed row untouched", func(t *testing.T) {
|
|
taskID := newTask(t, "running")
|
|
post(t, taskID, "complete", map[string]any{"output": "all done"}, testHandler.CompleteTask)
|
|
post(t, taskID, "cancel-ack", map[string]any{
|
|
"branch_name": "agent/j/stale011",
|
|
"durable_work_dir": "/Users/dev/stale-project",
|
|
"error_message": "stale preserved-path message",
|
|
"failure_reason": "local_directory_error",
|
|
}, testHandler.AckTaskCancelled)
|
|
if got := readBranch(t, taskID); got != "" {
|
|
t.Errorf("branch_name = %q, want empty — a late ack backfilled a completed row", got)
|
|
}
|
|
if got := readDurableWorkDir(t, taskID); got != "" {
|
|
t.Errorf("durable_work_dir = %q, want empty — a late ack backfilled a completed row", got)
|
|
}
|
|
gotErr, gotReason := readError(t, taskID)
|
|
if gotErr != "" || gotReason != "" {
|
|
t.Errorf("error/failure_reason = %q/%q, want both empty on a completed row", gotErr, gotReason)
|
|
}
|
|
})
|
|
|
|
t.Run("late cancel ack leaves a failed row untouched", func(t *testing.T) {
|
|
taskID := newTask(t, "running")
|
|
post(t, taskID, "fail", map[string]any{"error": "agent crashed"}, testHandler.FailTask)
|
|
post(t, taskID, "cancel-ack", map[string]any{
|
|
"branch_name": "agent/j/stale012",
|
|
"durable_work_dir": "/Users/dev/stale-project",
|
|
}, testHandler.AckTaskCancelled)
|
|
if got := readBranch(t, taskID); got != "" {
|
|
t.Errorf("branch_name = %q, want empty — a late ack backfilled a failed row", got)
|
|
}
|
|
if got := readDurableWorkDir(t, taskID); got != "" {
|
|
t.Errorf("durable_work_dir = %q, want empty — a late ack backfilled a failed row", got)
|
|
}
|
|
gotErr, _ := readError(t, taskID)
|
|
if gotErr != "agent crashed" {
|
|
t.Errorf("error = %q, want the fail callback's own message preserved", gotErr)
|
|
}
|
|
})
|
|
}
|
|
|
|
// The claim gate cancels the task; the reason has to land on the row. The 4xx
|
|
// only reaches the daemon's log, and batch claim drops the task from its
|
|
// response entirely — so without a persisted reason the user sees a bare
|
|
// "cancelled" for a condition only they can fix.
|
|
func TestWorktreeClaimGateCancelPersistsReason(t *testing.T) {
|
|
if testHandler == nil {
|
|
t.Skip("database not available")
|
|
}
|
|
ctx := context.Background()
|
|
|
|
var agentID, runtimeID string
|
|
if err := testPool.QueryRow(ctx, `
|
|
SELECT a.id, a.runtime_id FROM agent a WHERE a.workspace_id = $1 LIMIT 1
|
|
`, testWorkspaceID).Scan(&agentID, &runtimeID); err != nil {
|
|
t.Fatalf("setup: get agent: %v", err)
|
|
}
|
|
var taskID string
|
|
if err := testPool.QueryRow(ctx, `
|
|
INSERT INTO agent_task_queue (agent_id, runtime_id, status, priority, dispatched_at)
|
|
VALUES ($1, $2, 'dispatched', 0, now())
|
|
RETURNING id
|
|
`, agentID, runtimeID).Scan(&taskID); err != nil {
|
|
t.Fatalf("setup: create task: %v", err)
|
|
}
|
|
t.Cleanup(func() { testPool.Exec(ctx, `DELETE FROM agent_task_queue WHERE id = $1`, taskID) })
|
|
|
|
const reason = "worktree mode needs a newer runtime on that machine"
|
|
if _, err := testHandler.Queries.CancelAgentTaskWithReason(ctx, db.CancelAgentTaskWithReasonParams{
|
|
ID: parseUUID(taskID),
|
|
Error: pgtype.Text{String: reason, Valid: true},
|
|
FailureReason: pgtype.Text{String: "local_directory_error", Valid: true},
|
|
}); err != nil {
|
|
t.Fatalf("CancelAgentTaskWithReason: %v", err)
|
|
}
|
|
|
|
var status string
|
|
var errText, failureReason pgtype.Text
|
|
if err := testPool.QueryRow(ctx,
|
|
`SELECT status, error, failure_reason FROM agent_task_queue WHERE id = $1`,
|
|
taskID).Scan(&status, &errText, &failureReason); err != nil {
|
|
t.Fatalf("read task: %v", err)
|
|
}
|
|
if status != "cancelled" {
|
|
t.Errorf("status = %q, want cancelled", status)
|
|
}
|
|
if errText.String != reason {
|
|
t.Errorf("error = %q, want the user-facing reason persisted", errText.String)
|
|
}
|
|
if failureReason.String != "local_directory_error" {
|
|
t.Errorf("failure_reason = %q, want local_directory_error", failureReason.String)
|
|
}
|
|
}
|
|
|
|
// seedWorktreeGateClaimFixture builds the full claim-path scenario the gate
|
|
// exists for: a runtime whose machine reports cliVersion, an agent bound to
|
|
// it, and a queued issue task whose project carries a worktree-mode
|
|
// local_directory resource pinned to that same machine.
|
|
func seedWorktreeGateClaimFixture(t *testing.T, ctx context.Context, label, daemonID, cliVersion string) (runtimeID, taskID string) {
|
|
t.Helper()
|
|
|
|
metadata := "{}"
|
|
if cliVersion != "" {
|
|
metadata = `{"cli_version":"` + cliVersion + `"}`
|
|
}
|
|
if err := testPool.QueryRow(ctx, `
|
|
INSERT INTO agent_runtime (
|
|
workspace_id, daemon_id, name, runtime_mode, provider,
|
|
status, device_info, metadata, last_seen_at, visibility, owner_id
|
|
)
|
|
VALUES ($1, $2, $3, 'local', 'handler_test_runtime', 'online', 'worktree gate fixture', $4::jsonb, now(), 'private', $5)
|
|
RETURNING id
|
|
`, testWorkspaceID, daemonID, label+" runtime", metadata, testUserID).Scan(&runtimeID); err != nil {
|
|
t.Fatalf("setup: create runtime: %v", err)
|
|
}
|
|
t.Cleanup(func() { testPool.Exec(ctx, `DELETE FROM agent_runtime WHERE id = $1`, runtimeID) })
|
|
|
|
var agentID string
|
|
if err := testPool.QueryRow(ctx, `
|
|
INSERT INTO agent (
|
|
workspace_id, name, description, runtime_mode, runtime_config,
|
|
runtime_id, visibility, max_concurrent_tasks, owner_id
|
|
)
|
|
VALUES ($1, $2, '', 'local', '{}'::jsonb, $3, 'private', 1, $4)
|
|
RETURNING id
|
|
`, testWorkspaceID, label+" agent", runtimeID, testUserID).Scan(&agentID); err != nil {
|
|
t.Fatalf("setup: create agent: %v", err)
|
|
}
|
|
t.Cleanup(func() { testPool.Exec(ctx, `DELETE FROM agent WHERE id = $1`, agentID) })
|
|
|
|
var projectID string
|
|
if err := testPool.QueryRow(ctx, `
|
|
INSERT INTO project (workspace_id, title) VALUES ($1, $2) RETURNING id
|
|
`, testWorkspaceID, label+" project").Scan(&projectID); err != nil {
|
|
t.Fatalf("setup: create project: %v", err)
|
|
}
|
|
t.Cleanup(func() { testPool.Exec(ctx, `DELETE FROM project WHERE id = $1`, projectID) })
|
|
|
|
if _, err := testPool.Exec(ctx, `
|
|
INSERT INTO project_resource (project_id, workspace_id, resource_type, resource_ref, position)
|
|
VALUES ($1, $2, 'local_directory', $3::jsonb, 0)
|
|
`, projectID, testWorkspaceID,
|
|
`{"local_path":"/Users/dev/wtgate","daemon_id":"`+daemonID+`","execution_mode":"worktree"}`); err != nil {
|
|
t.Fatalf("setup: create project_resource: %v", err)
|
|
}
|
|
t.Cleanup(func() {
|
|
testPool.Exec(ctx, `DELETE FROM project_resource WHERE project_id = $1`, projectID)
|
|
})
|
|
|
|
var issueID string
|
|
if err := testPool.QueryRow(ctx, `
|
|
INSERT INTO issue (workspace_id, project_id, title, status, priority, creator_id, creator_type, number, position)
|
|
VALUES (
|
|
$1, $2, $3, 'in_progress', 'none', $4, 'member',
|
|
(SELECT COALESCE(MAX(number), 82649) + 1 FROM issue WHERE workspace_id = $1),
|
|
0
|
|
)
|
|
RETURNING id
|
|
`, testWorkspaceID, projectID, label+" issue", testUserID).Scan(&issueID); err != nil {
|
|
t.Fatalf("setup: create issue: %v", err)
|
|
}
|
|
t.Cleanup(func() { testPool.Exec(ctx, `DELETE FROM issue WHERE id = $1`, issueID) })
|
|
|
|
if err := testPool.QueryRow(ctx, `
|
|
INSERT INTO agent_task_queue (agent_id, runtime_id, issue_id, status, priority)
|
|
VALUES ($1, $2, $3, 'queued', 0)
|
|
RETURNING id
|
|
`, agentID, runtimeID, issueID).Scan(&taskID); err != nil {
|
|
t.Fatalf("setup: create task: %v", err)
|
|
}
|
|
t.Cleanup(func() { testPool.Exec(ctx, `DELETE FROM agent_task_queue WHERE id = $1`, taskID) })
|
|
|
|
return runtimeID, taskID
|
|
}
|
|
|
|
// assertWorktreeGateCancelled reads the task row and asserts the gate left it
|
|
// in the state the user can act on: cancelled, with the reason persisted.
|
|
func assertWorktreeGateCancelled(t *testing.T, ctx context.Context, taskID string) {
|
|
t.Helper()
|
|
var status string
|
|
var errText, failureReason pgtype.Text
|
|
if err := testPool.QueryRow(ctx,
|
|
`SELECT status, error, failure_reason FROM agent_task_queue WHERE id = $1`,
|
|
taskID).Scan(&status, &errText, &failureReason); err != nil {
|
|
t.Fatalf("read task: %v", err)
|
|
}
|
|
if status != "cancelled" {
|
|
t.Errorf("status = %q, want cancelled", status)
|
|
}
|
|
if !strings.Contains(errText.String, "/Users/dev/wtgate") {
|
|
t.Errorf("error = %q, want the persisted reason naming the directory", errText.String)
|
|
}
|
|
if failureReason.String != "local_directory_error" {
|
|
t.Errorf("failure_reason = %q, want local_directory_error", failureReason.String)
|
|
}
|
|
}
|
|
|
|
// TestClaimTask_WorktreeGateSingular drives the REAL singular claim endpoint
|
|
// against a too-old runtime: the daemon must get the reason as a 422, and the
|
|
// row must land cancelled-with-reason via the full TaskService path — not a
|
|
// bare status flip that leaves agent status and live cards stale.
|
|
func TestClaimTask_WorktreeGateSingular(t *testing.T) {
|
|
if testHandler == nil || testPool == nil {
|
|
t.Skip("database not available")
|
|
}
|
|
ctx := context.Background()
|
|
const daemonID = "wtgate-singular-daemon"
|
|
runtimeID, taskID := seedWorktreeGateClaimFixture(t, ctx, "WT gate singular", daemonID, "0.4.10")
|
|
|
|
w := httptest.NewRecorder()
|
|
req := newDaemonTokenRequest("POST", "/api/daemon/runtimes/"+runtimeID+"/claim", nil, testWorkspaceID, daemonID)
|
|
req = withURLParam(req, "runtimeId", runtimeID)
|
|
testHandler.ClaimTaskByRuntime(w, req)
|
|
|
|
if w.Code != http.StatusUnprocessableEntity {
|
|
t.Fatalf("expected 422 for a too-old runtime, got %d: %s", w.Code, w.Body.String())
|
|
}
|
|
if body := w.Body.String(); !strings.Contains(body, "/Users/dev/wtgate") ||
|
|
!strings.Contains(body, "does not support parallel") ||
|
|
!strings.Contains(body, "Update the Multica app") {
|
|
t.Errorf("422 body should name the directory and tell the user to update, got: %s", body)
|
|
}
|
|
assertWorktreeGateCancelled(t, ctx, taskID)
|
|
}
|
|
|
|
// TestClaimTask_WorktreeGateBatch drives the REAL batch claim endpoint: the
|
|
// blocked task is omitted from the response (the daemon never sees it), so the
|
|
// persisted row reason is the ONLY explanation the user gets — assert both.
|
|
func TestClaimTask_WorktreeGateBatch(t *testing.T) {
|
|
if testHandler == nil || testPool == nil {
|
|
t.Skip("database not available")
|
|
}
|
|
ctx := context.Background()
|
|
// The batch token and body share batchClaimTestDaemonID; the runtime row
|
|
// and resource ref must use the same machine for the gate to key on it.
|
|
runtimeID, taskID := seedWorktreeGateClaimFixture(t, ctx, "WT gate batch", batchClaimTestDaemonID, "0.4.10")
|
|
|
|
w := postBatchClaim(t, testWorkspaceID, []string{runtimeID}, 5)
|
|
if w.Code != http.StatusOK {
|
|
t.Fatalf("batch claim: expected 200, got %d: %s", w.Code, w.Body.String())
|
|
}
|
|
var resp struct {
|
|
Tasks []AgentTaskResponse `json:"tasks"`
|
|
}
|
|
if err := json.Unmarshal(w.Body.Bytes(), &resp); err != nil {
|
|
t.Fatalf("decode: %v", err)
|
|
}
|
|
if len(resp.Tasks) != 0 {
|
|
t.Fatalf("blocked worktree task leaked into the batch response: %+v", resp.Tasks)
|
|
}
|
|
assertWorktreeGateCancelled(t, ctx, taskID)
|
|
}
|
|
|
|
// TestClaimTask_WorktreeGateAllowsCurrentRuntime is the control: the same
|
|
// fixture with a daemon that ADVERTISES worktree support claims normally,
|
|
// proving the gate blocks on the missing capability — not on worktree
|
|
// resources in general. Note the deliberately ancient version string: the gate
|
|
// must not consult it at all.
|
|
func TestClaimTask_WorktreeGateAllowsCurrentRuntime(t *testing.T) {
|
|
if testHandler == nil || testPool == nil {
|
|
t.Skip("database not available")
|
|
}
|
|
ctx := context.Background()
|
|
const daemonID = "wtgate-ok-daemon"
|
|
runtimeID, taskID := seedWorktreeGateClaimFixture(t, ctx, "WT gate ok", daemonID, "0.0.1")
|
|
|
|
w := httptest.NewRecorder()
|
|
req := newDaemonTokenRequest("POST", "/api/daemon/runtimes/"+runtimeID+"/claim", nil, testWorkspaceID, daemonID)
|
|
req.Header.Set("X-Client-Capabilities", protocol.DaemonCapabilityLocalWorktreeV1)
|
|
req = withURLParam(req, "runtimeId", runtimeID)
|
|
testHandler.ClaimTaskByRuntime(w, req)
|
|
|
|
if w.Code != http.StatusOK {
|
|
t.Fatalf("expected 200 for a current runtime, got %d: %s", w.Code, w.Body.String())
|
|
}
|
|
var resp struct {
|
|
Task *AgentTaskResponse `json:"task"`
|
|
}
|
|
if err := json.Unmarshal(w.Body.Bytes(), &resp); err != nil {
|
|
t.Fatalf("decode: %v", err)
|
|
}
|
|
if resp.Task == nil {
|
|
t.Fatal("expected the task to be claimed by a new-enough runtime")
|
|
}
|
|
var status string
|
|
if err := testPool.QueryRow(ctx, `SELECT status FROM agent_task_queue WHERE id = $1`, taskID).Scan(&status); err != nil {
|
|
t.Fatalf("read task: %v", err)
|
|
}
|
|
if status != "dispatched" {
|
|
t.Errorf("status = %q, want dispatched", status)
|
|
}
|
|
}
|
|
|
|
// injectCancelFailureForTask installs a row-scoped trigger that makes any
|
|
// UPDATE flipping this task to 'cancelled' raise — real fault injection at the
|
|
// layer the gate's cancel actually fails at. The requeue path (status back to
|
|
// 'queued') passes through untouched, which is exactly the recovery the gate
|
|
// must take.
|
|
func injectCancelFailureForTask(t *testing.T, ctx context.Context, taskID string) {
|
|
t.Helper()
|
|
if _, err := testPool.Exec(ctx, `
|
|
CREATE OR REPLACE FUNCTION wtgate_fail_cancel() RETURNS trigger AS $fn$
|
|
BEGIN
|
|
IF NEW.status = 'cancelled' THEN
|
|
RAISE EXCEPTION 'injected cancel failure';
|
|
END IF;
|
|
RETURN NEW;
|
|
END $fn$ LANGUAGE plpgsql
|
|
`); err != nil {
|
|
t.Fatalf("create fault function: %v", err)
|
|
}
|
|
if _, err := testPool.Exec(ctx,
|
|
`CREATE TRIGGER wtgate_fail_cancel_trg BEFORE UPDATE ON agent_task_queue
|
|
FOR EACH ROW WHEN (OLD.id = '`+taskID+`'::uuid) EXECUTE FUNCTION wtgate_fail_cancel()`); err != nil {
|
|
t.Fatalf("create fault trigger: %v", err)
|
|
}
|
|
t.Cleanup(func() {
|
|
testPool.Exec(ctx, `DROP TRIGGER IF EXISTS wtgate_fail_cancel_trg ON agent_task_queue`)
|
|
testPool.Exec(ctx, `DROP FUNCTION IF EXISTS wtgate_fail_cancel`)
|
|
})
|
|
}
|
|
|
|
// When the gate's cancel itself fails, the claimed row must NOT strand in
|
|
// dispatched (the daemon was refused the task, so nothing would ever run or
|
|
// release it until stale reclaim). The gate requeues it so the next claim
|
|
// re-runs the gate and retries the cancel.
|
|
func TestClaimTask_WorktreeGateCancelFailureRequeuesSingular(t *testing.T) {
|
|
if testHandler == nil || testPool == nil {
|
|
t.Skip("database not available")
|
|
}
|
|
ctx := context.Background()
|
|
const daemonID = "wtgate-cancelfail-daemon"
|
|
runtimeID, taskID := seedWorktreeGateClaimFixture(t, ctx, "WT gate cancelfail", daemonID, "0.4.10")
|
|
injectCancelFailureForTask(t, ctx, taskID)
|
|
|
|
w := httptest.NewRecorder()
|
|
req := newDaemonTokenRequest("POST", "/api/daemon/runtimes/"+runtimeID+"/claim", nil, testWorkspaceID, daemonID)
|
|
req = withURLParam(req, "runtimeId", runtimeID)
|
|
testHandler.ClaimTaskByRuntime(w, req)
|
|
|
|
if w.Code != http.StatusInternalServerError {
|
|
t.Fatalf("expected 500 (transient server problem, not a claim refusal), got %d: %s", w.Code, w.Body.String())
|
|
}
|
|
var status string
|
|
if err := testPool.QueryRow(ctx, `SELECT status FROM agent_task_queue WHERE id = $1`, taskID).Scan(&status); err != nil {
|
|
t.Fatalf("read task: %v", err)
|
|
}
|
|
if status != "queued" {
|
|
t.Errorf("status = %q, want queued — a stranded dispatched row waits on stale reclaim with no reason", status)
|
|
}
|
|
}
|
|
|
|
func TestClaimTask_WorktreeGateCancelFailureRequeuesBatch(t *testing.T) {
|
|
if testHandler == nil || testPool == nil {
|
|
t.Skip("database not available")
|
|
}
|
|
ctx := context.Background()
|
|
runtimeID, taskID := seedWorktreeGateClaimFixture(t, ctx, "WT gate cancelfail batch", batchClaimTestDaemonID, "0.4.10")
|
|
injectCancelFailureForTask(t, ctx, taskID)
|
|
|
|
w := postBatchClaim(t, testWorkspaceID, []string{runtimeID}, 5)
|
|
if w.Code != http.StatusOK {
|
|
t.Fatalf("batch claim: expected 200, got %d: %s", w.Code, w.Body.String())
|
|
}
|
|
var resp struct {
|
|
Tasks []AgentTaskResponse `json:"tasks"`
|
|
}
|
|
if err := json.Unmarshal(w.Body.Bytes(), &resp); err != nil {
|
|
t.Fatalf("decode: %v", err)
|
|
}
|
|
if len(resp.Tasks) != 0 {
|
|
t.Fatalf("blocked worktree task leaked into the batch response: %+v", resp.Tasks)
|
|
}
|
|
var status string
|
|
if err := testPool.QueryRow(ctx, `SELECT status FROM agent_task_queue WHERE id = $1`, taskID).Scan(&status); err != nil {
|
|
t.Fatalf("read task: %v", err)
|
|
}
|
|
if status != "queued" {
|
|
t.Errorf("status = %q, want queued after the batch gate's cancel failed", status)
|
|
}
|
|
}
|
|
|
|
// The bug this gate was rebuilt for: a dev-built daemon reports a git-describe
|
|
// version that the version floor deliberately exempts, so the old version-based
|
|
// gate waved through a binary with no worktree implementation and two tasks ran
|
|
// in the user's own directory (MUL-5707). The capability signal is immune to
|
|
// how the version string happens to be spelled.
|
|
func TestWorktreeClaimGateIgnoresVersionStrings(t *testing.T) {
|
|
const daemon = "daemon-a"
|
|
res := []ProjectResourceData{{
|
|
ID: "r1", ResourceType: "local_directory",
|
|
ResourceRef: localDirRef(t, "/Users/dev/game", daemon, "worktree"),
|
|
}}
|
|
|
|
// Every one of these is a version string that the old floor check would
|
|
// have ALLOWED. Without the capability, all must now be blocked.
|
|
for _, version := range []string{
|
|
"v0.4.21-24-gcd3c0bb89", // the exact dev-describe build that got through
|
|
"0.4.24", // at the floor
|
|
"9.9.9", // far above it
|
|
"", // none reported
|
|
} {
|
|
if worktreeClaimBlockReason(res, runtimeWithVersion(daemon, version), false) == "" {
|
|
t.Errorf("version %q was allowed to claim without advertising the capability", version)
|
|
}
|
|
}
|
|
|
|
// And the converse: a capable daemon runs regardless of how old its version
|
|
// string looks, so the gate can never strand a runtime that actually works.
|
|
for _, version := range []string{"v0.4.21-24-gcd3c0bb89", "0.0.1", ""} {
|
|
if reason := worktreeClaimBlockReason(res, runtimeWithVersion(daemon, version), true); reason != "" {
|
|
t.Errorf("version %q blocked a capable runtime: %q", version, reason)
|
|
}
|
|
}
|
|
}
|
|
|
|
// The stored-capability read backs the save-time gate and the UI, which cannot
|
|
// see the live request. Absent metadata is an older daemon: fail closed.
|
|
func TestRuntimeHasCapability(t *testing.T) {
|
|
withCaps := func(caps ...string) []byte {
|
|
raw, err := json.Marshal(map[string]any{"capabilities": caps})
|
|
if err != nil {
|
|
t.Fatalf("marshal: %v", err)
|
|
}
|
|
return raw
|
|
}
|
|
|
|
if !runtimeHasCapability(withCaps("skill-bundles-v1", "local-worktree-v1"), "local-worktree-v1") {
|
|
t.Error("advertised capability not detected")
|
|
}
|
|
if runtimeHasCapability(withCaps("skill-bundles-v1"), "local-worktree-v1") {
|
|
t.Error("unadvertised capability reported as present")
|
|
}
|
|
for _, metadata := range [][]byte{
|
|
nil,
|
|
[]byte(`{}`),
|
|
[]byte(`{"cli_version":"9.9.9"}`), // an old daemon: version, no capabilities
|
|
[]byte(`not json`),
|
|
} {
|
|
if runtimeHasCapability(metadata, "local-worktree-v1") {
|
|
t.Errorf("metadata %q reported the capability as present", string(metadata))
|
|
}
|
|
}
|
|
}
|
|
|
|
func runtimeRow(daemonID string, seenAt time.Time, caps ...string) db.AgentRuntime {
|
|
rt := db.AgentRuntime{
|
|
DaemonID: pgtype.Text{String: daemonID, Valid: daemonID != ""},
|
|
LastSeenAt: pgtype.Timestamptz{Time: seenAt, Valid: !seenAt.IsZero()},
|
|
}
|
|
payload := map[string]any{"cli_version": "9.9.9"}
|
|
if len(caps) > 0 {
|
|
payload["capabilities"] = caps
|
|
}
|
|
rt.Metadata, _ = json.Marshal(payload)
|
|
return rt
|
|
}
|
|
|
|
// Deregistering a runtime only flips the row to offline — its metadata,
|
|
// capabilities included, survives — and ListAgentRuntimes returns every row. So
|
|
// "any row advertised it" keeps answering yes long after the machine downgraded,
|
|
// and the save gate and UI would keep offering a mode the claim gate then
|
|
// refuses. Newest-seen row wins.
|
|
func TestDaemonAdvertisesWorktreeUsesNewestRow(t *testing.T) {
|
|
const daemon = "daemon-a"
|
|
older := time.Date(2026, 8, 1, 0, 0, 0, 0, time.UTC)
|
|
newer := time.Date(2026, 8, 13, 0, 0, 0, 0, time.UTC)
|
|
|
|
t.Run("stale capable row does not rescue a downgraded daemon", func(t *testing.T) {
|
|
rows := []db.AgentRuntime{
|
|
runtimeRow(daemon, older, "local-worktree-v1"), // left behind by the old capable build
|
|
runtimeRow(daemon, newer), // what the machine runs now
|
|
}
|
|
if daemonAdvertisesWorktree(rows, daemon) {
|
|
t.Error("a stale capable row was allowed to vouch for a downgraded daemon")
|
|
}
|
|
})
|
|
|
|
t.Run("newest capable row wins over an older incapable one", func(t *testing.T) {
|
|
rows := []db.AgentRuntime{
|
|
runtimeRow(daemon, older),
|
|
runtimeRow(daemon, newer, "local-worktree-v1"), // the upgrade
|
|
}
|
|
if !daemonAdvertisesWorktree(rows, daemon) {
|
|
t.Error("an upgraded daemon was not recognised")
|
|
}
|
|
})
|
|
|
|
t.Run("row order does not matter", func(t *testing.T) {
|
|
rows := []db.AgentRuntime{
|
|
runtimeRow(daemon, newer),
|
|
runtimeRow(daemon, older, "local-worktree-v1"),
|
|
}
|
|
if daemonAdvertisesWorktree(rows, daemon) {
|
|
t.Error("result depended on slice order")
|
|
}
|
|
})
|
|
|
|
t.Run("a row that never reported loses to one that did", func(t *testing.T) {
|
|
var never time.Time
|
|
rows := []db.AgentRuntime{
|
|
runtimeRow(daemon, never, "local-worktree-v1"),
|
|
runtimeRow(daemon, newer),
|
|
}
|
|
if daemonAdvertisesWorktree(rows, daemon) {
|
|
t.Error("a never-seen row outvoted a live one")
|
|
}
|
|
})
|
|
|
|
t.Run("ignores other daemons and empty ids", func(t *testing.T) {
|
|
rows := []db.AgentRuntime{runtimeRow("daemon-b", newer, "local-worktree-v1")}
|
|
if daemonAdvertisesWorktree(rows, daemon) {
|
|
t.Error("another machine's row vouched for this daemon")
|
|
}
|
|
if daemonAdvertisesWorktree(rows, "") {
|
|
t.Error("empty daemon id matched a row")
|
|
}
|
|
if daemonAdvertisesWorktree(nil, daemon) {
|
|
t.Error("no rows at all reported capable")
|
|
}
|
|
})
|
|
}
|
|
|
|
// The bridge the whole gate rests on: what the daemon advertises on the
|
|
// register request has to survive onto the runtime row, or the save gate and
|
|
// the UI read an empty capability list and refuse a machine that is perfectly
|
|
// capable. Drives the real DaemonRegister handler.
|
|
func TestDaemonRegisterPersistsCapabilities(t *testing.T) {
|
|
if testHandler == nil || testPool == nil {
|
|
t.Skip("database not available")
|
|
}
|
|
ctx := context.Background()
|
|
const daemonID = "capability-roundtrip-daemon"
|
|
|
|
register := func(t *testing.T, capabilities string) string {
|
|
t.Helper()
|
|
w := httptest.NewRecorder()
|
|
req := newDaemonTokenRequest("POST", "/api/daemon/register", map[string]any{
|
|
"workspace_id": testWorkspaceID,
|
|
"daemon_id": daemonID,
|
|
"device_name": "capability-roundtrip-device",
|
|
"runtimes": []map[string]any{
|
|
{"name": "cap-runtime", "type": "claude", "version": "1.0.0", "status": "online"},
|
|
},
|
|
}, testWorkspaceID, daemonID)
|
|
if capabilities != "" {
|
|
req.Header.Set("X-Client-Capabilities", capabilities)
|
|
} else {
|
|
req.Header.Del("X-Client-Capabilities")
|
|
}
|
|
testHandler.DaemonRegister(w, req)
|
|
if w.Code != http.StatusOK {
|
|
t.Fatalf("DaemonRegister: expected 200, got %d: %s", w.Code, w.Body.String())
|
|
}
|
|
var resp map[string]any
|
|
if err := json.NewDecoder(w.Body).Decode(&resp); err != nil {
|
|
t.Fatalf("decode: %v", err)
|
|
}
|
|
runtimes, ok := resp["runtimes"].([]any)
|
|
if !ok || len(runtimes) == 0 {
|
|
t.Fatalf("expected runtimes in response, got %v", resp)
|
|
}
|
|
id := runtimes[0].(map[string]any)["id"].(string)
|
|
t.Cleanup(func() { testPool.Exec(ctx, `DELETE FROM agent_runtime WHERE id = $1`, id) })
|
|
return id
|
|
}
|
|
|
|
assertCapable := func(t *testing.T, runtimeID string, want bool) {
|
|
t.Helper()
|
|
var metadata []byte
|
|
if err := testPool.QueryRow(ctx,
|
|
`SELECT metadata FROM agent_runtime WHERE id = $1`, runtimeID).Scan(&metadata); err != nil {
|
|
t.Fatalf("read metadata: %v", err)
|
|
}
|
|
if got := runtimeHasCapability(metadata, protocol.DaemonCapabilityLocalWorktreeV1); got != want {
|
|
t.Errorf("capability persisted = %v, want %v (metadata: %s)", got, want, metadata)
|
|
}
|
|
}
|
|
|
|
t.Run("advertised capability lands on the row", func(t *testing.T) {
|
|
id := register(t, protocol.DaemonCapabilitySkillBundlesV1+","+protocol.DaemonCapabilityLocalWorktreeV1)
|
|
assertCapable(t, id, true)
|
|
})
|
|
|
|
// An older daemon sends no header at all. Re-registering must overwrite the
|
|
// row rather than leave a capable-looking one behind — that is precisely the
|
|
// downgrade the save gate has to notice.
|
|
t.Run("re-registering without the header clears it", func(t *testing.T) {
|
|
id := register(t, protocol.DaemonCapabilitySkillBundlesV1+","+protocol.DaemonCapabilityLocalWorktreeV1)
|
|
assertCapable(t, id, true)
|
|
|
|
again := register(t, "")
|
|
if again != id {
|
|
t.Fatalf("expected the same runtime row on re-register, got %s then %s", id, again)
|
|
}
|
|
assertCapable(t, id, false)
|
|
})
|
|
}
|