jason.woltjeandClaude Opus 5.5
17d801f482
Candidate manifest, patch against 559ef2287, build notes, five killed
mutants and the targeted gate (seat, cli, harness, two scripts).
Co-Authored-By: Claude Opus 5.5 <[email protected]>
90 lines
7.1 KiB
Plaintext
90 lines
7.1 KiB
Plaintext
✔ sessionModel: agent vars win, then the system's execution settings (13.388919ms)
|
||
✔ a pi bundle: prompt, policy, tools and manifest, 0600 in a 0700 directory (4.957742ms)
|
||
✔ a claude-code bundle adds the wrapped gate hook and the MCP config (3.179899ms)
|
||
✔ the prompt's built-in tools line is the harness's own names, as the manifest lists them (10.941028ms)
|
||
✔ the prompt names the project clones in the workspace, and none when there are none (5.284068ms)
|
||
✔ the prompt explains the review loop to a role with push_working, and reviews to one with fetch_review (8.229744ms)
|
||
✔ a bundle is written once: an existing file refuses (1.940532ms)
|
||
✔ a path with a single quote can't go into the hook command (2.289958ms)
|
||
✔ allow exits 0, a deny exits 2 with the reason on stderr (122.992526ms)
|
||
✔ a missing or wrong policy, or a bad event, exits 2 (76.129354ms)
|
||
✔ the bundle's wrapped command: a missing gate or node still blocks (1084.828943ms)
|
||
✔ claude: typed tools through MCP, the hook blocks, builtins outside --tools don't exist (729.576255ms)
|
||
✔ claude: the hook alone blocks a path outside the workspace (430.511651ms)
|
||
✔ claude: a second turn resumes the first turn's session (753.852659ms)
|
||
✔ claude adapter: --restricted is always passed (5.289167ms)
|
||
✔ claude adapter: MOSAIC_CLAUDE_BIN wins over PATH and must be an absolute executable (16.337151ms)
|
||
✔ claude adapter: a directory pin exits 2 before it runs; a pin with a space runs (5.820861ms)
|
||
✔ claude: CLAUDE.md files and auto-memory don't reach the model; without --restricted they do (686.587216ms)
|
||
✔ claude: a missing hook or MCP file refuses before claude starts (7.02235ms)
|
||
✔ pi: policy tools and typed tools pass, anything else is blocked (4.113982ms)
|
||
✔ claude: builtins map from pi names, typed tools need the mcp prefix (1.020364ms)
|
||
✔ file tool paths must resolve inside the workspace (1.831233ms)
|
||
✔ pi's own path normalisation can't be used to step out (1.373022ms)
|
||
✔ a symlink inside the workspace that points out is outside (1.153946ms)
|
||
✔ a dangling symlink is refused at any depth, in both harnesses (3.671755ms)
|
||
✔ read is checked under every spelling pi's read would open, in both harnesses (18.394307ms)
|
||
✔ other spellings cover directories, dangling links and pi's cwd (1.964912ms)
|
||
✔ a relative path climbs from the workspace's real path, in both harnesses (4.49529ms)
|
||
✔ claude path fields per tool (0.718145ms)
|
||
✔ glob patterns stay inside the workspace (0.703993ms)
|
||
✔ a path that can't be checked is blocked (0.424947ms)
|
||
✔ fetch_review's have lists the working refs before origin's, and no more than HAVE_MAX (196.618766ms)
|
||
✔ fetch_review's have orders the working refs newest first within each clone, one clone after another (119.099552ms)
|
||
✔ a runner git past its time: SIGTERM reaches its process group, and SIGKILL follows after the grace period (1809.646242ms)
|
||
✔ once a signalled runner git has closed, its group gets SIGKILL, so a process that ignored SIGTERM dies too (304.003536ms)
|
||
✔ initialize, ping and tools/list (46.906846ms)
|
||
✔ tools/call goes through the tool socket; a refusal is an isError result (35.349736ms)
|
||
✔ replies are compact JSON; over the cap a tool error names the size and the cap (35.879984ms)
|
||
✔ unknown tools and methods are JSON-RPC errors and never reach the socket (28.76647ms)
|
||
✔ a missing argument is a usage error (25.024264ms)
|
||
✔ pi: typed tools reach the socket, the gate blocks, agent_end writes the marker (349.344908ms)
|
||
✔ pi: a reply over the cap is a tool error naming the size and the cap; list_tasks asks for open tasks (319.354969ms)
|
||
✔ pi: a write through a dangling symlink is blocked, and nothing appears outside (308.562565ms)
|
||
✔ pi: a read is refused when pi would open another spelling outside (314.151651ms)
|
||
✔ pi: a relative path climbs from the real path of a workspace behind a symlink (334.644419ms)
|
||
✔ pi: a relative path climbs from the real path of a dataRoot behind a symlink (306.580142ms)
|
||
✔ pi: a missing extension refuses before any model call (5.456278ms)
|
||
✔ pi: an extension without its configuration fails pi's start (246.034351ms)
|
||
✔ founderCheck: founder variables, then a needed service without a usable token (1.422188ms)
|
||
✔ turnRequest names the sender, class, reply and decision (0.197563ms)
|
||
✔ turnRequest says a tester's message is a test and never Jason's instruction (0.231275ms)
|
||
✔ turnRequest shows the message's own sent time, a day old as well as new (0.147162ms)
|
||
✔ stateBlock names the launch state with its time and event, and the open tasks with the cap (0.252965ms)
|
||
✔ a message becomes a turn, the answer goes back as a RESULT, SIGTERM releases and exits 0 (255.888805ms)
|
||
✔ launches revoked and then restored: the turn's block reads allowed and gives the restore time (257.756985ms)
|
||
✔ a task closed on the tracker is missing from the next turn's open list (219.445431ms)
|
||
✔ a message read a day after it was sent shows the time it was sent (167.336712ms)
|
||
✔ a decision the human resolves becomes a turn citing the decision and the answer (203.891433ms)
|
||
✔ a failed state read fails the turn: no adapter runs, the sender hears why, the message is read (115.1135ms)
|
||
✔ a SIGTERM before the claim stops the runner with exit 0 and no claim (108.725818ms)
|
||
✔ typed tools carry the runner's capability; launch goes to the host's launch socket (419.152882ms)
|
||
✔ a RESULT gets no automatic reply; failed turns reply with the reason (1288.462209ms)
|
||
✔ SIGTERM during a turn kills the turn's process group and still exits 0 (152.260188ms)
|
||
✔ founder credentials stop before the claim (20) (166.766001ms)
|
||
✔ a refused claim exits 21; an ended run's capability exits 22 (188.897227ms)
|
||
✔ the launch ending under a running session exits 22 (140.151923ms)
|
||
✔ a broker that stays unreachable exits 23 after brokerRetries polls (245.04999ms)
|
||
✔ a broker that is down at the claim exits 23, not 21 (82.772596ms)
|
||
✔ no capability, or a malformed one, on stdin exits 2 (185.203599ms)
|
||
✔ a missing or malformed policy exits 2 before the claim (127.284485ms)
|
||
✔ the PM gets launch, its task verbs and the reads (7.927721ms)
|
||
✔ list_requirements reads the requirement ids, for a task.create holder with a tracker (6.071965ms)
|
||
✔ a coder gets no launch, no resolve_decision, and no task tools without a tracker (1.510724ms)
|
||
✔ a coder with a tracker gets its own task tools and no task_reassign (2.103048ms)
|
||
✔ launch only when the business's launch block names the instance as launcher (1.951486ms)
|
||
✔ an action outside the instance's authority has no tool (2.221092ms)
|
||
✔ the review loop: push_working and request_review for the coder, fetch_review and review_verdict for the reviewer, none for the PM (5.375561ms)
|
||
✔ callTool: one JSON line out, the result back, a refusal rejects (9.511834ms)
|
||
✔ list_tasks takes the broker's filters and pages; get_task takes a task_ref (2.599688ms)
|
||
✔ callTool sends list_tasks done false unless the session names done; other tools as given (2.608257ms)
|
||
✔ replyText: compact JSON up to the cap, an error naming the size and the cap over it (0.719176ms)
|
||
ℹ tests 81
|
||
ℹ suites 0
|
||
ℹ pass 81
|
||
ℹ fail 0
|
||
ℹ cancelled 0
|
||
ℹ skipped 0
|
||
ℹ todo 0
|
||
ℹ duration_ms 11306.047886
|