jason.woltjeandClaude Opus 5.5
1e3575be66
Round 3 candidate on 26a0b0fab, manifest digest 75e07b65...47d1, 42
paths, with the runtime.mjs project adapter Sage approved in sage-0488.
Rocko's run: 747 package tests passed, 54/54 mutants killed. Packet
scanned for secrets and binaries, none found.
Co-Authored-By: Claude Opus 5.5 <[email protected]>
276 lines
12 KiB
Plaintext
276 lines
12 KiB
Plaintext
✖ the PM gets its task verbs and the reads, and no launch (6.771468ms)
|
||
✖ the chief of staff gets launch, send_message, end_run and change_organization, and no task verbs (2.250286ms)
|
||
✔ request_staff is the pm's alone: staff.request over message.send, roles and counts bounded (7.316382ms)
|
||
✔ end_run sends role and reason, no decision; change_organization sends revision and the organization keys (1.242897ms)
|
||
✔ the organization keys change_organization takes are the broker's ORGANIZATION_KEYS (0.090135ms)
|
||
✔ a role without role.end or organization.change gets neither tool, and each tool follows its own grant (5.087481ms)
|
||
✖ the assistant gets send_message, the reads and the web tools (it holds the web grant), no launch (1.006576ms)
|
||
✔ list_requirements reads the requirement ids, for a task.create holder with a tracker (1.635595ms)
|
||
✖ a coder gets no launch, no resolve_decision, and no task tools without a tracker (0.869549ms)
|
||
✖ a coder with a tracker gets its own task tools and no task_reassign (0.922462ms)
|
||
✔ launch only when the business's launch block names the instance as launcher (1.529053ms)
|
||
✖ an action outside the instance's authority has no tool (0.991289ms)
|
||
✖ the review loop: push_working and request_review for the coder, fetch_review and review_verdict for the reviewer, none for the PM (1.045234ms)
|
||
✔ callTool: one JSON line out, the result back, a refusal rejects (9.60071ms)
|
||
✔ list_tasks takes the broker's filters and pages; get_task takes a task_ref (1.806843ms)
|
||
✔ callTool sends list_tasks done false unless the session names done; other tools as given (1.833478ms)
|
||
✔ replyText: compact JSON up to the cap, an error naming the size and the cap over it (0.453321ms)
|
||
✔ web_search's query maxLength is the web layer's SEARCH_MAX_QUERY_CHARS (1.988839ms)
|
||
ℹ tests 18
|
||
ℹ suites 0
|
||
ℹ pass 11
|
||
ℹ fail 7
|
||
ℹ cancelled 0
|
||
ℹ skipped 0
|
||
ℹ todo 0
|
||
ℹ duration_ms 119.448179
|
||
|
||
✖ failing tests:
|
||
|
||
test at packages/harness/tests/tools.test.mjs:9:1
|
||
✖ the PM gets its task verbs and the reads, and no launch (6.771468ms)
|
||
AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
|
||
+ actual - expected
|
||
... Skipped lines
|
||
|
||
[
|
||
'send_message',
|
||
'request_staff',
|
||
'task_create',
|
||
'task_assign',
|
||
...
|
||
'task_close',
|
||
+ 'read_spec',
|
||
+ 'write_record',
|
||
'raise_decision',
|
||
'resolve_decision',
|
||
'list_agents',
|
||
'inbox',
|
||
'trail',
|
||
|
||
at TestContext.<anonymous> (file:///mnt/storage/src/mosaic-stack-rocko-138-r3/packages/harness/tests/tools.test.mjs:12:10)
|
||
at Test.runInAsyncScope (node:async_hooks:226:14)
|
||
at Test.run (node:internal/test_runner/test:1402:25)
|
||
at Test.start (node:internal/test_runner/test:1262:17)
|
||
at startSubtestAfterBootstrap (node:internal/test_runner/harness:387:17) {
|
||
generatedMessage: true,
|
||
code: 'ERR_ASSERTION',
|
||
actual: [
|
||
'send_message', 'request_staff',
|
||
'task_create', 'task_assign',
|
||
'task_reassign', 'task_schedule',
|
||
'task_priority_change', 'task_scope_change',
|
||
'task_update_assigned', 'task_close',
|
||
'read_spec', 'write_record',
|
||
'raise_decision', 'resolve_decision',
|
||
'list_agents', 'inbox',
|
||
'trail', 'list_tasks',
|
||
'get_task', 'list_requirements'
|
||
],
|
||
expected: [
|
||
'send_message', 'request_staff',
|
||
'task_create', 'task_assign',
|
||
'task_reassign', 'task_schedule',
|
||
'task_priority_change', 'task_scope_change',
|
||
'task_update_assigned', 'task_close',
|
||
'raise_decision', 'resolve_decision',
|
||
'list_agents', 'inbox',
|
||
'trail', 'list_tasks',
|
||
'get_task', 'list_requirements'
|
||
],
|
||
operator: 'deepStrictEqual',
|
||
diff: 'simple'
|
||
}
|
||
|
||
test at packages/harness/tests/tools.test.mjs:33:1
|
||
✖ the chief of staff gets launch, send_message, end_run and change_organization, and no task verbs (2.250286ms)
|
||
AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
|
||
+ actual - expected
|
||
|
||
[
|
||
'send_message',
|
||
'launch',
|
||
'end_run',
|
||
'change_organization',
|
||
+ 'read_spec',
|
||
+ 'write_record',
|
||
'raise_decision',
|
||
'list_agents',
|
||
'inbox',
|
||
'trail',
|
||
'list_tasks',
|
||
|
||
at TestContext.<anonymous> (file:///mnt/storage/src/mosaic-stack-rocko-138-r3/packages/harness/tests/tools.test.mjs:36:10)
|
||
at Test.runInAsyncScope (node:async_hooks:226:14)
|
||
at Test.run (node:internal/test_runner/test:1402:25)
|
||
at Test.processPendingSubtests (node:internal/test_runner/test:974:18)
|
||
at Test.postRun (node:internal/test_runner/test:1542:19)
|
||
at Test.run (node:internal/test_runner/test:1467:12)
|
||
at async startSubtestAfterBootstrap (node:internal/test_runner/harness:387:3) {
|
||
generatedMessage: true,
|
||
code: 'ERR_ASSERTION',
|
||
actual: [ 'send_message', 'launch', 'end_run', 'change_organization', 'read_spec', 'write_record', 'raise_decision', 'list_agents', 'inbox', 'trail', 'list_tasks', 'get_task' ],
|
||
expected: [ 'send_message', 'launch', 'end_run', 'change_organization', 'raise_decision', 'list_agents', 'inbox', 'trail', 'list_tasks', 'get_task' ],
|
||
operator: 'deepStrictEqual',
|
||
diff: 'simple'
|
||
}
|
||
|
||
test at packages/harness/tests/tools.test.mjs:110:1
|
||
✖ the assistant gets send_message, the reads and the web tools (it holds the web grant), no launch (1.006576ms)
|
||
AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
|
||
+ actual - expected
|
||
|
||
[
|
||
'send_message',
|
||
'web_search',
|
||
'web_fetch',
|
||
+ 'read_spec',
|
||
+ 'write_record',
|
||
'raise_decision',
|
||
'list_agents',
|
||
'inbox',
|
||
'trail',
|
||
'list_tasks',
|
||
|
||
at TestContext.<anonymous> (file:///mnt/storage/src/mosaic-stack-rocko-138-r3/packages/harness/tests/tools.test.mjs:113:10)
|
||
at Test.runInAsyncScope (node:async_hooks:226:14)
|
||
at Test.run (node:internal/test_runner/test:1402:25)
|
||
at Test.processPendingSubtests (node:internal/test_runner/test:974:18)
|
||
at Test.postRun (node:internal/test_runner/test:1542:19)
|
||
at Test.run (node:internal/test_runner/test:1467:12)
|
||
at async Test.processPendingSubtests (node:internal/test_runner/test:974:7) {
|
||
generatedMessage: true,
|
||
code: 'ERR_ASSERTION',
|
||
actual: [ 'send_message', 'web_search', 'web_fetch', 'read_spec', 'write_record', 'raise_decision', 'list_agents', 'inbox', 'trail', 'list_tasks', 'get_task' ],
|
||
expected: [ 'send_message', 'web_search', 'web_fetch', 'raise_decision', 'list_agents', 'inbox', 'trail', 'list_tasks', 'get_task' ],
|
||
operator: 'deepStrictEqual',
|
||
diff: 'simple'
|
||
}
|
||
|
||
test at packages/harness/tests/tools.test.mjs:144:1
|
||
✖ a coder gets no launch, no resolve_decision, and no task tools without a tracker (0.869549ms)
|
||
AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
|
||
+ actual - expected
|
||
|
||
[
|
||
'send_message',
|
||
'request_review',
|
||
+ 'read_spec',
|
||
+ 'write_record',
|
||
'raise_decision',
|
||
'list_agents',
|
||
'inbox',
|
||
'trail'
|
||
]
|
||
|
||
at TestContext.<anonymous> (file:///mnt/storage/src/mosaic-stack-rocko-138-r3/packages/harness/tests/tools.test.mjs:147:10)
|
||
at Test.runInAsyncScope (node:async_hooks:226:14)
|
||
at Test.run (node:internal/test_runner/test:1402:25)
|
||
at Test.processPendingSubtests (node:internal/test_runner/test:974:18)
|
||
at Test.postRun (node:internal/test_runner/test:1542:19)
|
||
at Test.run (node:internal/test_runner/test:1467:12)
|
||
at async Test.processPendingSubtests (node:internal/test_runner/test:974:7) {
|
||
generatedMessage: true,
|
||
code: 'ERR_ASSERTION',
|
||
actual: [ 'send_message', 'request_review', 'read_spec', 'write_record', 'raise_decision', 'list_agents', 'inbox', 'trail' ],
|
||
expected: [ 'send_message', 'request_review', 'raise_decision', 'list_agents', 'inbox', 'trail' ],
|
||
operator: 'deepStrictEqual',
|
||
diff: 'simple'
|
||
}
|
||
|
||
test at packages/harness/tests/tools.test.mjs:153:1
|
||
✖ a coder with a tracker gets its own task tools and no task_reassign (0.922462ms)
|
||
AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
|
||
+ actual - expected
|
||
|
||
[
|
||
'send_message',
|
||
'task_scope_change',
|
||
'task_update_assigned',
|
||
'request_review',
|
||
+ 'read_spec',
|
||
+ 'write_record',
|
||
'raise_decision',
|
||
'list_agents',
|
||
'inbox',
|
||
'trail',
|
||
'list_tasks',
|
||
|
||
at TestContext.<anonymous> (file:///mnt/storage/src/mosaic-stack-rocko-138-r3/packages/harness/tests/tools.test.mjs:155:10)
|
||
at Test.runInAsyncScope (node:async_hooks:226:14)
|
||
at Test.run (node:internal/test_runner/test:1402:25)
|
||
at Test.processPendingSubtests (node:internal/test_runner/test:974:18)
|
||
at Test.postRun (node:internal/test_runner/test:1542:19)
|
||
at Test.run (node:internal/test_runner/test:1467:12)
|
||
at async Test.processPendingSubtests (node:internal/test_runner/test:974:7) {
|
||
generatedMessage: true,
|
||
code: 'ERR_ASSERTION',
|
||
actual: [ 'send_message', 'task_scope_change', 'task_update_assigned', 'request_review', 'read_spec', 'write_record', 'raise_decision', 'list_agents', 'inbox', 'trail', 'list_tasks', 'get_task' ],
|
||
expected: [ 'send_message', 'task_scope_change', 'task_update_assigned', 'request_review', 'raise_decision', 'list_agents', 'inbox', 'trail', 'list_tasks', 'get_task' ],
|
||
operator: 'deepStrictEqual',
|
||
diff: 'simple'
|
||
}
|
||
|
||
test at packages/harness/tests/tools.test.mjs:168:1
|
||
✖ an action outside the instance's authority has no tool (0.991289ms)
|
||
AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
|
||
+ actual - expected
|
||
|
||
[
|
||
'request_review',
|
||
+ 'read_spec',
|
||
'raise_decision',
|
||
'list_agents',
|
||
'inbox',
|
||
'trail',
|
||
'list_tasks',
|
||
|
||
at TestContext.<anonymous> (file:///mnt/storage/src/mosaic-stack-rocko-138-r3/packages/harness/tests/tools.test.mjs:170:10)
|
||
at Test.runInAsyncScope (node:async_hooks:226:14)
|
||
at Test.run (node:internal/test_runner/test:1402:25)
|
||
at Test.processPendingSubtests (node:internal/test_runner/test:974:18)
|
||
at Test.postRun (node:internal/test_runner/test:1542:19)
|
||
at Test.run (node:internal/test_runner/test:1467:12)
|
||
at async Test.processPendingSubtests (node:internal/test_runner/test:974:7) {
|
||
generatedMessage: true,
|
||
code: 'ERR_ASSERTION',
|
||
actual: [ 'request_review', 'read_spec', 'raise_decision', 'list_agents', 'inbox', 'trail', 'list_tasks', 'get_task' ],
|
||
expected: [ 'request_review', 'raise_decision', 'list_agents', 'inbox', 'trail', 'list_tasks', 'get_task' ],
|
||
operator: 'deepStrictEqual',
|
||
diff: 'simple'
|
||
}
|
||
|
||
test at packages/harness/tests/tools.test.mjs:174:1
|
||
✖ the review loop: push_working and request_review for the coder, fetch_review and review_verdict for the reviewer, none for the PM (1.045234ms)
|
||
AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
|
||
+ actual - expected
|
||
|
||
[
|
||
'send_message',
|
||
'task_scope_change',
|
||
'task_update_assigned',
|
||
'push_working',
|
||
'request_review',
|
||
+ 'read_spec',
|
||
+ 'write_record',
|
||
'raise_decision',
|
||
'list_agents',
|
||
'inbox',
|
||
'trail',
|
||
'list_tasks',
|
||
|
||
at TestContext.<anonymous> (file:///mnt/storage/src/mosaic-stack-rocko-138-r3/packages/harness/tests/tools.test.mjs:177:10)
|
||
at Test.runInAsyncScope (node:async_hooks:226:14)
|
||
at Test.run (node:internal/test_runner/test:1402:25)
|
||
at Test.processPendingSubtests (node:internal/test_runner/test:974:18)
|
||
at Test.postRun (node:internal/test_runner/test:1542:19)
|
||
at Test.run (node:internal/test_runner/test:1467:12)
|
||
at async Test.processPendingSubtests (node:internal/test_runner/test:974:7) {
|
||
generatedMessage: true,
|
||
code: 'ERR_ASSERTION',
|
||
actual: [ 'send_message', 'task_scope_change', 'task_update_assigned', 'push_working', 'request_review', 'read_spec', 'write_record', 'raise_decision', 'list_agents', 'inbox', 'trail', 'list_tasks', 'get_task' ],
|
||
expected: [ 'send_message', 'task_scope_change', 'task_update_assigned', 'push_working', 'request_review', 'raise_decision', 'list_agents', 'inbox', 'trail', 'list_tasks', 'get_task' ],
|
||
operator: 'deepStrictEqual',
|
||
diff: 'simple'
|
||
}
|