114 lines
7.8 KiB
Plaintext
114 lines
7.8 KiB
Plaintext
TAP version 13
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r79d4b619348f","instance":"assistant","turn":"28dacfd0-08f2-4c8a-a81f-2eab0366b5c7","source":"@none","code":"baseline-unknown"}
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"rd9a130652165","instance":"assistant","turn":"cd2f2ba2-dba6-4cab-9953-253748bfa138","source":"@none","code":"baseline-unknown"}
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r42d22e1a7690","instance":"assistant","turn":"b8dd4fdd-3b64-4efe-8f8c-1949b54704c6","source":"@none","code":"baseline-unknown"}
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r050a03e595e5","instance":"assistant","turn":"dcb26a83-40f8-4da0-a43c-1f7bc3c488f8","source":"@none","code":"baseline-unknown"}
|
|
# Subtest: REQ-THREAD-2 REQ-LAUNCH-1 REQ-MSG-1 a thread message starts the thread's session, which stops when idle; its history survives the stop and a restart and no other thread sees it
|
|
ok 1 - REQ-THREAD-2 REQ-LAUNCH-1 REQ-MSG-1 a thread message starts the thread's session, which stops when idle; its history survives the stop and a restart and no other thread sees it
|
|
---
|
|
duration_ms: 5864.298755
|
|
type: 'test'
|
|
...
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r1c6c9b11e4c3","instance":"assistant","turn":"37fa2442-7e7d-47ba-8be8-51bc71314fcd","source":"@none","code":"baseline-unknown"}
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r5b180db14c3b","instance":"assistant","turn":"108dfb88-d25c-4832-b0f8-39159255c000","source":"@none","code":"baseline-unknown"}
|
|
# Subtest: REQ-THREAD-2 REQ-LAUNCH-1 a running thread counts against its model's limit and an idle-stopped one doesn't
|
|
ok 2 - REQ-THREAD-2 REQ-LAUNCH-1 a running thread counts against its model's limit and an idle-stopped one doesn't
|
|
---
|
|
duration_ms: 1706.544026
|
|
type: 'test'
|
|
...
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"rc5afea01af93","instance":"assistant","turn":"5eab0f2c-4154-4ec3-b51b-7ca007c12000","source":"@none","code":"baseline-unknown"}
|
|
# Subtest: REQ-THREAD-2 REQ-LAUNCH-1 a turn longer than the idle time isn't stopped, and the thread idles out after it
|
|
ok 3 - REQ-THREAD-2 REQ-LAUNCH-1 a turn longer than the idle time isn't stopped, and the thread idles out after it
|
|
---
|
|
duration_ms: 4403.081556
|
|
type: 'test'
|
|
...
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r74ca0384a96b","instance":"assistant","turn":"96786e42-76dc-44d8-a206-e9a87f804caa","source":"@none","code":"baseline-unknown"}
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r74ca0384a96b","instance":"assistant","turn":"102aa40e-5c6f-4c8f-a732-5ab7ab38d2cf","source":"@none","code":"baseline-unknown"}
|
|
# Subtest: REQ-THREAD-2 REQ-LAUNCH-1 a message sent after the idle snapshot keeps the session, which answers it
|
|
ok 4 - REQ-THREAD-2 REQ-LAUNCH-1 a message sent after the idle snapshot keeps the session, which answers it
|
|
---
|
|
duration_ms: 2897.388951
|
|
type: 'test'
|
|
...
|
|
# Subtest: REQ-ROLE-2 REQ-LAUNCH-1 a thread held by a run the launcher didn't start gets no second session
|
|
ok 5 - REQ-ROLE-2 REQ-LAUNCH-1 a thread held by a run the launcher didn't start gets no second session
|
|
---
|
|
duration_ms: 80.873718
|
|
type: 'test'
|
|
...
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r152b033baa9f","instance":"assistant","turn":"f7c0142e-e303-4b04-b6da-f505ce03daa8","source":"@none","code":"baseline-unknown"}
|
|
# Subtest: REQ-LAUNCH-1 a thread run's session file has no landing, even when landHolders names its instance
|
|
ok 6 - REQ-LAUNCH-1 a thread run's session file has no landing, even when landHolders names its instance
|
|
---
|
|
duration_ms: 369.994293
|
|
type: 'test'
|
|
...
|
|
# Subtest: REQ-LAUNCH-1 a run that ends without taking its thread's message isn't started again for that message
|
|
ok 7 - REQ-LAUNCH-1 a run that ends without taking its thread's message isn't started again for that message
|
|
---
|
|
duration_ms: 222.763422
|
|
type: 'test'
|
|
...
|
|
# Subtest: REQ-THREAD-2 REQ-LAUNCH-1 a thread id that isn't a safe segment, or a thread of a non-thread instance, launches nothing
|
|
ok 8 - REQ-THREAD-2 REQ-LAUNCH-1 a thread id that isn't a safe segment, or a thread of a non-thread instance, launches nothing
|
|
---
|
|
duration_ms: 220.916658
|
|
type: 'test'
|
|
...
|
|
# Subtest: REQ-THREAD-1 REQ-LAUNCH-1 the chief can't launch the assistant outside a thread
|
|
ok 9 - REQ-THREAD-1 REQ-LAUNCH-1 the chief can't launch the assistant outside a thread
|
|
---
|
|
duration_ms: 79.354174
|
|
type: 'test'
|
|
...
|
|
# Subtest: C2-09a: fromSession refuses a creative instance outside a thread without a sandbox
|
|
ok 10 - C2-09a: fromSession refuses a creative instance outside a thread without a sandbox
|
|
---
|
|
duration_ms: 74.79886
|
|
type: 'test'
|
|
...
|
|
# limits: {"event":"limit-reached","business":"acme","check":"token-limit","export":"mayLaunch","subject":{"instance":"assistant","provider":"zai","model":"claude-sonnet-5-5","account":null},"path":["tokens","instances","assistant"],"limit":0,"count":0,"unknownTurns":0}
|
|
# limits: {"event":"limit-reached","business":"acme","check":"token-limit","export":"mayLaunch","subject":{"instance":"assistant","provider":"zai","model":"claude-sonnet-5-5","account":null},"path":["tokens","instances","assistant"],"limit":0,"count":0,"unknownTurns":0}
|
|
# Subtest: REQ-LIMIT-3 REQ-LIMIT-4 a thread start whose instance is at its token limit is refused, logged once with the limit and the count
|
|
ok 11 - REQ-LIMIT-3 REQ-LIMIT-4 a thread start whose instance is at its token limit is refused, logged once with the limit and the count
|
|
---
|
|
duration_ms: 188.806504
|
|
type: 'test'
|
|
...
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r92dfbf735c99","instance":"assistant","turn":"0cce25a6-9c0f-4d94-b57b-d8039ba4d1b1","source":"@none","code":"baseline-unknown"}
|
|
# limits: {"event":"limit-reached","business":"acme","check":"token-limit","export":"mustStop","subject":{"instance":"assistant","provider":"zai","model":"claude-sonnet-5-5","account":null},"path":["tokens","instances","assistant"],"limit":0,"count":0,"unknownTurns":1}
|
|
# Subtest: REQ-LIMIT-4 a thread run at its token limit stops at the end of its turn: the reply lands, and the end record names the limit
|
|
ok 12 - REQ-LIMIT-4 a thread run at its token limit stops at the end of its turn: the reply lands, and the end record names the limit
|
|
---
|
|
duration_ms: 343.275617
|
|
type: 'test'
|
|
...
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"re4cc3406cb18","instance":"bean","turn":"bbcc0460-77b4-4c73-a3ca-8af14501024f","source":"@none","code":"baseline-unknown"}
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r8bc476441e83","instance":"chet","turn":"a0ed47c4-1b02-4c3d-9bf8-ca6dfc5d564b","source":"@none","code":"baseline-unknown"}
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"re4cc3406cb18","instance":"bean","turn":"fa11f186-f0be-492a-9983-17f3632e68b3","source":"@none","code":"baseline-unknown"}
|
|
# Subtest: C2-09a: creative thread messages start distinct runs and keep each instance history separate
|
|
ok 13 - C2-09a: creative thread messages start distinct runs and keep each instance history separate
|
|
---
|
|
duration_ms: 751.333117
|
|
type: 'test'
|
|
...
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"rf8f568dab687","instance":"bean","turn":"cd83351b-e319-4098-82be-f1eb252118e4","source":"@none","code":"baseline-unknown"}
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"rc5b6a618554a","instance":"bean","turn":"40f31a1b-9ec4-4ef7-b4d7-d06d5886801d","source":"@none","code":"baseline-unknown"}
|
|
# Subtest: C2-09a: terminating one creative thread does not signal an unselected peer of the same instance
|
|
ok 14 - C2-09a: terminating one creative thread does not signal an unselected peer of the same instance
|
|
---
|
|
duration_ms: 639.736872
|
|
type: 'test'
|
|
...
|
|
1..14
|
|
# tests 14
|
|
# suites 0
|
|
# pass 14
|
|
# fail 0
|
|
# cancelled 0
|
|
# skipped 0
|
|
# todo 0
|
|
# duration_ms 17967.821134
|