114 lines
7.8 KiB
Plaintext
114 lines
7.8 KiB
Plaintext
TAP version 13
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r4b15c3383579","instance":"assistant","turn":"24879825-b4c6-43b8-80ac-54691efb9652","source":"@none","code":"baseline-unknown"}
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r7cf647f9cf44","instance":"assistant","turn":"f7a5f9f4-603a-481e-a6fc-1fa6c74d53bb","source":"@none","code":"baseline-unknown"}
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r3b88e384d56d","instance":"assistant","turn":"2d191c05-6495-4da5-98fc-378dff33489b","source":"@none","code":"baseline-unknown"}
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"rf6a9176bda2a","instance":"assistant","turn":"c0d587c3-ed2d-4961-9338-8085f7c86b01","source":"@none","code":"baseline-unknown"}
|
|
# Subtest: REQ-THREAD-2 REQ-LAUNCH-1 REQ-MSG-1 a thread message starts the thread's session, which stops when idle; its history survives the stop and a restart and no other thread sees it
|
|
ok 1 - REQ-THREAD-2 REQ-LAUNCH-1 REQ-MSG-1 a thread message starts the thread's session, which stops when idle; its history survives the stop and a restart and no other thread sees it
|
|
---
|
|
duration_ms: 5855.389904
|
|
type: 'test'
|
|
...
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r450facde04f6","instance":"assistant","turn":"2b766103-a530-4c8f-89a0-c51cdddde0c4","source":"@none","code":"baseline-unknown"}
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r2d7e65f09e3b","instance":"assistant","turn":"4a105f94-1fde-4b68-8970-7c82f3dc709b","source":"@none","code":"baseline-unknown"}
|
|
# Subtest: REQ-THREAD-2 REQ-LAUNCH-1 a running thread counts against its model's limit and an idle-stopped one doesn't
|
|
ok 2 - REQ-THREAD-2 REQ-LAUNCH-1 a running thread counts against its model's limit and an idle-stopped one doesn't
|
|
---
|
|
duration_ms: 1695.313738
|
|
type: 'test'
|
|
...
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"rf101bf08aad9","instance":"assistant","turn":"1ef8bb0f-81c1-4237-beb6-eb0a0ea1febd","source":"@none","code":"baseline-unknown"}
|
|
# Subtest: REQ-THREAD-2 REQ-LAUNCH-1 a turn longer than the idle time isn't stopped, and the thread idles out after it
|
|
ok 3 - REQ-THREAD-2 REQ-LAUNCH-1 a turn longer than the idle time isn't stopped, and the thread idles out after it
|
|
---
|
|
duration_ms: 4398.514721
|
|
type: 'test'
|
|
...
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r7f72b25838f8","instance":"assistant","turn":"498c374b-74b9-4381-9bcb-43d3061cfc91","source":"@none","code":"baseline-unknown"}
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r7f72b25838f8","instance":"assistant","turn":"664083b8-4b6a-48d7-b60b-ff069e32df7d","source":"@none","code":"baseline-unknown"}
|
|
# Subtest: REQ-THREAD-2 REQ-LAUNCH-1 a message sent after the idle snapshot keeps the session, which answers it
|
|
ok 4 - REQ-THREAD-2 REQ-LAUNCH-1 a message sent after the idle snapshot keeps the session, which answers it
|
|
---
|
|
duration_ms: 2884.283906
|
|
type: 'test'
|
|
...
|
|
# Subtest: REQ-ROLE-2 REQ-LAUNCH-1 a thread held by a run the launcher didn't start gets no second session
|
|
ok 5 - REQ-ROLE-2 REQ-LAUNCH-1 a thread held by a run the launcher didn't start gets no second session
|
|
---
|
|
duration_ms: 84.403304
|
|
type: 'test'
|
|
...
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r3e4103cb2b17","instance":"assistant","turn":"2a51193c-b587-4243-bb74-dab75f56d709","source":"@none","code":"baseline-unknown"}
|
|
# Subtest: REQ-LAUNCH-1 a thread run's session file has no landing, even when landHolders names its instance
|
|
ok 6 - REQ-LAUNCH-1 a thread run's session file has no landing, even when landHolders names its instance
|
|
---
|
|
duration_ms: 376.315296
|
|
type: 'test'
|
|
...
|
|
# Subtest: REQ-LAUNCH-1 a run that ends without taking its thread's message isn't started again for that message
|
|
ok 7 - REQ-LAUNCH-1 a run that ends without taking its thread's message isn't started again for that message
|
|
---
|
|
duration_ms: 220.889945
|
|
type: 'test'
|
|
...
|
|
# Subtest: REQ-THREAD-2 REQ-LAUNCH-1 a thread id that isn't a safe segment, or a thread of a non-thread instance, launches nothing
|
|
ok 8 - REQ-THREAD-2 REQ-LAUNCH-1 a thread id that isn't a safe segment, or a thread of a non-thread instance, launches nothing
|
|
---
|
|
duration_ms: 221.278128
|
|
type: 'test'
|
|
...
|
|
# Subtest: REQ-THREAD-1 REQ-LAUNCH-1 the chief can't launch the assistant outside a thread
|
|
ok 9 - REQ-THREAD-1 REQ-LAUNCH-1 the chief can't launch the assistant outside a thread
|
|
---
|
|
duration_ms: 79.727904
|
|
type: 'test'
|
|
...
|
|
# Subtest: C2-09a: fromSession refuses a creative instance outside a thread without a sandbox
|
|
ok 10 - C2-09a: fromSession refuses a creative instance outside a thread without a sandbox
|
|
---
|
|
duration_ms: 75.969621
|
|
type: 'test'
|
|
...
|
|
# limits: {"event":"limit-reached","business":"acme","check":"token-limit","export":"mayLaunch","subject":{"instance":"assistant","provider":"zai","model":"claude-sonnet-5-5","account":null},"path":["tokens","instances","assistant"],"limit":0,"count":0,"unknownTurns":0}
|
|
# limits: {"event":"limit-reached","business":"acme","check":"token-limit","export":"mayLaunch","subject":{"instance":"assistant","provider":"zai","model":"claude-sonnet-5-5","account":null},"path":["tokens","instances","assistant"],"limit":0,"count":0,"unknownTurns":0}
|
|
# Subtest: REQ-LIMIT-3 REQ-LIMIT-4 a thread start whose instance is at its token limit is refused, logged once with the limit and the count
|
|
ok 11 - REQ-LIMIT-3 REQ-LIMIT-4 a thread start whose instance is at its token limit is refused, logged once with the limit and the count
|
|
---
|
|
duration_ms: 193.192129
|
|
type: 'test'
|
|
...
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r398834dd538d","instance":"assistant","turn":"f93e47a7-c34e-4f1e-9660-6dd5d4721769","source":"@none","code":"baseline-unknown"}
|
|
# limits: {"event":"limit-reached","business":"acme","check":"token-limit","export":"mustStop","subject":{"instance":"assistant","provider":"zai","model":"claude-sonnet-5-5","account":null},"path":["tokens","instances","assistant"],"limit":0,"count":0,"unknownTurns":1}
|
|
# Subtest: REQ-LIMIT-4 a thread run at its token limit stops at the end of its turn: the reply lands, and the end record names the limit
|
|
ok 12 - REQ-LIMIT-4 a thread run at its token limit stops at the end of its turn: the reply lands, and the end record names the limit
|
|
---
|
|
duration_ms: 342.658374
|
|
type: 'test'
|
|
...
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r2ac81e778687","instance":"bean","turn":"ebcc3d2b-dbd0-4e17-8138-787637b9de3e","source":"@none","code":"baseline-unknown"}
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r627d5c3d849a","instance":"chet","turn":"f1337595-adab-453f-9471-cfed4282dfd2","source":"@none","code":"baseline-unknown"}
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r2ac81e778687","instance":"bean","turn":"72ac65c8-8155-4bbd-8145-d6cf4a87e72b","source":"@none","code":"baseline-unknown"}
|
|
# Subtest: C2-09a: creative thread messages start distinct runs and keep each instance history separate
|
|
ok 13 - C2-09a: creative thread messages start distinct runs and keep each instance history separate
|
|
---
|
|
duration_ms: 748.834963
|
|
type: 'test'
|
|
...
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"raa6e978a45fa","instance":"bean","turn":"1994f6c6-7527-4b16-9085-72d85e55ad2b","source":"@none","code":"baseline-unknown"}
|
|
# usage: {"event":"usage-unknown","business":"acme","run":"r0a0890a25253","instance":"bean","turn":"be326fe9-22b4-4d7c-8316-0398769cf36d","source":"@none","code":"baseline-unknown"}
|
|
# Subtest: C2-09a: terminating one creative thread does not signal an unselected peer of the same instance
|
|
ok 14 - C2-09a: terminating one creative thread does not signal an unselected peer of the same instance
|
|
---
|
|
duration_ms: 641.219375
|
|
type: 'test'
|
|
...
|
|
1..14
|
|
# tests 14
|
|
# suites 0
|
|
# pass 14
|
|
# fail 0
|
|
# cancelled 0
|
|
# skipped 0
|
|
# todo 0
|
|
# duration_ms 17946.600416
|