[COORD-006] Test assignment scenarios #146

Closed
opened 2026-01-31 21:03:49 +00:00 by jason.woltje · 0 comments
Owner

Objective

Validate agent assignment algorithm optimizes cost through comprehensive test scenarios.

Implementation Details

Test all assignment scenarios from Part 1:

Test cases required:

  • Low difficulty issue should assign MiniMax or Haiku (free/cheap)
  • Medium difficulty issue should assign GLM when capable (free)
  • High difficulty issue should assign Opus (only capable agent)
  • Oversized issue should reject (no agent has capacity)

Document cost savings achieved by assignment optimization.

Context Estimate

  • Files to modify: 2 (test file, validation report)
  • Implementation complexity: low (10,000 tokens)
  • Test requirements: high (15,000 tokens)
  • Documentation: medium (3,000 tokens)
  • Total estimated: 40,300 tokens
  • Recommended agent: glm

Difficulty

low

Dependencies

  • Blocked by: #149 (COORD-005)

Acceptance Criteria

  • Test: Low difficulty assigns to cheapest capable agent
  • Test: Medium difficulty assigns to GLM (self-hosted preference)
  • Test: High difficulty assigns to Opus (only capable)
  • Test: Oversized issue rejected
  • Cost savings report documenting optimization effectiveness
  • All assignment paths tested (100% success rate)
  • Tests pass (85% coverage minimum)

Testing Requirements

  • Create test issues for each difficulty level
  • Validate correct agent assignment
  • Measure and document cost savings
  • Test edge cases and error conditions
  • Coverage: 85% minimum
## Objective Validate agent assignment algorithm optimizes cost through comprehensive test scenarios. ## Implementation Details Test all assignment scenarios from Part 1: Test cases required: - Low difficulty issue should assign MiniMax or Haiku (free/cheap) - Medium difficulty issue should assign GLM when capable (free) - High difficulty issue should assign Opus (only capable agent) - Oversized issue should reject (no agent has capacity) Document cost savings achieved by assignment optimization. ## Context Estimate - Files to modify: 2 (test file, validation report) - Implementation complexity: low (10,000 tokens) - Test requirements: high (15,000 tokens) - Documentation: medium (3,000 tokens) - **Total estimated: 40,300 tokens** - **Recommended agent: glm** ## Difficulty low ## Dependencies - Blocked by: #149 (COORD-005) ## Acceptance Criteria - [ ] Test: Low difficulty assigns to cheapest capable agent - [ ] Test: Medium difficulty assigns to GLM (self-hosted preference) - [ ] Test: High difficulty assigns to Opus (only capable) - [ ] Test: Oversized issue rejected - [ ] Cost savings report documenting optimization effectiveness - [ ] All assignment paths tested (100% success rate) - [ ] Tests pass (85% coverage minimum) ## Testing Requirements - Create test issues for each difficulty level - Validate correct agent assignment - Measure and document cost savings - Test edge cases and error conditions - Coverage: 85% minimum
jason.woltje added the phase-2apiapip0 labels 2026-01-31 21:03:49 +00:00
jason.woltje added this to the M4.1-Coordinator (0.0.4) milestone 2026-01-31 21:10:03 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: mosaic/stack#146