stack

mosaic/stack

Fork 0

Commit Graph

Author	SHA1	Message	Date
Jason Woltje	9f3c76d43b	test(#146 ): Validate assignment cost optimization Add comprehensive cost optimization test scenarios and validation report. Test Scenarios Added (10 new tests): - Low difficulty assigns to MiniMax/GLM (free agents) - Medium difficulty assigns to GLM when within capacity - High difficulty assigns to Opus (only capable agent) - Oversized issues rejected with actionable error - Boundary conditions at capacity limits - Aggregate cost optimization across all scenarios Results: - All 33 tests passing (23 existing + 10 new) - 100% coverage of agent_assignment.py (36/36 statements) - Cost savings validation: 50%+ in aggregate scenarios - Real-world projection: 70%+ savings with typical workload Documentation: - Created cost-optimization-validation.md with detailed analysis - Documents cost savings for each scenario - Validates all acceptance criteria from COORD-006 Completes Phase 2 (M4.1-Coordinator) testing requirements. Fixes #146 Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>	2026-02-01 18:13:53 -06:00
Jason Woltje	a1b911d836	test(#143 ): Validate 50% rule prevents context exhaustion Following TDD (Red-Green-Refactor): - RED: Created comprehensive test suite with 12 test cases - GREEN: Implemented validation logic that passes all tests - All quality gates passed Test Coverage: - Oversized issue (120K) correctly rejected - Properly sized issue (80K) correctly accepted - Edge case at exactly 50% (100K) correctly accepted - Sequential issues validated individually - All agent types tested (opus, sonnet, haiku, glm, minimax) - Edge cases covered (zero, very small, boundaries) Implementation: - src/validation.py: Pure validation function - tests/test_fifty_percent_rule.py: 12 comprehensive tests - docs/50-percent-rule-validation.md: Validation report - 100% test coverage (14/14 statements) - Type checking: PASS (mypy) - Linting: PASS (ruff) The 50% rule ensures no single issue exceeds 50% of target agent's context limit, preventing context exhaustion while allowing efficient capacity utilization. Fixes #143 Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>	2026-02-01 17:56:04 -06:00

Author

SHA1

Message

Date

Jason Woltje

9f3c76d43b

test(#146 ): Validate assignment cost optimization

Add comprehensive cost optimization test scenarios and validation report.

Test Scenarios Added (10 new tests):
- Low difficulty assigns to MiniMax/GLM (free agents)
- Medium difficulty assigns to GLM when within capacity
- High difficulty assigns to Opus (only capable agent)
- Oversized issues rejected with actionable error
- Boundary conditions at capacity limits
- Aggregate cost optimization across all scenarios

Results:
- All 33 tests passing (23 existing + 10 new)
- 100% coverage of agent_assignment.py (36/36 statements)
- Cost savings validation: 50%+ in aggregate scenarios
- Real-world projection: 70%+ savings with typical workload

Documentation:
- Created cost-optimization-validation.md with detailed analysis
- Documents cost savings for each scenario
- Validates all acceptance criteria from COORD-006

Completes Phase 2 (M4.1-Coordinator) testing requirements.

Fixes #146

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>

2026-02-01 18:13:53 -06:00

Jason Woltje

a1b911d836

test(#143 ): Validate 50% rule prevents context exhaustion

Following TDD (Red-Green-Refactor):
- RED: Created comprehensive test suite with 12 test cases
- GREEN: Implemented validation logic that passes all tests
- All quality gates passed

Test Coverage:
- Oversized issue (120K) correctly rejected
- Properly sized issue (80K) correctly accepted
- Edge case at exactly 50% (100K) correctly accepted
- Sequential issues validated individually
- All agent types tested (opus, sonnet, haiku, glm, minimax)
- Edge cases covered (zero, very small, boundaries)

Implementation:
- src/validation.py: Pure validation function
- tests/test_fifty_percent_rule.py: 12 comprehensive tests
- docs/50-percent-rule-validation.md: Validation report
- 100% test coverage (14/14 statements)
- Type checking: PASS (mypy)
- Linting: PASS (ruff)

The 50% rule ensures no single issue exceeds 50% of target
agent's context limit, preventing context exhaustion while
allowing efficient capacity utilization.

Fixes #143

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>

2026-02-01 17:56:04 -06:00

2 Commits