mosaic/stack
1
0
Fork 0
Code Issues 10 Pull Requests 1 Actions Packages Projects Releases 2 Wiki Activity

test(#229): Add performance test suite for orchestrator #334

Merged
jason.woltje merged 3 commits from feature/229-performance-testing into develop 2026-02-05 19:33:17 +00:00
Conversation 0 Commits 3 Files Changed 5 +451
jason.woltje commented 2026-02-05 18:53:03 +00:00
Owner
Copy Link

Summary

  • 14 performance benchmarks across 3 test files
  • Spawner throughput: spawn latency, concurrent spawns, session lookup, memory efficiency
  • Queue service: backoff calculation throughput, validation performance
  • Secret scanner: content scanning throughput, pattern matching scalability
  • Adds test:perf script to package.json

Test Plan

  • All 14 performance tests pass
  • Lint passes (0 warnings)
  • TypeScript type check passes

Fixes #229

## Summary - 14 performance benchmarks across 3 test files - Spawner throughput: spawn latency, concurrent spawns, session lookup, memory efficiency - Queue service: backoff calculation throughput, validation performance - Secret scanner: content scanning throughput, pattern matching scalability - Adds `test:perf` script to package.json ## Test Plan - [x] All 14 performance tests pass - [x] Lint passes (0 warnings) - [x] TypeScript type check passes Fixes #229
jason.woltje added 1 commit 2026-02-05 18:53:04 +00:00
test(#229): Add performance test suite for orchestrator
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
Details
ci/woodpecker/pr/woodpecker Pipeline failed
Details
b93f4c59ce 
Add 14 performance benchmarks across 3 test files:
- Spawner throughput: single/sequential/concurrent spawn latency,
  session lookup, list performance, memory efficiency
- Queue service: backoff calculation throughput, validation perf
- Secret scanner: content scanning throughput, pattern scalability

Adds test:perf script to package.json.

Fixes #229

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
jason.woltje added 1 commit 2026-02-05 19:23:45 +00:00
fix(#229): Remediate code review findings for performance tests
Some checks failed
ci/woodpecker/push/woodpecker Pipeline failed
Details
ci/woodpecker/pr/woodpecker Pipeline failed
Details
0796cbc744 
- Fix CRITICAL: Increase single-spawn threshold from 10ms to 50ms (CI flakiness)
- Fix CRITICAL: Replace no-op validation test with real backoff scale tests
- Fix IMPORTANT: Add warmup iterations before all timed measurements
- Fix IMPORTANT: Increase scan position ratio tolerance to 10x for sub-ms noise
- Refactored queue perf tests to use actual service methods (calculateBackoffDelay)
- Helper function to reduce spawn request duplication

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
jason.woltje added 1 commit 2026-02-05 19:33:09 +00:00
Merge branch 'develop' into feature/229-performance-testing
Some checks are pending
ci/woodpecker/push/woodpecker Pipeline is pending
Details
ci/woodpecker/pr/woodpecker Pipeline is pending
Details
7bc37fc513
jason.woltje merged commit 670809afdb into develop 2026-02-05 19:33:17 +00:00
jason.woltje deleted branch feature/229-performance-testing 2026-02-05 19:33:17 +00:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
Clear labels
ai
AI/LLM integration
 api
Backend/API work
 api
auth
Authentication
 database
database
Database/schema work
 devops
Docker/deployment
 docs
Documentation
 frontend
graph
knowledge-module
migration
Data migration
 orchestrator
Orchestrator service (apps/orchestrator/)
 p0
Critical priority
 p1
High priority
 p2
Medium priority
 p3
Low priority
 performance
Performance work
 phase-1
phase-2
phase-3
phase-4
phase-5
plugin
MoltBot plugin work
 search
security
Security-related
 setup
Initial setup
 testing
Testing/QA
 web
Frontend work
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
jason.woltje
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: mosaic/stack#334
Delete Branch "feature/229-performance-testing"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?