E2E integration tests for speech services #405

Closed
opened 2026-02-15 07:35:41 +00:00 by jason.woltje · 1 comment
Owner

Description

Create end-to-end integration tests that verify the full speech pipeline from API endpoints through to external providers.

Test Scenarios

  1. Transcribe audio file via REST endpoint
  2. Synthesize text via REST endpoint
  3. Provider fallback (mock premium failure then default succeeds)
  4. WebSocket streaming transcription
  5. Audio format validation (accept valid, reject invalid)
  6. File size limit enforcement
  7. Authentication required for all endpoints
  8. Provider health check

Test Infrastructure

  • Use test audio files (short clips, various formats)
  • Mock external providers in CI (no real Speaches/Kokoro in pipeline)
  • Integration test with real providers for local development

Acceptance Criteria

  • REST transcription tests
  • REST synthesis tests
  • WebSocket streaming tests
  • Provider fallback tests
  • Validation tests
  • Auth tests
  • CI-compatible (mocked providers)
  • Local dev tests (real providers via docker compose)
## Description Create end-to-end integration tests that verify the full speech pipeline from API endpoints through to external providers. ## Test Scenarios 1. Transcribe audio file via REST endpoint 2. Synthesize text via REST endpoint 3. Provider fallback (mock premium failure then default succeeds) 4. WebSocket streaming transcription 5. Audio format validation (accept valid, reject invalid) 6. File size limit enforcement 7. Authentication required for all endpoints 8. Provider health check ## Test Infrastructure - Use test audio files (short clips, various formats) - Mock external providers in CI (no real Speaches/Kokoro in pipeline) - Integration test with real providers for local development ## Acceptance Criteria - [ ] REST transcription tests - [ ] REST synthesis tests - [ ] WebSocket streaming tests - [ ] Provider fallback tests - [ ] Validation tests - [ ] Auth tests - [ ] CI-compatible (mocked providers) - [ ] Local dev tests (real providers via docker compose)
jason.woltje added this to the M13-SpeechServices (0.0.13) milestone 2026-02-15 07:35:41 +00:00
Author
Owner

Completed as part of M13-SpeechServices milestone on branch feature/m13-speech-services. SP-E2E-001: E2E integration tests for speech services (commit d2c7602, 30 tests). All quality gates passed (lint, typecheck, tests, security).

Completed as part of M13-SpeechServices milestone on branch feature/m13-speech-services. SP-E2E-001: E2E integration tests for speech services (commit d2c7602, 30 tests). All quality gates passed (lint, typecheck, tests, security).
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: mosaic/stack#405