mosaic/stack
1
0
Fork 0
Code Issues 10 Pull Requests Actions Packages Projects Releases 2 Wiki Activity

Implement Chatterbox TTS provider (premium tier, voice cloning) #394

New Issue
Closed
opened 2026-02-15 07:34:28 +00:00 by jason.woltje · 1 comment
jason.woltje commented 2026-02-15 07:34:28 +00:00
Owner
Copy Link

Description

Implement the premium-tier TTS provider using Chatterbox (Resemble AI) for voice cloning and maximum quality.

Details

  • MIT license
  • Requires GPU (8-16GB VRAM, RTX 3060 12GB fits)
  • 63.75% preferred over ElevenLabs in blind tests
  • Zero-shot voice cloning from seconds of reference audio
  • Emotion exaggeration control
  • 23 languages, cross-language voice transfer
  • Sub-200ms streaming latency
  • OpenAI-compatible /v1/audio/speech endpoint via Chatterbox-TTS-Server

Voice Cloning

Acceptance Criteria

  • ChatterboxTtsProvider registered in SpeechModule
  • Voice cloning from reference audio
  • Emotion exaggeration parameter support
  • Graceful degradation when GPU unavailable
  • Provider marked as optional (premium tier)
  • Unit tests with mocked client
## Description Implement the premium-tier TTS provider using Chatterbox (Resemble AI) for voice cloning and maximum quality. ## Details - MIT license - Requires GPU (8-16GB VRAM, RTX 3060 12GB fits) - 63.75% preferred over ElevenLabs in blind tests - Zero-shot voice cloning from seconds of reference audio - Emotion exaggeration control - 23 languages, cross-language voice transfer - Sub-200ms streaming latency - OpenAI-compatible /v1/audio/speech endpoint via Chatterbox-TTS-Server ## Voice Cloning ## Acceptance Criteria - [ ] ChatterboxTtsProvider registered in SpeechModule - [ ] Voice cloning from reference audio - [ ] Emotion exaggeration parameter support - [ ] Graceful degradation when GPU unavailable - [ ] Provider marked as optional (premium tier) - [ ] Unit tests with mocked client
jason.woltje added this to the M13-SpeechServices (0.0.13) milestone 2026-02-15 07:34:28 +00:00
jason.woltje commented 2026-02-15 09:30:12 +00:00
Author
Owner
Copy Link

Completed as part of M13-SpeechServices milestone on branch feature/m13-speech-services. SP-TTS-003: Chatterbox TTS provider with voice cloning (commit d37c78f, 26 tests). All quality gates passed (lint, typecheck, tests, security).

Completed as part of M13-SpeechServices milestone on branch feature/m13-speech-services. SP-TTS-003: Chatterbox TTS provider with voice cloning (commit d37c78f, 26 tests). All quality gates passed (lint, typecheck, tests, security).
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
ai
AI/LLM integration
 api
Backend/API work
 api
auth
Authentication
 database
database
Database/schema work
 devops
Docker/deployment
 docs
Documentation
 frontend
graph
knowledge-module
migration
Data migration
 orchestrator
Orchestrator service (apps/orchestrator/)
 p0
Critical priority
 p1
High priority
 p2
Medium priority
 p3
Low priority
 performance
Performance work
 phase-1
phase-2
phase-3
phase-4
phase-5
plugin
MoltBot plugin work
 search
security
Security-related
 setup
Initial setup
 testing
Testing/QA
 web
Frontend work
No Label
Milestone
No items
No Milestone M13-SpeechServices (0.0.13)
Projects
Clear projects
No project
Assignees
Clear assignees
jason.woltje
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: mosaic/stack#394
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?