mosaic/stack
1
0
Fork 0
Code Issues 10 Pull Requests Actions Packages Projects Releases 2 Wiki Activity

Create LLM Manager Service #126

New Issue
Closed
opened 2026-01-30 21:28:25 +00:00 by jason.woltje · 0 comments
jason.woltje commented 2026-01-30 21:28:25 +00:00
Owner
Copy Link

Implement LLM Manager for provider instance management and selection.

Objective: Create service to manage multiple LLM provider instances with hot reload.

Tasks:

  • Create llm.manager.ts
  • Implement provider registration and discovery
  • Add instance selection logic (system-level vs user-level)
  • Implement hot reload without restart
  • Add default provider handling
  • Cache provider instances
  • Write unit tests

Acceptance Criteria:

  • Can register/unregister providers dynamically
  • Provider selection works correctly
  • Hot reload functional
  • Tests pass with 85%+ coverage

Related: Epic #121, Phase 1 LLM Abstraction
Depends on: #122, #123 (interface + Ollama provider)

Implement LLM Manager for provider instance management and selection. Objective: Create service to manage multiple LLM provider instances with hot reload. Tasks: - Create llm.manager.ts - Implement provider registration and discovery - Add instance selection logic (system-level vs user-level) - Implement hot reload without restart - Add default provider handling - Cache provider instances - Write unit tests Acceptance Criteria: - Can register/unregister providers dynamically - Provider selection works correctly - Hot reload functional - Tests pass with 85%+ coverage Related: Epic #121, Phase 1 LLM Abstraction Depends on: #122, #123 (interface + Ollama provider)
jason.woltje added the p0apiapiphase-1 labels 2026-01-30 21:28:25 +00:00
jason.woltje added this to the M4-LLM (0.0.4) milestone 2026-01-30 23:40:48 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
ai
AI/LLM integration
 api
Backend/API work
 api
auth
Authentication
 database
database
Database/schema work
 devops
Docker/deployment
 docs
Documentation
 frontend
graph
knowledge-module
migration
Data migration
 orchestrator
Orchestrator service (apps/orchestrator/)
 p0
Critical priority
 p1
High priority
 p2
Medium priority
 p3
Low priority
 performance
Performance work
 phase-1
phase-2
phase-3
phase-4
phase-5
plugin
MoltBot plugin work
 search
security
Security-related
 setup
Initial setup
 testing
Testing/QA
 web
Frontend work
No Label api api p0 phase-1
Milestone
No items
No Milestone M4-LLM (0.0.4)
Projects
Clear projects
No project
Assignees
Clear assignees
jason.woltje
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: mosaic/stack#126
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?