mosaic/stack
1
0
Fork 0
Code Issues 10 Pull Requests Actions Packages Projects Releases 2 Wiki Activity

Ollama integration (local/remote) #21

New Issue
Closed
opened 2026-01-28 19:05:02 +00:00 by jason.woltje · 0 comments
jason.woltje commented 2026-01-28 19:05:02 +00:00
Owner
Copy Link

Implement configurable Ollama integration.

Configuration:

  • OLLAMA_MODE: local | remote
  • OLLAMA_ENDPOINT: URL
  • OLLAMA_MODEL: model name
  • OLLAMA_EMBEDDING_MODEL: embedding model

Features:

  • Chat completions
  • Embeddings generation
  • Model switching
  • Fallback handling

API:

  • POST /api/ai/chat - Chat with AI
  • POST /api/ai/embed - Generate embeddings

Service layer:

  • OllamaService with configurable endpoint
  • Health check on startup
  • Timeout handling
  • Rate limiting

Requirements:

  • Works with local Ollama (Docker)
  • Works with remote Ollama (homelab)
  • Works with OpenAI-compatible APIs (together.ai)
Implement configurable Ollama integration. **Configuration:** - OLLAMA_MODE: local | remote - OLLAMA_ENDPOINT: URL - OLLAMA_MODEL: model name - OLLAMA_EMBEDDING_MODEL: embedding model **Features:** - Chat completions - Embeddings generation - Model switching - Fallback handling **API:** - POST /api/ai/chat - Chat with AI - POST /api/ai/embed - Generate embeddings **Service layer:** - OllamaService with configurable endpoint - Health check on startup - Timeout handling - Rate limiting **Requirements:** - Works with local Ollama (Docker) - Works with remote Ollama (homelab) - Works with OpenAI-compatible APIs (together.ai)
jason.woltje added this to the M3-Features (0.0.3) milestone 2026-01-28 19:05:02 +00:00
jason.woltje added the p1aiapi labels 2026-01-28 19:05:02 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
ai
AI/LLM integration
 api
Backend/API work
 api
auth
Authentication
 database
database
Database/schema work
 devops
Docker/deployment
 docs
Documentation
 frontend
graph
knowledge-module
migration
Data migration
 orchestrator
Orchestrator service (apps/orchestrator/)
 p0
Critical priority
 p1
High priority
 p2
Medium priority
 p3
Low priority
 performance
Performance work
 phase-1
phase-2
phase-3
phase-4
phase-5
plugin
MoltBot plugin work
 search
security
Security-related
 setup
Initial setup
 testing
Testing/QA
 web
Frontend work
No Label ai api p1
Milestone
No items
No Milestone M3-Features (0.0.3)
Projects
Clear projects
No project
Assignees
Clear assignees
jason.woltje
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: mosaic/stack#21
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?