feat: storage abstraction retrofit — adapters for queue, storage, memory (phases 1-4) #365

Merged

jason.woltje merged 19 commits from feat/storage-abstraction into main 2026-04-03 04:40:58 +00:00

Conversation 0 Commits 19 Files Changed 38 +3243 -89

jason.woltje commented 2026-04-03 04:11:55 +00:00

Owner

Copy Link

Multi-phase refactor enabling Mosaic to work with multiple backends:

Phase 1: Define adapter interfaces for queue, storage, memory
Phase 2: Wrap existing Redis/Postgres/pgvector as adapters
Phase 3: Implement local SQLite + keyword search adapter
Phase 4: Add MosaicConfig schema + CLI tier selection wizard

All packages typecheck and lint green. Ready for merge.

Multi-phase refactor enabling Mosaic to work with multiple backends: **Phase 1:** Define adapter interfaces for queue, storage, memory **Phase 2:** Wrap existing Redis/Postgres/pgvector as adapters **Phase 3:** Implement local SQLite + keyword search adapter **Phase 4:** Add MosaicConfig schema + CLI tier selection wizard All packages typecheck and lint green. Ready for merge.

jason.woltje added 19 commits 2026-04-03 04:11:56 +00:00

chore(orchestrator): Bootstrap storage abstraction retrofit ... 73043773d8

Mission: Decouple gateway from hardcoded Postgres/Valkey backends.
20 tasks across 5 phases. Estimated total: ~214K tokens.

Phase 1: Interface extraction (4 tasks)
Phase 2: Wrap existing backends as adapters (5 tasks)
Phase 3: Local tier implementation (4 tasks)
Phase 4: Config + CLI commands (4 tasks)
Phase 5: Migration + docs (3 tasks)

feat(queue): define QueueAdapter interface types ... 05d61e62be

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

feat(storage): define StorageAdapter interface types + scaffold package ... e797676a02

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

feat(memory): define MemoryAdapter interface types ... 41961a6980

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

feat: add adapter factory + registry pattern for queue, storage, memory ... 9d22ef4cc9

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

chore(orchestrator): Phase 1 complete — all interfaces defined e0eca771c6

refactor(queue): wrap ioredis as bullmq adapter behind QueueAdapter interface ... 5e852df6c3

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

feat(storage): implement Postgres adapter wrapping Drizzle + @mosaic/db ... d19ef45bb0

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

refactor(memory): wrap pgvector logic as MemoryAdapter implementation ... 27b1898ec6

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

feat(gateway): wire adapter factories + DI tokens alongside existing providers ... e128a7a322

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

chore(orchestrator): Phase 2 complete — existing backends wrapped as adapters 46a31d4e71

feat(queue): implement local adapter with JSON persistence ... 7bb878718d

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

feat(storage): implement SQLite adapter with better-sqlite3 ... 25383ea645

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

feat(memory): implement keyword search adapter — no vector dependency ... 35fbd88a1d

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

chore(orchestrator): Phase 3 complete — local tier implemented (SQLite + keyword search + JSON queue) ... 626adac363

42 new tests: 4 queue, 18 storage, 20 memory
347 total tests passing

feat(config): add MosaicConfig schema + loader with tier auto-detection ... 04a80fb9ba

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

feat(cli): add mosaic gateway init command with tier selection wizard ... 95e7b071d4

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

feat(cli): add gateway start/stop/status lifecycle commands ... ce3ca1dbd1

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

chore(orchestrator): Phase 4 complete — config schema + CLI lifecycle commands ... fd83bd4f2d

381 tests passing (347 gateway + 34 CLI), 40/40 tasks clean

jason.woltje merged commit 0b0fe10b37 into main 2026-04-03 04:40:58 +00:00

jason.woltje referenced this issue from a commit 2026-04-03 04:40:59 +00:00

Merge pull request 'feat: storage abstraction retrofit — adapters for queue, storage, memory (phases 1-4)' (#365) from feat/storage-abstraction into main

Sign in to join this conversation.

Reviewers

No Reviewers

Labels

No items

No Label

Milestone

No items

No Milestone

Projects

Clear projects

No project

Assignees

Clear assignees

jason.woltje

No Assignees

1 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: mosaicstack/stack#365