feat: storage abstraction retrofit — adapters for queue, storage, memory (phases 1-4) #365

2026-04-03T04:11:55Z

jason.woltje commented

2026-04-03 04:11:55 +00:00

Multi-phase refactor enabling Mosaic to work with multiple backends:

Phase 1: Define adapter interfaces for queue, storage, memory
Phase 2: Wrap existing Redis/Postgres/pgvector as adapters
Phase 3: Implement local SQLite + keyword search adapter
Phase 4: Add MosaicConfig schema + CLI tier selection wizard

All packages typecheck and lint green. Ready for merge.

Multi-phase refactor enabling Mosaic to work with multiple backends: **Phase 1:** Define adapter interfaces for queue, storage, memory **Phase 2:** Wrap existing Redis/Postgres/pgvector as adapters **Phase 3:** Implement local SQLite + keyword search adapter **Phase 4:** Add MosaicConfig schema + CLI tier selection wizard All packages typecheck and lint green. Ready for merge.

jason.woltje added 19 commits 2026-04-03 04:11:56 +00:00

chore(orchestrator): Bootstrap storage abstraction retrofit 73043773d8

Mission: Decouple gateway from hardcoded Postgres/Valkey backends.
20 tasks across 5 phases. Estimated total: ~214K tokens.

Phase 1: Interface extraction (4 tasks)
Phase 2: Wrap existing backends as adapters (5 tasks)
Phase 3: Local tier implementation (4 tasks)
Phase 4: Config + CLI commands (4 tasks)
Phase 5: Migration + docs (3 tasks)

feat(queue): define QueueAdapter interface types 05d61e62be

Co-Authored-By: Claude Opus 4.6 <[email protected]>

feat(storage): define StorageAdapter interface types + scaffold package e797676a02

Co-Authored-By: Claude Opus 4.6 <[email protected]>

feat(memory): define MemoryAdapter interface types 41961a6980

Co-Authored-By: Claude Opus 4.6 <[email protected]>

feat: add adapter factory + registry pattern for queue, storage, memory 9d22ef4cc9

Co-Authored-By: Claude Opus 4.6 <[email protected]>

chore(orchestrator): Phase 1 complete — all interfaces defined e0eca771c6

refactor(queue): wrap ioredis as bullmq adapter behind QueueAdapter interface 5e852df6c3

Co-Authored-By: Claude Opus 4.6 <[email protected]>

feat(storage): implement Postgres adapter wrapping Drizzle + @mosaic/db d19ef45bb0

Co-Authored-By: Claude Opus 4.6 <[email protected]>

refactor(memory): wrap pgvector logic as MemoryAdapter implementation 27b1898ec6

Co-Authored-By: Claude Opus 4.6 <[email protected]>

feat(gateway): wire adapter factories + DI tokens alongside existing providers e128a7a322

Co-Authored-By: Claude Opus 4.6 <[email protected]>

chore(orchestrator): Phase 2 complete — existing backends wrapped as adapters

ci/woodpecker/push/ci Pipeline was successful

Details

46a31d4e71

feat(queue): implement local adapter with JSON persistence 7bb878718d

Co-Authored-By: Claude Opus 4.6 <[email protected]>

feat(storage): implement SQLite adapter with better-sqlite3 25383ea645

Co-Authored-By: Claude Opus 4.6 <[email protected]>

feat(memory): implement keyword search adapter — no vector dependency 35fbd88a1d

Co-Authored-By: Claude Opus 4.6 <[email protected]>

chore(orchestrator): Phase 3 complete — local tier implemented (SQLite + keyword search + JSON queue)

ci/woodpecker/push/ci Pipeline failed

Details

626adac363

42 new tests: 4 queue, 18 storage, 20 memory
347 total tests passing

feat(config): add MosaicConfig schema + loader with tier auto-detection

ci/woodpecker/push/ci Pipeline failed

Details

04a80fb9ba

Co-Authored-By: Claude Opus 4.6 <[email protected]>

feat(cli): add mosaic gateway init command with tier selection wizard 95e7b071d4

Co-Authored-By: Claude Opus 4.6 <[email protected]>

feat(cli): add gateway start/stop/status lifecycle commands ce3ca1dbd1

Co-Authored-By: Claude Opus 4.6 <[email protected]>

chore(orchestrator): Phase 4 complete — config schema + CLI lifecycle commands

ci/woodpecker/push/ci Pipeline failed

Details

ci/woodpecker/pr/ci Pipeline failed

Details

fd83bd4f2d

381 tests passing (347 gateway + 34 CLI), 40/40 tasks clean

jason.woltje merged commit 0b0fe10b37 into main

2026-04-03 04:40:58 +00:00

jason.woltje referenced this issue from a commit

2026-04-03 04:40:59 +00:00

Merge pull request 'feat: storage abstraction retrofit — adapters for queue, storage, memory (phases 1-4)' (#365) from feat/storage-abstraction into main

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: mosaicstack/stack#365