Data validation and integrity checks #31

Open
opened 2026-01-28 19:06:38 +00:00 by jason.woltje · 0 comments
Owner

Implement data validation for migration.

Pre-migration checks:

  • Source files exist and are valid JSON
  • Required fields present
  • Date formats valid
  • No circular dependencies

Post-migration checks:

  • All records imported
  • Relationships intact
  • No orphan records
  • Timestamps preserved
  • IDs consistent

Validation report:

  • Summary of migrated records
  • Warnings (e.g., missing optional fields)
  • Errors (failed records)

Requirements:

  • Automated validation script
  • Human-readable report
  • CI integration
Implement data validation for migration. **Pre-migration checks:** - Source files exist and are valid JSON - Required fields present - Date formats valid - No circular dependencies **Post-migration checks:** - All records imported - Relationships intact - No orphan records - Timestamps preserved - IDs consistent **Validation report:** - Summary of migrated records - Warnings (e.g., missing optional fields) - Errors (failed records) **Requirements:** - Automated validation script - Human-readable report - CI integration
jason.woltje added this to the MVP-Migration (0.1.0 MVP) milestone 2026-01-28 19:06:38 +00:00
jason.woltje added the migrationp0 labels 2026-01-28 19:06:38 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: mosaic/stack#31