Parse → Supabase DB foundation: read-scope schema, sample importer, local dev

[hatton]

[Claude Opus 4.8] PR opened by preflight.

What this establishes

The database read foundation for the Parse/MongoDB → Supabase Postgres migration. This is the durable artifact of the milestone (formerly branded "Local Supabase + Blorg"); the local-dev tooling is the scaffolding around it.

• Read-scope schema as migrations — books / languages / tags / related_books / users + the book_languages junction, generated from the authoritative production Parse schema dump. TEXT PKs preserve Parse objectIds; RLS enabled with anonymous public read; books.tags_text generated column for wildcard tag matching.
• packages/sync-tool — an idempotent sample importer that pulls ~100 diverse production books into a local stack (refuses non-localhost targets by default).
• Local dev — Podman-on-Windows setup, ports moved 543xx→443xx to dodge Windows Hyper-V excluded ranges, docs.
• CI — validates the migrations apply cleanly from scratch on every PR.

Parse remains the production system of record; nothing here serves production traffic yet. See docs/db/README.md for schema conventions and the post-milestone roadmap.

Notes

• Base (develop) integrated; its MIGRATION-PLAN.md → FUNCTIONS-MIGRATION-PLAN.md rename folded in and the db README cross-reference updated.

[greptile-apps]

Greptile Summary

This PR establishes the database read foundation for the Parse/MongoDB → Supabase Postgres migration: a versioned schema for books, languages, tags, users, and junction tables; an idempotent sample importer; and a migrated send-concern-email Edge Function. It also wires up CI migration validation and adjusts local ports for Windows Hyper-V compatibility.

• Three SQL migrations define the read-scope schema with TEXT PKs (preserving Parse objectIds), GIN indexes, and RLS policies on every table — soft-delete guards are applied consistently across books, book_languages, related_books, and users.
• packages/sync-tool pulls a diverse ~100-book sample from production Parse into the local stack; a localhost-only guard (overridable via SYNC_ALLOW_REMOTE=1) prevents accidental remote writes.
• send-concern-email replaces the legacy Parse cloud function, with thorough input validation, a Mailgun no-op fallback when env vars are absent, and a full test suite; verify_jwt = false is acknowledged as a temporary trade-off with a TODO for the auth cutover.

Important Files Changed

Filename	Overview
supabase/migrations/20260717120000_initial_read_schema.sql	Full read-scope schema: tables, indexes, and RLS policies for books/languages/tags/users/book_languages/related_books. RLS soft-delete guards on all junction tables are correctly applied.
supabase/migrations/20260717230000_add_books_tags_text.sql	Adds tags_text generated column using an IMMUTABLE wrapper around array_to_string to enable per-element wildcard tag matching via LIKE. Approach is well-justified by inline comments.
supabase/migrations/20260718000000_add_match_topic_tags_rpc.sql	Adds match_topic_tags RPC: STABLE, SECURITY INVOKER, pinned search_path; explicitly revokes PUBLIC and re-grants to anon/authenticated. Logic faithfully replicates Parse's topic-filter semantics without regex surface.
packages/sync-tool/src/import-sample.mjs	Idempotent Parse→Supabase sample importer. Localhost guard prevents accidental remote writes. Parse expanded-pointer vs. stub distinction is handled correctly throughout.
.github/workflows/ci.yml	Adds a migration-validation job that starts a stripped-down local Supabase stack, runs db reset, and stops it. Supabase CLI version pinned to match package.json.
supabase/functions/send-concern-email/concernEmail.ts	Migrates sendConcernEmail Parse cloud function to a Supabase Edge Function. Input validation, Mailgun integration, and no-op fallback are all well-tested. The fromAddress-from-body trust issue is acknowledged and annotated as a TODO.
supabase/functions/tests/send-concern-email-test.ts	Comprehensive tests covering validation, book-not-found, no-op env behavior, Mailgun request shape, fallback field values, error responses, and CORS headers.
supabase/config.toml	Ports moved from 543xx to 443xx to avoid Windows Hyper-V excluded ranges. New env secrets for Mailgun wired up. verify_jwt = false on send-concern-email is documented with a TODO for post-auth-cutover reversal.

_{Reviews (7): Last reviewed commit: "Document the 200k-books performance desi..." | Re-trigger Greptile}

[hatton]

[Claude Opus 4.8] Consulted Devin on 2026-07-17, up to commit 41a9c9d.

Devin found 1 Bug + 3 Investigate + 3 Informational. Each actionable finding is mirrored as its own inline review thread:

• Bug — updated_at trigger clobbers Parse timestamps on re-import → open, in the developer decision report.
• Investigate — languages embed alias collides with the legacy languages column → open, decision report.
• Investigate — anonymous read exposes all users emails → open, decision report.
• Investigate — toSnake can drop capital-run analytics fields → assessed acceptable for the v0 logging importer, resolved (verify-at-full-sync noted).

Informational items skipped (stale 543xx refs in fs/README, Parse tag maxLimit, duplicate langPointers). CI (test) green — deno suite + migrations-apply-from-scratch. Greptile green with one P1 (soft-deleted books readable via using(true)), also in the decision report.

[hatton]

[Claude Fable 5] Consulted Devin on 2026-07-18 up to commit 7990f7b. Two review cycles this run: the first (at 667563a) raised one Bug — duplicate langPointers aborting the sample import — fixed in 7990f7b (thread), and one Investigate about CI's supabase-start exclusion list, verified not an issue (thread). The re-review at 7990f7b marks all Bugs resolved with no new findings. CI and Greptile are green and quiet for the same commit.

[hatton]

[Claude Fable 5] Consulted Devin on 2026-07-18 up to commit be6db75 (re-run after the send-concern-email / match_topic_tags / SAMPLE_TARGET batch landed). One new Bug: the Mailgun secrets were never wired into the local edge runtime, so the concern-email flow silently no-opped in local dev — fixed in be6db75 (thread). No other new findings; CI and Greptile green and quiet for the same commit.