#171: Migrate Submission records separation - #206
Open
leoraba wants to merge 69 commits into
Open
Conversation
leoraba
marked this pull request as draft
June 9, 2026 17:44
leoraba
marked this pull request as ready for review
June 12, 2026 17:40
leoraba
requested review from
JamesTLopez,
Copilot and
joneubank
and removed request for
Copilot
June 12, 2026 17:48
Base automatically changed from
feat/interation-test-migration
to
feat/dictionary_migration
July 9, 2026 15:14
leoraba
force-pushed
the
feat/submission_records_separation
branch
from
July 16, 2026 13:54
5ed266e to
fada6b2
Compare
joneubank
approved these changes
Jul 20, 2026
joneubank
left a comment
joneubank
left a comment
Contributor
There was a problem hiding this comment.
LGTM!
One comment on migration of submissions into files having file_size = 0, but I don't think this blocks moving ahead with this as is.
| submission_id, | ||
| file_name, | ||
| entity_name, | ||
| 0 AS file_size |
Contributor
There was a problem hiding this comment.
Do we have any mechanism to calculate or approximate the file size? This works but I fear we will have some weird behaviour in the future if we ever rely on this value.
Contributor
Author
There was a problem hiding this comment.
update to calculate the actual json size in bytes.
leoraba
force-pushed
the
feat/submission_records_separation
branch
from
August 10, 2026 19:05
d284353 to
546c0d0
Compare
5 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This PR creates a SQL script to migrate legacy submission payloads into a normalized structure by creating one row record per submitted item.
Issues
This PR is part 1 of a series of PRs to complete issue # 171
Description of Changes
Package 'Data-model'
0015_create_submission_records_table.sqlDDL migration that creates the newsubmission_filesandsubmission_records tables.0016_CUSTOM_migrate_submission_records.sqlcustom DML migration that moves existing data into the new schema.schema.dbmldocs/README.mdReadiness Checklist
.env.schemafile and documented in the README