Skip to content

feat(core): add lineage.enabled to WorkflowSettings and ProjectConfig - #2235

Merged
rafal-hawrylak merged 1 commit into
mainfrom
feat-lineage-enabled
Aug 5, 2026
Merged

feat(core): add lineage.enabled to WorkflowSettings and ProjectConfig#2235
rafal-hawrylak merged 1 commit into
mainfrom
feat-lineage-enabled

Conversation

@rafal-hawrylak

Copy link
Copy Markdown
Collaborator

Introduces LineageSettings { bool enabled } and threads it through WorkflowSettings (yaml opt-in) into ProjectConfig (compiled graph) so downstream Dataform runners can decide whether to emit OpenLineage events to Knowledge Catalog (datalineage.googleapis.com) after each action completes.

Config plumbing only — no emission logic is added in this change.

@rafal-hawrylak
rafal-hawrylak requested a review from a team as a code owner July 28, 2026 09:08
@rafal-hawrylak
rafal-hawrylak requested review from SuchodolskiEdvin and removed request for ikholopov-omni and kolina July 30, 2026 06:45
Comment thread protos/core.proto
@rafal-hawrylak
rafal-hawrylak force-pushed the feat-lineage-enabled branch 2 times, most recently from 2dbd093 to 3aa6b9f Compare July 31, 2026 20:59
Comment thread protos/configs.proto Outdated
Comment thread protos/core.proto Outdated
Introduces `LineageSettings { bool enabled }` and threads it through
`WorkflowSettings` (yaml opt-in) into `ProjectConfig` (compiled graph)
so downstream Dataform runners can decide whether to emit OpenLineage
events to Knowledge Catalog (datalineage.googleapis.com) after each
action completes.

Config plumbing only — no emission logic is added in this change.
Consumers (Dataform CLI runner, Dataform Backend) read this field in
follow-up work.
@rafal-hawrylak
rafal-hawrylak merged commit d634c7f into main Aug 5, 2026
11 checks passed
@rafal-hawrylak
rafal-hawrylak deleted the feat-lineage-enabled branch August 5, 2026 09:02
rafal-hawrylak added a commit that referenced this pull request Aug 5, 2026
Introduces `LineageSettings { bool enabled }` and threads it through
`WorkflowSettings` (yaml opt-in) into `ProjectConfig` (compiled graph)
so downstream Dataform runners can decide whether to emit OpenLineage
events to Knowledge Catalog (datalineage.googleapis.com) after each
action completes.

Config plumbing only — no emission logic is added in this change.
Consumers (Dataform CLI runner, Dataform Backend) read this field in
follow-up work.

Porting the changes from PR (#2235)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants