Skip to content

Contract the fields your metrics read, and check them where the data lands - #38

Merged
h3qing merged 1 commit into
mainfrom
schema-drift-and-data-contracts
Sep 17, 2026
Merged

h3qing merged 1 commit into
mainfrom
schema-drift-and-data-contracts

Conversation

@h3qing

@h3qing h3qing commented Sep 11, 2026 •

Copy link
Copy Markdown
Owner

An upstream change that breaks your query tells you the same day. A change that only alters meaning tells you nothing: a new value in a status field, cents that become dollars, a column that starts arriving empty. The number moves and the query stays green. There is a newer form of the same failure. An AI assistant keeps notes about a field, the field changes, and the notes keep answering.

This page contracts the handful of fields each metric actually reads, and checks them where the data lands in your warehouse rather than in the producer's pipeline. A table lists what must stay true about each field and the check that fails when it stops being true, from not_null to a re-run of the hand-checked questions on closed periods. The assistant's memory is part of the contract and changes in the same commit as the field. The template carries the field list, the structural and semantic checks, the reaction plan, and the agent prompts.

Files:

  • docs/modules/01-ai-data-quality/schema-drift-and-data-contracts.md
  • templates/01-ai-data-quality/schema-contract-control-plan.md
  • REFERENCES.md
  • llms.txt, CONTENT_BACKLOG.md, DECISIONS.md, docs/modules/01-ai-data-quality/README.md, templates/README.md

@h3qing
h3qing force-pushed the schema-drift-and-data-contracts branch 2 times, most recently from a584ef9 to e15abcc Compare September 16, 2026 08:26
An upstream change that breaks a query announces itself the same day. A
change that only alters meaning says nothing: a new value in a status
field, cents that become dollars, a column that starts arriving empty.
The number moves and the query stays green. There is a newer form of
the same failure: an AI assistant keeps notes about a field, the field
changes, and the notes keep answering. This page contracts the handful
of fields each metric reads, checks them where the data lands, and
treats the assistant's memory as part of the contract. Sixteen
references added.
@h3qing
h3qing force-pushed the schema-drift-and-data-contracts branch from e15abcc to 3089c04 Compare September 17, 2026 03:18
@h3qing
h3qing merged commit 21d5abf into main Sep 17, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant