You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Audit October feature coverage and surface recorded evidence in Lab - #723
Audit the October 5–19 changes against repository docs, the published site, and the opt-in Lab dashboard. The audit reconciles 50 merged PRs with default-branch commits and records each feature’s documentation, UI/API, and regression coverage.
Lab evidence: Add a Recorded evidence tab for saved reliability estimates, portable evidence, scoped requirement observations, and independent prompt-judging results. Distinguish missing or invalid metadata, explicit zero credits, cached provenance, and unverified evidence; do not imply evidence contents were independently verified.
Audit and docs: Add a linked coverage inventory and update Lab guidance, CLI/runtime wording, and October version boundaries. Add a screenshot generated from a mock-provenance fixture with a matching site mirror.
Known gap: Malformed runtime reliability interval and pass^k values still need validation in the Lab inspector.
Validate malformed rows before rendering header fields
web/src/lab/RunInspector.tsx:74
Object-shaped malformed rows still reach the header. For example, { runNumber: {}, attempts: 1, cached: false, assessment: "invalid" } passes this check; the manifest guard returns false, but React then tries to render runNumber as a child and crashes the inspector. Validate the envelope fields before rendering them and return the existing withheld placeholder on failure. Add a regression with a malformed object beside a valid record.
CopilotAI
changed the title
[WIP] Audit October 5–19 features and fixes for documentation and dashboard
Audit October feature coverage and surface recorded evidence in Lab
Oct 19, 2026
Validate malformed evidence envelopes before rendering
web/src/lab/RunInspector.tsx:114
Object-shaped malformed rows still pass this guard. For example, { runNumber: {}, attempts: 1, cached: false, assessment: "invalid" } reaches Run {evidence.runNumber}, where React throws instead of showing the withheld placeholder. Validate the envelope fields before rendering them, and add a regression with a malformed object alongside a valid sibling so one bad row cannot hide the remaining evidence.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Audit the October 5–19 changes against repository docs, the published site, and the opt-in Lab dashboard. The audit reconciles 50 merged PRs with default-branch commits and records each feature’s documentation, UI/API, and regression coverage.
pass^kvalues still need validation in the Lab inspector.