Skip to content

ci: reject Mathlib pins whose cache lacks modules - #672

Merged
kim-em merged 1 commit into
mainfrom
ci/mathlib-cache-complete
Nov 13, 2026
Merged

kim-em merged 1 commit into
mainfrom
ci/mathlib-cache-complete

Conversation

@kim-em

@kim-em kim-em commented Nov 13, 2026

Copy link
Copy Markdown
Collaborator

This PR adds a mathlib cache job, one per benchmark configuration (rc and stable), to the dependency cache restoration workflow, and makes the required restore check depend on it. The job clones only the configuration's pinned Mathlib, runs lake exe cache get, and requires lake --no-build build Mathlib to succeed. It also requires Mathlib's toolchain to match the configuration's.

Evaluation restores dependencies with compilation disabled, so a single module missing from Mathlib's cache fails every submission. Mathlib b63f6e8 lacked Mathlib.Tactic.CategoryTheory.BicategoryCoherence, and evaluations failed from late October until #670 moved the pins. Cloning Mathlib alone keeps the job clear of the large solution libraries that materializing the benchmark workspace would fetch. The workflow now also runs when the root lakefile.toml or lake-manifest.json changes.

🤖 Prepared with Claude Code

Evaluation restores dependencies with compilation disabled, so one module
missing from Mathlib's cache (as with Mathlib b63f6e8, which lacked
Mathlib.Tactic.CategoryTheory.BicategoryCoherence) fails every submission.
For each benchmark configuration, clone only the pinned Mathlib, run
`lake exe cache get` and require `lake --no-build build Mathlib` to succeed,
and require its toolchain to match the configuration's. Run the workflow when
the root lakefile or manifest changes too.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@kim-em
kim-em merged commit 8955681 into main Nov 13, 2026
14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant