[ethan-scitix]

Type

• chore — release

Summary

Release 0.12.0: CHANGELOG.md folds [Unreleased] into [0.12.0] - 2026-10-23, with a "Migrating from 0.11.x" section, a Fixed entry for #224 and the 0.12.0 compare link. The Dockerfile installs sieval-0.12.0-py3-none-any.whl.

Covers v0.11.0 (339f7d0) to main (6488edc):

• feat(core)!: split the grader identity along postprocess, feedback and report #211, feat(core)!: Model.extra as a capability contract, and a code-based preprocess identity #221 (breaking): meta.json identity is schema 3, one identity per stage (data, preprocess, inference, postprocess, feedback, report); preprocess is identified by code; Model.extra / sequence_wrappers.
• refactor!: remove 0.10/0.11 deprecations; cut unit test time 64s to 37s #222 (breaking): the 0.10/0.11 deprecations are removed. sieval.cli.leaderboard.session, --resume-from, the Transport aliases and InferConfig are gone; runner_config.auto_resume / resume_from are refused.
• feat(infer): resolve serving plans for GPUs declared in SIEVAL_TARGET_GPU #215: SIEVAL_TARGET_GPU.
• feat(cli): sieval run starts an engine only for samples left to infer #216: sieval run starts an engine only for samples left to infer.
• feat(cli): sieval run --dry-run reports what the run would do #217, feat(cli): sieval run --dry-run reports each task's stage plan #220, feat(cli): sieval run --dry-run reports each task's report metric names #225: sieval run --dry-run reports models, tasks, stages, metrics and needs_inference. It now loads every dataset, so a dry-run without the data fails resume_plan.
• fix(deps): require anyio>=4.15 so CapacityLimiter holds its bound #224: anyio>=4.15.

A minor bump, because of #211/#221 and #222.

Identity and resume against 0.11.0

• IDENTITY_SCHEMA 3, RESULT_SCHEMA_VERSION 1.
• Verified on 6488edc: 0.10.0, 0.10.2 and 0.11.0 result-directory fixtures resume with zero restarts and are rewritten to identity.schema 3; a wrapping and a plain model share data and preprocess; the dry-run carries stages, metrics and needs_inference.

Tagging v0.12.0 and the GitHub release happen after merge.

Test plan (macOS, worktree at 6488edc)

• Full suite on 6488edc: passed (run before this PR; this branch changes only CHANGELOG.md and Dockerfile).
• pre-commit run --all-files: pass.
• scripts/check_preflight.py check_version: CHANGELOG, Dockerfile and compare link match 0.12.0; only git tag (0.11.0) != CHANGELOG (0.12.0) fails until the tag exists.

🤖 Generated with Claude Code