Skip to content

chore: release 0.14.0 - #248

Merged
ethan-scitix merged 1 commit into
mainfrom
chore/release-0.14.0
Oct 26, 2026
Merged

ethan-scitix merged 1 commit into
mainfrom
chore/release-0.14.0

Conversation

@ethan-scitix

@ethan-scitix ethan-scitix commented Oct 26, 2026 •

Copy link
Copy Markdown
Collaborator

Type

  • chore — CI, tooling, dependencies, config

Summary

  • Release 0.14.0: CHANGELOG entry and Dockerfile wheel version, as in the 0.13.2 release (chore: release 0.13.2 #244).
  • A minor bump: new config keys runner_config.stop_after and a model's lifecycle, a grader/extractor may name a models: entry that sieval run launches, a new exit code 6 for an engine lost mid-run, and new --dry-run fields barriers, phases and launches (fix(cli): fail fast when an engine sieval run launched dies mid-run #246, feat: stage barriers and model lifecycles #247).
  • No identity or on-disk format change: IDENTITY_SCHEMA stays 4 and RESULT_SCHEMA_VERSION stays 1. Barriers and lifecycles are scheduling only; engine_died, engine_died_unsent and barrier_iteration are new error_reason values; runs[].stopped_after and runs[].serving.lifecycles are additive. 0.13.x result directories resume.

Related Issues

Refs #245

Test Plan

Automated

  • Lint/format clean (ruff check ., ruff format --check .)
  • Type check clean (ty check)
  • Unit + integration: pytest tests/unit tests/integration --cov --cov-fail-under=95 -n 8: 9971 passed, 1 skipped, coverage 97.15%. test_exec_quotebench_anchor.py fails on a macOS host, as on v0.13.2 (it compares against GNU verdicts). Three test_wikisql.py tests fail only when the shell has no locale set; with LANG=en_US.UTF-8 they pass.
  • Acceptance gate pytest tests/acceptance -m "not benchmark" -s: 11 passed, 10 skipped (staged BFCL archives and the code-evaluator service are not available locally)
  • Benchmark gate pytest -m benchmark -s: all scenarios PASS once host load fell, four runs in a row (last: single-turn 558.5 SPS / 87.3%, long output 156.7 / 73.4%, multi-iteration 180.2 / 84.5%, high concurrency 1078.9 / 84.3%, framework overhead 1677.9 SPS, resume 0.5 s), matching v0.13.2 run back to back on the same host (1079.6 / 84.3%, 1688.6 SPS). Earlier runs under host load failed single-turn at 61.0% and, once in three, high concurrency at 61.0%.
  • pre-commit run -a: all hooks pass
  • check_preflight.py --level deep: all pass except check_version (latest tag 0.13.2 vs CHANGELOG 0.14.0, which resolves when v0.14.0 is tagged after merge) and link warnings for unreachable or not-yet-existing URLs

Checklist

Required (all PRs)

  • PR title follows conventional format (type(scope): description)
  • No internal paths, credentials, or personal info in committed files
  • AI-generated code has AI-Generated Code - <model> (<provider>) in module docstring
  • No new upper-layer dependencies added to core/
  • Deleted code verified — no remaining call sites depend on it

🤖 Generated with Claude Code

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@ethan-scitix
ethan-scitix merged commit 40d09b2 into main Oct 26, 2026
8 checks passed
@ethan-scitix
ethan-scitix deleted the chore/release-0.14.0 branch October 26, 2026 16:35
@ethan-scitix ethan-scitix mentioned this pull request Oct 27, 2026
7 tasks done
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant