Skip to content

chore(eval): add GPT-6.1 Sol and GPT-6 Luna to the 88-task and generate results - #2703

Merged
chaliy merged 1 commit into
mainfrom
claude/project-thread-hndwnc
Oct 12, 2026
Merged

chaliy merged 1 commit into
mainfrom
claude/project-thread-hndwnc

Conversation

@chaliy

@chaliy chaliy commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

What changed

GPT-6.1 Sol and GPT-6 Luna are now included in the 2026-10-09 tagged bashkit_bash (88 tasks) and bashkit_generate (15 tasks) runs. They were added with mira run --resume, which ran only their cases. The README table, the eval README results and the knowledge log now cover all seven models, and the homepage table picks up both models from the regenerated site data.

Why

#2664 shipped with five models because the OpenAI key ran out of credit. Now that it has been topped up, the lineup is complete.

Before / After

Before: five models were on the 88-task set, and GPT-6 was missing from the homepage and the README.

After:

Model 88-task basic repo hard runtime generate
GPT-6.1 Sol 76 54 3 8 11 14/15
GPT-6 Luna 71 53 1 5 12 14/15

GPT-6.1 Sol is the only model besides Opus 5.5 that solves hard_makefile_deps.

Risk

  • Low. The PR touches only results data and docs.

Checklist

  • Tests added or updated (n/a, data only; just check-okf and just check-doc-links pass)
  • Backward compatibility considered (n/a)

@chaliy chaliy self-assigned this Oct 12, 2026
@cloudflare-workers-and-pages

Copy link
Copy Markdown

Deploying with  Cloudflare Workers  Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status Name Latest Commit Preview URL Updated (UTC)
✅ Deployment successful!
View logs
bashkit 09ce5af Commit Preview URL

Branch Preview URL
Oct 12 2026, 07:01 PM

@chaliy
chaliy merged commit eacce6f into main Oct 12, 2026
25 checks passed
@chaliy
chaliy deleted the claude/project-thread-hndwnc branch October 12, 2026 19:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant