Skip to content

Regenerate reproducible evaluation baseline - #56

Merged
chaudhryumer merged 1 commit into
QuantumLogicsLabs:mainfrom
mustfaaaa:dev1/reproducible-evaluation-reporting
Oct 3, 2026
Merged

chaudhryumer merged 1 commit into
QuantumLogicsLabs:mainfrom
mustfaaaa:dev1/reproducible-evaluation-reporting

Conversation

@mustfaaaa

Copy link
Copy Markdown
Contributor

Summary

  • regenerate the evaluation report from the current checkpoint and five benchmark files
  • reconcile the stale 300-case total with the actual 268-case suite
  • record partial at 60/60 and gradient at 12/18 with exact reproducibility settings
  • add machine-readable evidence, input hashes, and report freshness tests

Validation

  • full 268-case evaluation: 259/268 exact match, 268/268 verified, 0 exceptions
  • python -m unittest tests.unit.test_eval_report_freshness -v: 2 tests passed
  • Markdown output matches the JSON summary

This PR updates reporting and measurement only; it does not change model quality.

@vercel

vercel Bot commented Oct 1, 2026

Copy link
Copy Markdown

@mustfaaaa is attempting to deploy a commit to the seno-quantum-coder's projects Team on Vercel.

A member of the Team first needs to authorize it.

@chaudhryumer
chaudhryumer merged commit f17d9a7 into QuantumLogicsLabs:main Oct 3, 2026
1 of 5 checks passed
chaudhryumer added a commit to chaudhryumer/CalculusSolver that referenced this pull request Oct 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants