Skip to content

Update the pinned ClawBench revision - #184

Merged
rgarcia merged 5 commits into
mainfrom
hypeship/update-clawbench-pin
Oct 1, 2026
Merged

rgarcia merged 5 commits into
mainfrom
hypeship/update-clawbench-pin

Conversation

@rgarcia

@rgarcia rgarcia commented Sep 8, 2026 •

Copy link
Copy Markdown
Contributor

Summary

  • update the benchmark workflow and local runner to upstream ClawBench 187cd252bc60af8ac3a2c98a87c9316e49a5ac75
  • pick up the upstreamed Kernel browser control arm, Harbor correctness fixes, run provenance, and reproduction-cache cleanup
  • document the same immutable revision and keep it covered by workflow hardening tests
  • merge current main so the benchmark update includes the latest trace-publication changes

Depends on kernel/ClawBench#2, which makes the pinned upstream commit available from the Kernel fork.

Test plan

  • bun test (822 passing)
  • bunx tsc --noEmit
  • targeted Prettier check
  • bash -n benchmarks/harbor/clawbench/run.sh
  • Actionlint
  • Zizmor
  • generate and rewrite the Red Cross Harbor task using the pinned ClawBench revision

@vercel

vercel Bot commented Sep 8, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
mcp Ready Ready Preview Oct 1, 2026 1:19pm UTC

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes using default effort and found 3 potential issues.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit f704ee6. Configure here.

Comment thread benchmarks/harbor/results.test.ts Outdated
Comment thread .github/workflows/benchmark-clawbench.yml Outdated
Comment thread benchmarks/harbor/README.md Outdated

@bmsaadat bmsaadat left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm!

@rgarcia
rgarcia merged commit d86d85d into main Oct 1, 2026
9 checks passed
@rgarcia
rgarcia deleted the hypeship/update-clawbench-pin branch October 1, 2026 15:41

This branch was successfully deployed

1 active deployment
Preview — 5da549e0 Deployed Oct 1, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants