Repository navigation
Benchmark drift on master #395
Description
Activity
Counts on master grew by more than 3% between b7eacec and 698f881 (10 recorded merges; latest: Merge pull request #400 from jinja2cpp/claude/project-thread-sfzfdx).
Benchmark Metric Before Now Change Render/large_static instructions 30,994 32,106 +3.59% Commits in the window: b31499d, f081f25, 5a42640, d2a4838, bfbc174, 579b378, 580fcbf, 35200ad, 150a5e0, 698f881.
A benchmark case that was edited in the window also shows here; check
git log bench/casesbefore bisecting. Charts: thebench-databranch.Counts on master grew by more than 3% between f081f25 and c2b626f (10 recorded merges; latest: Merge pull request #401 from jinja2cpp/claude/project-thread-5x85qg).
Benchmark Metric Before Now Change Render/plain_text instructions 2,656 2,746 +3.39% Commits in the window: 5a42640, d2a4838, bfbc174, 579b378, 580fcbf, 35200ad, 150a5e0, 698f881, f3af5dc, c2b626f.
A benchmark case that was edited in the window also shows here; check
git log bench/casesbefore bisecting. Charts: thebench-databranch.Counts on master grew by more than 3% between f3af5dc and c05ee13 (10 recorded merges; latest: Merge pull request #414 from jinja2cpp/claude/project-thread-fkqkk8).
Benchmark Metric Before Now Change Load/strings allocations 102 106 +3.92% Commits in the window: c2b626f, c66ee9a, 52d4543, 60febdc, 1906439, 448bb7c, 449e8c6, 8bd9d1f, 04c111d, c05ee13.
A benchmark case that was edited in the window also shows here; check
git log bench/casesbefore bisecting. Charts: thebench-databranch.Counts on master grew by more than 3% between 60febdc and 260ab16 (10 recorded merges; latest: Merge pull request #418 from jinja2cpp/claude/project-thread-tsheuk).
Benchmark Metric Before Now Change Load/many_tags allocations 9,658 10,238 +6.01% Commits in the window: 1906439, 448bb7c, 449e8c6, 8bd9d1f, 04c111d, c05ee13, b23c319, 0990e3a, a9ef179, 260ab16.
A benchmark case that was edited in the window also shows here; check
git log bench/casesbefore bisecting. Charts: thebench-databranch.Counts on master grew by more than 3% between a9ef179 and 16f3f3b (10 recorded merges; latest: Merge pull request #432 from jinja2cpp/claude/perf-wave2-arena-slots-p6gl1u).
Benchmark Metric Before Now Change Load/plain_text instructions 4,275 4,572 +6.94% Commits in the window: 260ab16, 85fd9a2, 0892811, 9736456, 20bd8ae, 1ad80c3, d47d436, 8a2018d, d333c43, 16f3f3b.
A benchmark case that was edited in the window also shows here; check
git log bench/casesbefore bisecting. Charts: thebench-databranch.Counts on master grew by more than 3% between 260ab16 and 3cc8e7d (10 recorded merges; latest: Merge pull request #433 from jinja2cpp/claude/perf-wave2-arena-slots-p6gl1u).
Benchmark Metric Before Now Change Load/dict_ops instructions 52,090 54,169 +3.99% Load/for_filter_if instructions 42,557 44,417 +4.37% Load/for_range instructions 20,691 21,787 +5.29% Load/substitute instructions 11,312 11,656 +3.04% Commits in the window: 85fd9a2, 0892811, 9736456, 20bd8ae, 1ad80c3, d47d436, 8a2018d, d333c43, 16f3f3b, 3cc8e7d.
A benchmark case that was edited in the window also shows here; check
git log bench/casesbefore bisecting. Charts: thebench-databranch.Counts on master grew by more than 3% between 85fd9a2 and 5a037d0 (10 recorded merges; latest: Merge pull request #434 from jinja2cpp/claude/perf-wave2-arena-slots-p6gl1u).
Benchmark Metric Before Now Change Render/inheritance instructions 202,716 213,313 +5.23% Commits in the window: 0892811, 9736456, 20bd8ae, 1ad80c3, d47d436, 8a2018d, d333c43, 16f3f3b, 3cc8e7d, 5a037d0.
A benchmark case that was edited in the window also shows here; check
git log bench/casesbefore bisecting. Charts: thebench-databranch.Counts on master grew by more than 3% between 20bd8ae and f3cc856 (10 recorded merges; latest: Merge pull request #437 from jinja2cpp/claude/perf-wave2-arena-slots-p6gl1u).
Benchmark Metric Before Now Change Load/chat_llama instructions 528,078 581,664 +10.15% Load/chat_mistral instructions 600,488 682,751 +13.70% Load/chat_qwen instructions 387,534 436,328 +12.59% Load/config_file instructions 130,357 150,366 +15.35% Load/expressions instructions 61,615 71,640 +16.27% Load/filters instructions 92,341 99,605 +7.87% Load/for_loop_vars instructions 49,970 58,440 +16.95% Load/html_autoescape instructions 254,838 297,191 +16.62% Load/inheritance instructions 33,992 36,146 +6.33% Load/large_static instructions 218,623 240,857 +10.17% Load/macros instructions 72,844 83,845 +15.10% Load/many_tags instructions 12,045,926 13,741,982 +14.08% Load/mitsuhiko_table instructions 74,437 83,519 +12.20% Load/mitsuhiko_table_wide instructions 93,936 102,897 +9.54% Load/strings instructions 95,574 107,570 +12.55% Load/substitute instructions 10,226 10,952 +7.10% Commits in the window: 1ad80c3, d47d436, 8a2018d, d333c43, 16f3f3b, 3cc8e7d, 5a037d0, 6039634, 425822a, f3cc856.
A benchmark case that was edited in the window also shows here; check
git log bench/casesbefore bisecting. Charts: thebench-databranch.Counts on master grew by more than 3% between 1ad80c3 and 6388fc9 (10 recorded merges; latest: Merge pull request #439 from jinja2cpp/claude/perf-wave2-arena-slots-p6gl1u).
Benchmark Metric Before Now Change Render/large_static instructions 26,629 27,520 +3.35% Commits in the window: d47d436, 8a2018d, d333c43, 16f3f3b, 3cc8e7d, 5a037d0, 6039634, 425822a, f3cc856, 6388fc9.
A benchmark case that was edited in the window also shows here; check
git log bench/casesbefore bisecting. Charts: thebench-databranch.Counts on master grew by more than 3% between f3cc856 and 08bce40 (10 recorded merges; latest: robin_hood allocates through operator new, so the bench counts its blocks (0154 part A) (#454)).
Benchmark Metric Before Now Change Render/inheritance allocations 76 81 +6.58% Render/many_tags allocations 2 15 +650.00% Commits in the window: 6388fc9, d509a09, 50dec81, 1734c9b, 0b1bf2f, 2486c22, ec9e7b4, 0aa521d, 2a844f9, 08bce40.
A benchmark case that was edited in the window also shows here; check
git log bench/casesbefore bisecting. Charts: thebench-databranch.Counts on master grew by more than 3% between 2a844f9 and ce547f1 (10 recorded merges; latest: docs/tasks/0151: P2 allocation counts as its targets).
Benchmark Metric Before Now Change Render/chat_llama allocations 348 421 +20.98% Render/chat_mistral allocations 426 491 +15.26% Render/chat_qwen allocations 337 395 +17.21% Render/config_file allocations 1,169 1,281 +9.58% Render/filters allocations 35 51 +45.71% Render/html_autoescape allocations 1,003 1,094 +9.07% Render/strings allocations 975 1,285 +31.79% Commits in the window: 08bce40, 5219f69, 0ae6057, 84f2ea0, 523d59e, 66c143e, 2fc6371, 6471f17, 89aa3b7, ce547f1.
A benchmark case that was edited in the window also shows here; check
git log bench/casesbefore bisecting. Charts: thebench-databranch.
Counts on master grew by more than 3% between 65f7a31 and d2a4838 (10 recorded merges; latest: Merge pull request #390 from jinja2cpp/claude/project-thread-w7wy7z).
Commits in the window: 6e82ae9, a24f887, 098d156, 29c6c73, cf927ef, b7eacec, b31499d, f081f25, 5a42640, d2a4838.
A benchmark case that was edited in the window also shows here; check
git log bench/casesbefore bisecting. Charts: thebench-databranch.