Skip to content

Update pytest-benchmark requirement from <=5.2.3 to <=5.3.0 - #2307

Open
dependabot[bot] wants to merge 1 commit into
masterfrom
dependabot/pip/pytest-benchmark-lte-5.3.0
Open

Update pytest-benchmark requirement from <=5.2.3 to <=5.3.0#2307
dependabot[bot] wants to merge 1 commit into
masterfrom
dependabot/pip/pytest-benchmark-lte-5.3.0

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Aug 27, 2026

Copy link
Copy Markdown
Contributor

Updates the requirements on pytest-benchmark to permit the latest version.

Release notes

Sourced from pytest-benchmark's releases.

v5.3.0

Changelog

Sourced from pytest-benchmark's changelog.

v5.3.0 (2026-08-23)

  • Added --benchmark-precision and --benchmark-confidence: instead of a fixed number of rounds, stop once the mean's relative margin of error falls below the given fraction. Contributed by Aarni Koskela in [#318](https://github.com/ionelmc/pytest-benchmark/issues/318) <https://github.com/ionelmc/pytest-benchmark/pull/318>_.
  • Added compare --between mode. Example: pytest-benchmark compare --between=min 0001 0002. Contributed by Aarni Koskela in [#302](https://github.com/ionelmc/pytest-benchmark/issues/302) <https://github.com/ionelmc/pytest-benchmark/pull/302>_.
  • Modernized the CI/linting and added spellchecking. Contributed by Aarni Koskela in [#304](https://github.com/ionelmc/pytest-benchmark/issues/304) <https://github.com/ionelmc/pytest-benchmark/pull/304>, [#306](https://github.com/ionelmc/pytest-benchmark/issues/306) <https://github.com/ionelmc/pytest-benchmark/pull/306> and [#319](https://github.com/ionelmc/pytest-benchmark/issues/319) <https://github.com/ionelmc/pytest-benchmark/pull/319>_.
  • Defer the xdist auto-disable warning until a benchmark fixture is collected. Contributed by xlyyddy in [#317](https://github.com/ionelmc/pytest-benchmark/issues/317) <https://github.com/ionelmc/pytest-benchmark/pull/317>_ (fixes [#65](https://github.com/ionelmc/pytest-benchmark/issues/65) <https://github.com/ionelmc/pytest-benchmark/issues/65>_).
  • Replaced deprecated argparse.FileType. Contributed by Sophia Castellarin in [#310](https://github.com/ionelmc/pytest-benchmark/issues/310) <https://github.com/ionelmc/pytest-benchmark/pull/310>_.
  • Fixed various spelling/typos. Contributed by Daniel Holth and Hugo van Kemenade in [#297](https://github.com/ionelmc/pytest-benchmark/issues/297) <https://github.com/ionelmc/pytest-benchmark/pull/297>_ and [#299](https://github.com/ionelmc/pytest-benchmark/issues/299) <https://github.com/ionelmc/pytest-benchmark/pull/299>_.
  • Cleaned up various dead code. Contributed by Hugo van Kemenade in [#300](https://github.com/ionelmc/pytest-benchmark/issues/300) <https://github.com/ionelmc/pytest-benchmark/pull/300>_ and [#301](https://github.com/ionelmc/pytest-benchmark/issues/301) <https://github.com/ionelmc/pytest-benchmark/pull/301>_.
  • CI now tests only with latest Pytest (now 9.1.1), Python 3.10-3.14 and PyPy 3.11.

v5.2.3 (2025-11-09)

  • Add support for pytest 9.0.
  • Moved the README.rst/CHANGELOG.rst concatenation from setup.py to pyproject.toml.

v5.2.2 (2025-11-07)

  • Fixed auto-disable to work with newer xdist (pytest-benchmark auto disables benchmarks if xdist is enabled by design). Contributed by Thomas B. Brunner in [#294](https://github.com/ionelmc/pytest-benchmark/issues/294) <https://github.com/ionelmc/pytest-benchmark/pull/294>_.

v5.2.1 (2025-11-04)

  • Add markers so pytest doesn't try to assert-rewrite the plugin internals (fixes those pytest.PytestAssertRewriteWarning: Module already imported so cannot be rewritten; pytest_benchmark warnings).

v5.2.0 (2025-10-30)

  • Added support for a per-round teardown function to pedantic mode.

... (truncated)

Commits
  • 07d5196 Bump version: 5.2.3 → 5.3.0
  • accf733 Add some details on #304.
  • 417dd9f Really update the changelog.
  • 898acb3 Update changelog and plan release.
  • 9cc7ef0 Defer xdist warning until benchmark collection (#65)
  • ef48550 Some minor skel updates: test only against latest pytest; bump linting/format...
  • 88eaea9 Add --benchmark-precision for adaptive rounds (opt-in)
  • 3b83d12 Update and freeze GHA actions
  • 4b7662f Fix ruff complaints
  • 26b0113 Remove Taplo lint (unmaintained)
  • Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Updates the requirements on [pytest-benchmark](https://github.com/ionelmc/pytest-benchmark) to permit the latest version.
- [Release notes](https://github.com/ionelmc/pytest-benchmark/releases)
- [Changelog](https://github.com/ionelmc/pytest-benchmark/blob/master/CHANGELOG.rst)
- [Commits](ionelmc/pytest-benchmark@v2.5.0...v5.3.0)

---
updated-dependencies:
- dependency-name: pytest-benchmark
  dependency-version: 5.3.0
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot Bot added dependencies Issue related to libraries we depend on and how we interface with them run_benchmarks Run timing benchmarks on this PR against current master branch skip_changelog No need to update changelog on this PR labels Aug 27, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Memory benchmark result

|               Test Name                |      %Δ      |    Master (MB)     |      PR (MB)       |    Δ (MB)    |    Time PR (s)     |  Time Master (s)   |
| -------------------------------------- | ------------ | ------------------ | ------------------ | ------------ | ------------------ | ------------------ |
  test_objective_jac_w7x                 |   -0.13 %    |     4.242e+03      |     4.236e+03      |    -5.44     |       28.57        |       26.99        |
  test_proximal_jac_w7x_with_eq_update   |    0.04 %    |     6.814e+03      |     6.817e+03      |     3.03     |       138.20       |       137.18       |
  test_proximal_freeb_jac                |   -0.18 %    |     1.355e+04      |     1.352e+04      |    -24.51    |       80.87        |       81.02        |
  test_proximal_freeb_jac_blocked        |    0.07 %    |     7.852e+03      |     7.858e+03      |     5.44     |       72.97        |       73.18        |
  test_proximal_freeb_jac_batched        |   -0.26 %    |     7.878e+03      |     7.857e+03      |    -20.80    |       71.33        |       70.71        |
  test_proximal_jac_ripple               |   -1.25 %    |     3.789e+03      |     3.741e+03      |    -47.51    |       47.73        |       48.00        |
  test_proximal_jac_ripple_bounce1d      |   -1.76 %    |     3.977e+03      |     3.907e+03      |    -69.87    |       61.55        |       60.51        |
  test_eq_solve                          |   -0.18 %    |     1.833e+03      |     1.830e+03      |    -3.31     |       47.13        |       46.67        |
  test_objective_quadratic_flux_jac      |   -0.18 %    |     1.888e+03      |     1.884e+03      |    -3.38     |       31.29        |       31.34        |

For the memory plots, go to the summary of Memory Benchmarks workflow and download the artifact.

@codecov

codecov Bot commented Aug 27, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 94.35%. Comparing base (187e98e) to head (4c2d5d0).

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #2307      +/-   ##
==========================================
+ Coverage   94.34%   94.35%   +0.01%     
==========================================
  Files         101      101              
  Lines       29042    29042              
==========================================
+ Hits        27400    27403       +3     
+ Misses       1642     1639       -3     

see 2 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Issue related to libraries we depend on and how we interface with them run_benchmarks Run timing benchmarks on this PR against current master branch skip_changelog No need to update changelog on this PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants