Skip to content

[python] Introduce rbm32/rbm64 aggregator function#8724

Open
PyRSA wants to merge 2 commits into
apache:masterfrom
PyRSA:feature/pypaimon-roaring-bitmap-agg-impl
Open

[python] Introduce rbm32/rbm64 aggregator function#8724
PyRSA wants to merge 2 commits into
apache:masterfrom
PyRSA:feature/pypaimon-roaring-bitmap-agg-impl

Conversation

@PyRSA

@PyRSA PyRSA commented Jul 19, 2026

Copy link
Copy Markdown
Contributor

Purpose

This PR introduces the Python FieldRoaringBitmap32Agg and FieldRoaringBitmap64Agg implementations and aligns the Python roaring bitmap aggregation behavior with the Java implementation.

The changes include:

  • Add rbm32 and rbm64 field aggregation support.
  • Support roaring bitmap merge using serialized bytes representation.
  • Add VARBINARY type validation for roaring bitmap aggregation.
  • Add unit tests for aggregation and invalid input types.

Tests

  • python -m pytest pypaimon/tests/test_field_aggregators.py::FieldRoaringBitmap32AggTest -q
  • python -m pytest pypaimon/tests/test_field_aggregators.py::FieldRoaringBitmap64AggTest -q
  • python -m pytest pypaimon/tests/test_aggregation_e2e.py -q
  • python -m pytest pypaimon/tests/test_aggregation_merge_function.py -q
  • git diff --check

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant