Repository navigation

[SPARK-60717][CONNECT] Skip redundant canonical int64 Arrow normalization - #137

Draft

dbtsai wants to merge 9 commits into

apache:masterfrom

dbtsai:codex/spark-60717-canonical-arrow-input

Draft

[SPARK-60717][CONNECT] Skip redundant canonical int64 Arrow normalization#137
dbtsai wants to merge 9 commits into
apache:masterfrom
dbtsai:codex/spark-60717-canonical-arrow-input

Commits on Oct 29, 2026
- Export Arrow tables through the C Stream interface
  dbtsai
  committed
  d7cebc3
- Use arrow-rs reader conversion for the C Stream handoff
  dbtsai
  committed
  afb69bc
- Simplify Arrow handoff tests and add live-server smoke cases
  
  dbtsai
  and
  Isaac
  committed
  d89c01b
- Skip Arrow handoff tests when protoc is unavailable
  
  dbtsai
  and
  Isaac
  committed
  fe79d54
- [SPARK-60675][CONNECT] Support PyArrow Table input through the C Stream interface
  
  dbtsai
  and
  Isaac
  committed
  c4bbfd3
- [SPARK-60675][CONNECT] Upload large Arrow inputs as cached relations
  
  dbtsai
  and
  Isaac
  committed
  ce89b8d
- [SPARK-60698][CONNECT] Batch Arrow input normalization config reads
  
  dbtsai
  and
  Isaac
  committed
  911e23c
- [SPARK-60717][CONNECT] Skip redundant canonical int64 Arrow normalization
  
  dbtsai
  and
  Isaac
  committed
  2e1b604
Commits on Oct 30, 2026
- [SPARK-60717][CONNECT] Merge upstream Arrow output guards
  
  dbtsai
  and
  Isaac
  committed
  ef2e76c