All pull requests

Pull requests

• perf: sort JVM shuffle spill pointers in the sorter's scratch space

  area:shuffleenhancementperformance
  #7125·viirya opened Oct 20, 2026Member·

  ·
  1

• fix: export large_string and large_binary vectors with 32-bit offsets

  area:ffibug
  #7124·afterincomparableyum opened Oct 20, 2026·

  ·
  1

• fix: default broadcast build side conversion to off and document invalid UTF-8 cases

  bug
  #7123·andygrove opened Oct 20, 2026Member·

  ·
  1

  7

• fix: fall back when an Iceberg equality delete is keyed on a nested field

  area:Icebergarea:scanbug
  #7122·yunchipang opened Oct 20, 2026·Queued
  1

  1

• fix: preserve make_date overflow and skipped evaluation

  area:expressionsarea:ffibug
  #7117·pingzh opened Oct 19, 2026Contributor·

  ·
  1

  12

• fix: fall back to Spark for mode on FLOAT and DOUBLE before Spark 3.5.2

  area:aggregationbugrun-all-spark-profiles
  #7115·andygrove opened Oct 19, 2026Member·

  ·
  1

• test: move the float semantics sweep to SQL file tests

  enhancementrun-all-spark-profilestest
  #7114·andygrove opened Oct 19, 2026Member·

  ·
  1

• docs: publish the newest release at user-guide/latest and main at user-guide/dev

  area:Deltaarea:Icebergarea:scandocumentation
  #7112·andygrove opened Oct 19, 2026Member·

  ·

  · 1.2.0
  16

• chore: fix compiler warnings in the spark module

  area:ffiarea:Icebergarea:scanarea:shuffleenhancement
  #7110·andygrove opened Oct 19, 2026Member·

  ·
  2

• fix: decode invalid UTF-8 in nested Parquet BINARY values read as strings

  area:expressionsarea:scanbug
  #7106·manuzhang opened Oct 19, 2026Member·

  ·
  4

• fix: point the external sort OOM error at Comet's memory settings

  area:ffibug
  #7104·ump45nose opened Oct 18, 2026·

  ·
  1

  6

• feat: write top-level Iceberg unknown columns natively

  area:Icebergarea:writerenhancementrun-all-spark-profiles
  #7100·yunchipang opened Oct 18, 2026·

  ·
  13

• fix: point the spill limit error at spark.comet.maxTempDirectorySize

  area:ffibug
  #7098·ump45nose opened Oct 17, 2026·

  ·
  1

• fix: make fair_unified's per-consumer limit bind when tasks run concurrently

  area:Deltaarea:Icebergarea:memoryarea:writerbugrun-all-spark-profiles
  #7096·andygrove opened Oct 17, 2026Member·

  ·
  2

  8

• fix: scope fallback reasons to the current conversion

  area:expressionsbug
  #7095·sam-1112 opened Oct 17, 2026Contributor·

  ·
  1

• perf: load the next Parquet file's footer and page index while the current file is read

  area:scanenhancementperformance
  #7094·andygrove opened Oct 17, 2026Member·

  ·
  25

• fix: reject TIMESTAMP(NANOS) Parquet columns read as timestamp

  area:Icebergarea:scanbug
  #7089·ump45nose opened Oct 17, 2026·

  ·
  6

• fix: match Spark nullness for missing nested Parquet fields

  area:Icebergarea:scanbugrun-iceberg-testsrun-spark-3.5-testsrun-spark-4.1-tests
  #7085·rich7420 opened Oct 17, 2026Contributor·

  ·
  1

  2

• fix: hash NullType and ANSI interval values natively

  area:expressionsbug
  #7084·ump45nose opened Oct 17, 2026·

  ·
  1

  1

• perf: share Parquet footer and page index metadata across the tasks of a stage

  area:Deltaarea:scanenhancementperformancerun-spark-3.5-testsrun-spark-4.1-tests
  #7082·andygrove opened Oct 16, 2026Member·

  ·
  10

• feat: spilling shuffled hash join (research draft)

  area:joinsenhancementrun-spark-4.1-tests
  #7057·andygrove opened Oct 16, 2026Member·

  ·

• refactor: share filter and projection metrics wrapper

  enhancement
  #7056·rich7420 opened Oct 16, 2026Contributor·

  ·
  1

• test: re-enable the NullType Parquet read tests that #4199 skipped

  enhancementrun-spark-4.1-testsrun-spark-4.2-teststest
  #7054·andygrove opened Oct 16, 2026Member·

  ·
  1

• fix: write the Spark version into the footer of natively written Parquet files

  area:writerbug
  #7053·andygrove opened Oct 16, 2026Member·

  ·

  · 1.2.0
  1

  7

• fix: log native panic backtraces instead of attaching them to the exception

  area:ffibug
  #7042·viirya opened Oct 15, 2026Member·

  ·
  1

  9