All pull requests

Pull requests

• [CELEBORN-2479] Show shuffle compression ratio in Spark UI

  kind:buildmodule:clientmodule:commonmodule:spark
  #3872·yew1eb opened Oct 13, 2026Contributor·1 of 2 tasks·

  ·
  3

• [CELEBORN-2478] Add celeborn-client build information to Spark UI Celeborn tab

  kind:buildmodule:clientmodule:commonmodule:spark
  #3870·yew1eb opened Oct 13, 2026Contributor·

  ·
  3

• [CELEBORN-XXXX] Fix memory leak of committedFileInfos when graceful shutdown is disabled

  correctnessmodule:worker
  #3860·SoulKyu opened Oct 5, 2026·1 of 2 tasks·

  ·
  3

• [CELEBORN-XXXX] Skip memory file storage for replica partitions

  kind:documentationmodule:commonmodule:worker
  #3859·venkata91 opened Sep 29, 2026Contributor·1 of 2 tasks·

  ·

• [CELEBORN-2469] Add worker stats collection and reporting for autoscaling

  kind:documentationmodule:commonmodule:mastermodule:worker
  #3858·Kalvin2077 opened Sep 24, 2026Contributor·1 of 2 tasks·

  ·
  5

• [CELEBORN-2468] Support pluggable transport authentication and authorization

  correctnesskind:documentationmodule:clientmodule:commonmodule:flinkmodule:mastermodule:worker
  #3857·Kalvin2077 opened Sep 23, 2026Contributor·2 tasks done·

  ·
  15

• [CELEBORN-2464] Wire Kubernetes health probes into the Helm chart

  kind:deploy
  #3854·strelok89 opened Sep 17, 2026Contributor·1 of 2 tasks·

  ·
  7

• [CELEBORN-2465][SPARK] Proactively unregister shuffles on SQL query completion

  kind:documentationmodule:clientmodule:commonmodule:sparkmodule:tests
  #3853·yew1eb opened Sep 17, 2026Contributor·

  ·
  16

• [CELEBORN-2460] Reply SHUFFLE_EXPIRED for a released shuffle instead of an empty file group

  correctnessmodule:clientmodule:commonmodule:tests
  #3845·shlomitubul opened Sep 10, 2026Contributor·1 of 2 tasks·

  ·
  14

• [CELEBORN-2459] Fix race causing DataPusher to accept data during termination and drop it

  correctnessmodule:clientstale
  #3844·rjvkr2021 opened Sep 9, 2026·1 task done·

  ·
  18

• [CELEBORN-2457][CIP-24] Adaptive partition write parallelism

  kind:documentationmodule:clientmodule:commonmodule:testsmodule:worker
  #3843·yew1eb opened Sep 8, 2026Contributor·1 of 2 tasks·

  ·
  1

• [CELEBORN-2451] Make DRA safe under AUTO fallback by tying supportsReliableStorage to fallback policy

  correctnesskind:documentationmodule:clientmodule:spark
  #3834·venkata91 opened Aug 31, 2026Contributor·2 tasks done·

  ·
  18

• [CELEBORN-2445] Support overriding decommission forceExitTimeout via the worker exit API

  kind:documentationmodule:climodule:openapimodule:servicemodule:worker
  #3828·cxzl25 opened Aug 26, 2026Contributor·2 tasks·

  ·
  18

• [CELEBORN-2429][CIP-23] Batch worker/application heartbeats into aggregated raft log entries

  kind:documentationmodule:commonmodule:master
  #3810·yew1eb opened Aug 19, 2026Contributor·2 tasks·

  ·
  9

• [CELEBORN-2391] Eliminate intermediate byte[] allocation in Encoders.Strings via Netty ByteBufUtil

  kind:buildmodule:common
  #3769·yew1eb opened Jul 26, 2026Contributor·

  ·
  15

• [CELEBORN-2388] Decouple inter-master Ratis TLS into its own SSL module

  module:commonmodule:master
  #3767·shellfish007 opened Jul 23, 2026·

  ·
  10

• [CELEBORN-2389] Track S3 resource consumption in per-app/per-user metrics

  module:commonmodule:mastermodule:worker
  #3766·shellfish007 opened Jul 23, 2026·

  ·
  3

• [CELEBORN-2387] Add ReserveSlotsFailCount worker metric

  module:worker
  #3765·shellfish007 opened Jul 23, 2026·

  ·
  6

• [CELEBORN-2386] Pass peer hostname to SSLEngine for SNI support

  module:common
  #3764·shellfish007 opened Jul 23, 2026·

  ·
  5

• [CELEBORN-194] Introduce client side metrics for celeborn

  kind:deploykind:documentationmodule:clientmodule:commonmodule:master
  #3740·AmandeepSingh285 opened Jun 15, 2026Contributor·2 tasks·

  ·
  94

• [CELEBORN-2349] Support worker supplied tags and TagsManager hardening

  kind:documentationmodule:commonmodule:mastermodule:worker
  #3719·s0nskar opened Jun 5, 2026Contributor·1 of 2 tasks·

  ·
  34

• [CELEBORN-2065] Worker should support wait partition sort asynchronously

  module:worker
  #3652·leixm opened Apr 7, 2026Contributor·

  ·
  11