Skip to main content

Apache Uniffle (Incubating)

A high performance, general purpose remote shuffle service for distributed computing engines.

Fast

Reduces number of connections and random I/O in data shuffle.

Reliable

Reduces out of memory (or disk space) failures for large jobs.

Elastic

Enables orchestration and improves resource utilization.

Spark Support

Supports Apache Spark 2.3.x, 2.4.x, 3.0.x, 3.1.x, 3.2.x, 3.3.x.

MapReduce/Tez Support

Supports the MapReduce framework of Apache Hadoop 2.8.x, 3.2.x and Apache Tez 0.9.1.

Kubernetes Operator

Extends the Kubernetes API to create, configure, and manage Uniffle instances.