uber / RemoteShuffleService

Remote shuffle service for Apache Spark to store shuffle data on remote servers.

uber/RemoteShuffleService Issues

Corrupted block detected during decompression
Updated a year ago
[Spark 3] RSS performance with Adaptive Skew Join Optimization
Updated a year ago3
Spark 3.1/3.2 failed sql skew and local reader tests
Updated a year ago2
what may cause RssInvalidServerVersionException?
Updated a year ago2
Does Rss support YARN executor preemption?
Closed a year ago
Does zeus only support jdk 11 +
Updated a year ago2
Can Rss have stage retry when one server is down?
Updated a year ago13
fault tolerance of restarting server
Updated 2 years ago7
Rss shuffle data size is much larger than external shuffle service
Closed 2 years ago6
How to evaluate rss cluster size?
Updated 2 years ago1
Disk damage causes failure
Updated 2 years ago10
Root directory not configurable via Helm chart
Updated 2 years ago
hit exception writing heading bytes XXXXX
Closed 2 years ago8
Why this cannot support speculation
Updated 2 years ago5
How long the shuffle data of each ShuffleStage will be stored in RSS nodes?
Updated 2 years ago6
Metrics in ScheduledMetricCollector
Closed 2 years ago
How to get metrics value from RSS?
Updated 2 years ago3
Does RSS support multiple StreamServers on the same node?
Closed 2 years ago4
write amplification
Updated 2 years ago2
Shuffle Files Storage Is stored by default.Whether alluxio storage is supported and how to implement it.
Updated 2 years ago5
spark 3.0
Updated 2 years ago4
Using remote shuffle service with Spark operator
Updated 2 years ago2
spark 3.1/3.2?
Updated 2 years ago10
Unable to register with external shuffle server
Closed 2 years ago9
Not support Storing data on HDFS and dynamicAllocation?
Closed 2 years ago1
When to remove shuffle data in /tmp/StreamServer_* ？
Closed 2 years ago
which branch should be used for building jar and image for remote shuffle service for K8 environment?
Updated 3 years ago6
Failed to get all RSS servers
Closed 3 years ago3
[Proposal] Unsafe memory management in RSS mappers
Updated 3 years ago
how to run on k8s
Closed 3 years ago
Why not use netty to create and manage client
Updated 3 years ago
Whether to consider publishing the RemoteShuffleService jar to the Maven repository?
Updated 3 years ago
shuffle read error
Closed 3 years ago5
Does rss support hiveOnSpark?
Closed 3 years ago3
It has error when using Spark 3.1 with RSS Spark-30 branch
Closed 3 years ago2
Compilation error caused by scala-maven-plugin
Closed 3 years ago1
Reading control message may throw an exception in StreamServerMessageDecoder
Closed 3 years ago1
Compile error on Spark30 branch
Closed 3 years ago1
How to gracefully retention one RSS server?
Updated 4 years ago3
Unable to match RssShuffleHandle
Closed 4 years ago3
Unsupported shuffle manager
Closed 4 years ago2
Zeus?
Closed 4 years ago2