apache / celeborn

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

https://celeborn.apache.org/

[BUG] Relax isRssEnabled condition to compatible with gluten celeborn shuffle manager

ulysses-you opened this issue a year ago · comments

Xiduo You commented a year ago

What is the bug(with logs or screenshots)?

According to
https://github.com/oap-project/gluten/blob/e012b50e3dc2f082c82b324f0be2b1d6f277511b/gluten-celeborn/src/main/java/org/apache/spark/shuffle/gluten/celeborn/CelebornShuffleManager.java#L24

The celeborn shuffle manager of gluten is not org.apache.spark.shuffle.celeborn.RssShuffleManager, then it breaks the result of isRssEnabled.

How to reproduce the bug?

Steps to reproduce the bug.

/cc @who-need-to-know

/assign @who-can-solve-this-bug