Potential reasons for stuck building wheel for droput-layer-norm

[Shida Wang]

Hi! It's a really nice repo and the code is quite clear to read.

As I was trying to run the hyena code for language model, it seems the building for third layer_norm package is stuck and I've waited for the third install a whole day.

cd ./csrc/fused_dense_lib && pip install .
cd ../xentropy && pip install .
cd ../layer_norm && pip install .

I just wonder if it's normal for a build to take so long or some bug with my configuration.

Basically the current output for (stuck terminal) is:

Building wheels for collected packages: dropout-layer-norm
  Building wheel for dropout-layer-norm (setup.p) ... |

Thank you so much for reading my issue!

[Shida Wang]

Just found this issue has been proposed in flash-attention repo(Dao-AILab/flash-attention#131)