dropout_add_layer_norm is not installed

[oferballin]

Hi All,

We are trying to run Hyena with lambada.py and get this error: "ImportError: dropout_add_layer_norm is not installed"
Many trials with installing flash-attn in various versions and other imports did not work.

Any hints or tips on how to solve?

Thx!
Ofer

[Liwen Yao]

You can install:
cd csrc/layer_norm && python setup.py install

This works for me.