mosaicml / llm-foundry

LLM training code for Databricks foundation models

Home Page:https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Installation issue from habana_alpha branch

palash04 opened this issue · comments

Removed flash attn dependencies from requirements.txt, and it worked. Should it be installed for gaudi?

That's right, the flash-attn dependenices should not be required for Gaudi. If you'd like to submit a PR to this branch editing the setup.py requirements, please go for it!