transformerlab / transformerlab-app

Experiment with Large Language Models

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Local Connection installer: No error reported if there are exceptions during "Install Dependencies" step

dadmobile opened this issue · comments

If flash_attn fails to build using the UI installer, the app will just report Success and continue. Then you'll just hit weird errors in the app later on.

It would be really helpful if we could figure out how to install from a wheel instead of trying to build flash_attn locally.

NOTE: It looks like flash_attn will fail to build on WSL right now without g++, which does not come installed on the default WSL ubuntu distribution.

Changing this to a more generic bug...if there is an error during "Install Dependencies" they are not reported. We rely on CheckDependencies to make sure it's OK to go forward, but if something goes wrong there's no way to know why without looking at the logs. This is true for flash_attn and other dependencies.