Giters

transformerlab / transformerlab-app

Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.

Home Page:https://transformerlab.ai/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Vicuna models don't start

dadmobile opened this issue · comments

commented

The vicuna models don't start on MLX or fastchat:

b'2024-04-09 16:12:29 | ERROR | stderr | raise EnvironmentError(\n'
b"2024-04-09 16:12:29 | ERROR | stderr | OSError: vicuna-7b-v1.5 is not a local folder and is not a valid model identifier listed on 'https://huggingface.co/models'\n"

I believe this is because they don't have a huggingface style unique ID and we set the foundation to unique ID in our experiments. Either we should check for huggingface_repo instead of uniqueID or we should fix the vicuna ID to match the format of the other models (the second one is probably easier but just covers up this weirdness).

commented

Fixed the vicuna ID although it's possible this will cause some model details to not appear properly for people who downloaded the model in the past.