Vicuna models don't start
dadmobile opened this issue · comments
The vicuna models don't start on MLX or fastchat:
b'2024-04-09 16:12:29 | ERROR | stderr | raise EnvironmentError(\n'
b"2024-04-09 16:12:29 | ERROR | stderr | OSError: vicuna-7b-v1.5 is not a local folder and is not a valid model identifier listed on 'https://huggingface.co/models'\n"
I believe this is because they don't have a huggingface style unique ID and we set the foundation to unique ID in our experiments. Either we should check for huggingface_repo instead of uniqueID or we should fix the vicuna ID to match the format of the other models (the second one is probably easier but just covers up this weirdness).
Fixed the vicuna ID although it's possible this will cause some model details to not appear properly for people who downloaded the model in the past.