Unable to load interleave model
justinphen opened this issue · comments
When I was trying to run the gradio demo with the new llava-next-interleave-7b model, I ran into the following two errors. Any ideas?
When I was trying to run the gradio demo with the new llava-next-interleave-7b model, I ran into the following two errors. Any ideas?
You need to install llava-next first.
When I was trying to run the gradio demo with the new llava-next-interleave-7b model, I ran into the following two errors. Any ideas?
You need to install llava-next first.
The thing is, I have already installed llava-next before running this file. So not sure what caused this problem...
If you install flash attention module, then might be solved.