Giters

LLaVA-VL / LLaVA-NeXT

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

llavaconfig error

homiec opened this issue · comments

commented

File "/home/ma-user/anaconda3/envs/llava/lib/python3.10/site-packages/transformers/configuration_utils.py", line 264, in getattribute
return super().getattribute(key)
AttributeError: 'LlavaConfig' object has no attribute 'mlp_bias'

What is the cause of this problem?

commented

I have the same problem, have you figure out the solution yet ?

commented

I also have this problem when trying to test the inference with LLaVA-NeXT-Video-7B-DPO.

commented

I also have this problem when trying to test the inference with LLaVA-NeXT-Video-7B-DPO.

It seems I have fixed this problem. We have to build the environment by pip install -e ".[train]". The problem is because of the environment.

commented

I also have this problem when trying to test the inference with LLaVA-NeXT-Video-7B-DPO.

It seems I have fixed this problem. We have to build the environment by pip install -e ".[train]". The problem is because of the environment.

I still have the problem after pip install -e ".[train]". May I know what operation system you are system ? I'm currently on Mac OS Sonoma

commented

@reachsak Hi, in the pyproject.toml, the train target require transformers version is :

"transformers@git+https://github.com/huggingface/transformers.git@1c39974a4c4036fd641bc1191cc32799f85715a4"

I uninstall transformers and reinstall by

pip install transformers@git+https://github.com/huggingface/transformers.git@1c39974a4c4036fd641bc1191cc32799f85715a4

solved the problem.

The werid thing is, I check the transformers version, the versions after 4.40.0 is conclude this commit, "1c39974a4c4036fd641bc1191cc32799f85715a4", I dont know this issue still happened.