ValueError: Target modules [] not found in the base model. Please check the target modules and try again.
sankexin opened this issue · comments
sankexin commented
model:
firefly-gemma-2b-sft-qlora
env:
OS: CentOS Linux 7 (Core) (x86_64)
[pip3] apex==0.1+2a4864d.abi0.dtk2310.torch2.1
[pip3] deepspeed==0.12.3+git299681e.abi0.dtk2310.torch2.1.0a0
[pip3] numpy==1.21.4
[pip3] torch==2.1.0a0+git793d2b5.abi0.dtk2310
[pip3] torchvision==0.16.0+git267eff6.abi0.dtk2310.torch2.1.0
[pip3] triton==2.1.0
sankexin commented
升级到最新版本的transformers无法解决,仍然报这个错误。