yangjianxin1 / Firefly

Firefly: 大模型训练工具,支持训练Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

ValueError: Target modules [] not found in the base model. Please check the target modules and try again.

sankexin opened this issue · comments

model:
firefly-gemma-2b-sft-qlora

env:
OS: CentOS Linux 7 (Core) (x86_64)
[pip3] apex==0.1+2a4864d.abi0.dtk2310.torch2.1
[pip3] deepspeed==0.12.3+git299681e.abi0.dtk2310.torch2.1.0a0
[pip3] numpy==1.21.4
[pip3] torch==2.1.0a0+git793d2b5.abi0.dtk2310
[pip3] torchvision==0.16.0+git267eff6.abi0.dtk2310.torch2.1.0
[pip3] triton==2.1.0

升级到最新版本的transformers无法解决,仍然报这个错误。