nlpxucan / WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

catastrophi forgetting

DaiJianghai opened this issue · comments

your work is excellent, i have used your code to fintune on my own dataset, but the phenomenon of catastrophi forgetting is serious. Could you give some suggestions to overcome it? Thanks a lot!