nlpxucan / WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Wizard Math 7B cann't stop generate

Fazziekey opened this issue · comments

commented

image

when I use Wizard Math 7B generate, it can't stop, and out out </s> which is same to eos token, and I print the output tensor in torch , I find the </s> is be split to three token, </,s,>, which is not eos token,
but when I use the Wizard 13B, it works , I think there may be err in Wizard Math 7B SFT

Thank you for your interest in our work. Maybe you should to manually set the stop_tokens = ['</s>'] like our WizardMath demo

commented

Thank you for your interest in our work. Maybe you should to manually set the stop_tokens = [''] like our WizardMath demo

Thanks