nlpxucan / WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Question about WizardCoder-1B-V1.0

hgKang02 opened this issue · comments

Hi, I have a question about the WizardCoder model, especially in 1B size. I read the paper about WizardCoder and can see that WizardCoder-15B is fine-tuned from StarCoder 15B. I want to ask whether the 1B model is also fine-tuned from the StarCoder 1B model, or is there other way that the 1B model is built? Thank you for your consideration.

Sincerely,
Hangoo Kang.

yes. the 1b-version is from the starcoderbase-1b