Giters

nlpxucan / WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

What are the GPU requirements for fine-tuning the WizardCoder-Python 7/13/34B models?

matt-sharp opened this issue · comments

commented

I might need to fine-tune Wizardcoder on my source code and would like to know which model to start with. I have a single V100 with 32Gb RAM. Which size of model is it possible to fine-tune with this hardware?