Giters

salesforce / CodeGen

CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Problems With HumanEval

MT010104 opened this issue · comments

commented

Thanks for the work. CogeGen has achieved relatively good results on HumanEval, but I wanna know how the model is finetuned. Because it only has 164 problems, can you provide parameters for finetuning?

commented

CodeGen is only pre-trained on the datasets mentioned in the paper, then evaluated on HumanEval in a zero-shot manner. There is no fine-tuning involved.