Giters

stanford-crfm / helm

Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in Holistic Evaluation of Text-to-Image Models (HEIM) (https://arxiv.org/abs/2311.04287).

Home Page:https://crfm.stanford.edu/helm

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

HumanEval Code Scenario- From where do we get input_output.json

kapilmayank opened this issue · comments

commented

Thanks in advance
Please reply on kapilmayank6@gmail.com

commented

HumanEval does not appear to have a input_output.json. Are you referring to APPS's input_output.json here?

Please reply on kapilmayank6@gmail.com

We prefer to keep discussions on GitHub rather than email, so that there is a public record that can be referred to by other users.