Giters

huggingface / lighteval

LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Problem with mutliple tasks from the same dataset

clefourrier opened this issue · comments

commented

Need to see if it can be repro, but I can only load BBH by manually forcing all my processes to wait for one another.

commented

Was linked to force_redownload, issue was fixed in datasets here