How to load dataset in offline mode?

[Huaxin Zhang]

Since my server can't access huggingface.co, how can I load dataset from local direction?
Thank you for your contributions!

[Kaichen Zhang - NTU]

Hi, you can refer to

#15 and #21

[Huaxin Zhang]

Thanks, I solve this problem by defining local_dir in lmms-eval/lmms_eval/api/task.py line.528

self.DATASET_PATH = os.path.join(local_dir, self.config.dataset_path)