karpathy / llm.c

LLM training in simple, raw C/CUDA

Repository from Github https://github.comkarpathy/llm.cRepository from Github https://github.comkarpathy/llm.c

CI tests are dependent on connectivity/uptime of huggingface

dagelf opened this issue · comments

Possible to modify it to use cached files? Or to use git-lfs and keep file pointers here? (and ensure consistency of files and tests) Or to pause the test until dependent connections are restored? Or reschedule tests for later? How do people normally deal with external dependencies breaking tests?

image

Resolved partially by #216

CI still depends on pip of course. But I haven't seen that fail in a long time 😅

Edit: 🤦 lol and GPT2.. so git lfs?

Edit: Oh wait, git lfs will just pull from HF by default, won't it... ? I'm learning fast here. 💟

Maybe later... for now the repo is still <2M... so this increases size more than 30% 😅