SHA256 Sums
opened this issue · comments
Look at this: https://the-eye.eu/public/AI/pile/SHA256SUMS.txt
What is that file for, and does it have any significance in this repo?
This is for validating that the data was correctly downloaded.
EleutherAI / the-pile