The `--using` flag doesn't actually do anything
StellaAthena opened this issue · comments
If you run python3 the_pile/pile.py --using bibliotik then only Wikipedia will be downloaded. If you run python3 the_pile/pile.py --download --using bibliotik then the entire Pile will be downloaded.