eminorhan / webdataset-example

a simple webdataset sharded tar write example

A clean webdataset example

Please see makeshards.py for a clean example of how to create a sharded .tar archive from a list of image directories.