imagenet_to_gcs.py ends with empty tfrecords
exx8 opened this issue · comments
Eran commented
I try to run imagenet_to_gcs.py --raw_data_dir=/sda/Eran/imagenet/ --local_scratch_dir=/sda/Eran/downloads/TFrecords --nogcs_upload
and the script runs, but I get a folder with empty TFrecords.
it seems that something went wrong. The folder of the extracted images of imagenet seems to be fine:
I use tf 2.8.
Debugging tf global ended with an empty array.
Thanks
Eran commented
The problem was that the script expects the samples to be under "train" and "test"; if it doesn't find these folder it just skips all the files that should have been placed there.
I would expect some error or something that tell the problem.