extracting into subdirectories rather than everything in one dir
torehl opened this issue · comments
The extract.sh untar everything to one folder. Isn't it better to extract it into its destination folder? I.e.
$ more ../extract2.sh
for file in *.tar.gz;
do
mkdir -p "${file%.tar.gz}"
tar -zxf "$file" -C "${file%.tar.gz}"
done
and extract with
DeepMind/Kinetics-600/train$ bash ../extract2.sh k600_train_path.txt
gives
drwxr-sr-x 2 torel users 993 Apr 29 2018 abseiling/
-rw-r--r-- 1 torel users 2000227200 Apr 17 12:49 abseiling.tar.gz
drwxr-sr-x 2 torel users 708 Apr 29 2018 acting in play/
-rw-r--r-- 1 torel users 930025532 Apr 17 12:49 acting in play.tar.gz
drwxr-sr-x 2 torel users 649 Apr 29 2018 adjusting glasses/
Brgds,
I have written a program to achieve that for the Kinetics-400 dataset, see kinetics-dataset-downloader.
After that, the dataset can be loaded with the data loader from torchvision.datasets.Kinetics-400
.