joshterrill / recursive-s3-downloader

A slow but effective script that takes an open s3 root URL as an argument, loops through all available directories and files, exports them, and then downloads the files

Recursive S3 Downloader

A slow but effective script that takes an open s3 root URL as an argument, loops through all available directories and files, exports them, and then downloads the files

CLI usage

npm i -g recursive-s3-downloader
recursive-s3-downloader <root s3 bucket url here>
# optional param: --skip-download
# optional param: --additional-prefixes "webroot,logs"
# or...
# optional param: --download-only

Code usage

npm i recursive-s3-downloader --save

const recusriveS3Downloader = require('recursive-s3-downloader');

await recusriveS3Downloader.download('<root s3 bucket url here>', /* optional params */)

To-do

• Add whitelist/blacklist filetypes and/or media types for download options

License

MIT