Use multiple download threads
hoechenberger opened this issue · comments
Richard Höchenberger commented
It would be neat if we could download several files simultaneously.
Alexandre Gramfort commented
Richard Höchenberger commented
Doing the download themselves shouldn't be difficult, I'm more concerned about the progress bars. Any ideas? Maybe just use a single bar and update it as each thread terminates?
Alexandre Gramfort commented
Tqdm should be able to deal with this
Richard Höchenberger commented
Did a little digging and it seems that requests
isn't really async-compatible. A good alternative seems to be HTTPX, https://www.python-httpx.org/async/
Postponing this for now.