thammegowda / mtdata

A tool that locates, downloads, and extracts machine translation corpora

Home Page:https://pypi.org/project/mtdata/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Faster downloads with multiple streams

thammegowda opened this issue · comments

Datasets are getting bigger ( #140 ) , it means longer times to download.

Improve download speed using multiple streams via download accelerators. Example: here is a Python lib https://github.com/iTaybb/pySmartDL