crosstyan / dumb_downloader

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

dumbdl

Why

Impersonate TLS fingerprint and akamai fingerprint. I need a reliable tool as the backend of my crawler.

go build
./dumbdl.exe from 2023-10-12-1-5-8.log.json -o out/15d

TODO

  • an HTTP interface
  • a WebSocket interface
  • parallel download
  • retry after failure and logging failure to a file
  • support for transmission resume and download management

Not in the scope of this project:

  • GUI

HTTP API

See swagger.yaml or swagger router when using dumbdl serve.

See also

About

License:Do What The F*ck You Want To Public License


Languages

Language:Go 95.9%Language:Python 3.9%Language:Shell 0.1%Language:PowerShell 0.1%