Slow Downloads, could torrents be supported?
MikeS159 opened this issue · comments
Possibly a Cloudflare limitation rather than the tool. It seems to be capping out at about 60Mb/s.
Are torrent files still made available and if so could the tool provide a magnet link (or similar) to the most up to date torrent?
@stebet, have you observed this? I don't think we've had reports of bandwidth throttling before and I'm pretty sure that's not happening at Cloudflare.
Torrents are permanently gone, they became way too out of date as the monolithic downloads aren't being updated any more.
Same here, it takes around 1 day to download ntlm database in 32 threads. Bandwidth drops from 60 Mbps to 3 Mbps. ISP does not limit anything
IMO it will be better to make wider ranges supported by API, ex, making 4 chars instead of 5
Don't have an entire day's ETA but I do have an entire hour's ETA:
I've compiled this locally using dotnet publish -r linux-x64 -c Release -f net8.0 -o publish.
I have a 1 Gbps down 500 Mbps up connection and am not being limited by neither disk (NVMe), CPU nor network
Unsure if this is expected at all as there's no comment on download times anywhere.
Final result of the download:
Finished downloading all hash ranges in 3,873,525ms (270.70 hashes per second).
We made 1,048,576 Cloudflare requests (avg response time: 38.91ms). Of those, Cloudflare had already cached 1,048,576 requests, and made 0 requests to the Have I Been Pwned origin server.
Took a total of 65 minutes and 26.3 seconds.
You can try with more threads using the -p switch, for example -p 64. That can help if you have plenty of bandwidth.