darthbear / scrapy-proxynova

Use scrapy with a list of proxies generated from proxynova.com

darthbear/scrapy-proxynova Issues

It's not working
Closed 2 years ago
Track how fast each proxy responds and prefer the faster proxies.
Closed 5 years ago2
Can not found proxies.py file to generate the proxy list
Updated 10 years ago
Got an error
Closed 11 years ago1
Use proxy_list.txt instead of fetching the proxy list from the different pages in proxynova
Closed 12 years ago1
Fix parsing because Proxynova changed the way they offuscate the IP address
Closed 12 years ago1
Have a lock mechanism to prevent multiple scrapy instances to generate proxy lists at the same time
Closed 12 years ago3
Error out if proxynova is down or has no proxies available
Closed 12 years ago3
Multi thread the process to check connections when generating proxy list
Updated 12 years ago2