aliscraper
Scraper of Aliexpress product variants. Take url, scrape all variants and save to local db.
Consists of two parts:
-
Web front end on Flask, which allow to take requests with url for scraping and save result to db
-
Threaded runner for mass scrapping, which use Tor network for hidding from anti-spiders. It works with multiple retrys, identity changing and other tricky staff.