volmaster's starred repositories
DrissionPage
基于python的网页自动化工具。既能控制浏览器，也能收发数据包。可兼顾浏览器自动化的便利性和requests的高效率。功能强大，内置无数人性化设计和便捷功能。语法简洁而优雅，代码量少。
scrapeops-scrapy-sdk
Scrapy extension that gives you all the scraping monitoring, alerting, scheduling, and data validation you will need straight out of the box.
undetected-chromedriver
Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
scrapingant-client-python
ScrapingAnt API client for Python.
fuzzywuzzy
Fuzzy String Matching in Python
cloudflare-scrape
A Python module to bypass Cloudflare's anti-bot page.
docker-python-chromedriver
Dockerfile for running Python Selenium in headless Chrome (Python 2.7 / 3.6 / 3.7 / 3.8 / Alpine based Python / Chromedriver / Selenium / Xvfb included in different versions)
xvfbwrapper
Manage headless displays with Xvfb (X virtual framebuffer)
google-api-python-client
🐍 The official Python client library for Google's discovery based APIs.
dirbot-mysql
Scrapy project based on dirbot to show how to use Twisted's adbapi to store the scraped data in MySQL.
scrapy-fake-useragent
Random User-Agent middleware based on fake-useragent
scrapy-proxies
Random proxy middleware for Scrapy
awesome-remote-job
A curated list of awesome remote jobs and resources. Inspired by https://github.com/vinta/awesome-python