Gerapy

Gerapy's repositories

Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

Language:PythonMIT3229 124 210

Auto Extractor Module

Language:PythonApache-2.0309 15 20

Downloader Middleware to support Pyppeteer in Scrapy & Gerapy

Language:Python135 4 25

Downloader Middleware to support Playwright in Scrapy & Gerapy

Language:Python105 1 18

Downloader Middleware to support Selenium in Scrapy & Gerapy

Language:Python30 2 4

A package for supporting proxy in Scrapy & Gerapy

Language:Python10 20

Distribution Support for Scrapy & Gerapy using RabbitMQ

Language:Python8 2 2

Distribution Support for Scrapy & Gerapy using Redis

Language:Python8 20

Document of Gerapy

Language:HTML5 2 1

Gerapy Prometheus Exporter

Language:Python5 2 1

A package which can simplify your multiprocessing implementation

Language:Python4 20

Item Pipeline Components for Gerapy & Scrapy

Language:Python1 20