Scrapinghub

portia

Visual scraping for Scrapy

splash

Lightweight, scriptable browser as a service with an HTTP API

dateparser

python parser for human readable dates

frontera

A scalable frontier for web crawlers

slackbot

A chat bot for Slack (https://slack.com).

extruct

Extract embedded metadata from HTML markup

scrapyrt

HTTP API for Scrapy spiders

python-crfsuite

A python binding for crfsuite

spidermon

Scrapy Extension for monitoring spiders execution.

price-parser

Extract price amount and currency symbol from a raw text string

python-scrapinghub

A client interface for Scrapinghub's API

shub

Scrapinghub Command Line Client

scrapy-poet

Page Object pattern for Scrapy

number-parser

Parse numbers written in natural language

web-poet

Web scraping Page Objects core library

scrapinghub-stack-scrapy

Software stack with latest Scrapy and updated deps

scrapy-frontera

More flexible and featured Frontera scheduler for Scrapy

docker-images

scrapinghub-entrypoint-scrapy

Scrapy entrypoint for Scrapinghub job runner

andi

Library for annotation-based dependency injection

shub-workflow

hcf-backend

Crawl Frontier HCF backend

webstruct-demo

HTTP demo for https://github.com/scrapinghub/webstruct

epmdless_dist

marathon-apps-collectd-plugin

marathon-apps-collectd-plugin

erl-iputils

grafana

Gorgeous metric viz, dashboards & editors for Graphite, InfluxDB & OpenTSDB

asgi_rabbitmq

RabbitMQ backend for ASGI

marray

urilator