Scrapinghub (scrapinghub)

Scrapinghub

scrapinghub

Geek Repo

Turn web content into useful data

Location:The Internet

Home Page:https://scrapinghub.com

Twitter:@Scrapinghub

Github PK Tool:Github PK Tool

Scrapinghub's repositories

portia

Visual scraping for Scrapy

Language:PythonLicense:BSD-3-ClauseStargazers:9144Issues:504Issues:451

splash

Lightweight, scriptable browser as a service with an HTTP API

Language:PythonLicense:BSD-3-ClauseStargazers:3993Issues:213Issues:853

dateparser

python parser for human readable dates

Language:PythonLicense:BSD-3-ClauseStargazers:2445Issues:134Issues:652

frontera

A scalable frontier for web crawlers

Language:PythonLicense:BSD-3-ClauseStargazers:1278Issues:163Issues:155

slackbot

A chat bot for Slack (https://slack.com).

Language:PythonLicense:MITStargazers:1252Issues:58Issues:134

scrapyrt

HTTP API for Scrapy spiders

Language:PythonLicense:BSD-3-ClauseStargazers:814Issues:43Issues:93

extruct

Extract embedded metadata from HTML markup

Language:PythonLicense:BSD-3-ClauseStargazers:811Issues:116Issues:89

python-crfsuite

A python binding for crfsuite

Language:PythonLicense:MITStargazers:764Issues:33Issues:97

spidermon

Scrapy Extension for monitoring spiders execution.

Language:PythonLicense:BSD-3-ClauseStargazers:508Issues:77Issues:163

price-parser

Extract price amount and currency symbol from a raw text string

Language:PythonLicense:BSD-3-ClauseStargazers:297Issues:14Issues:30

python-scrapinghub

A client interface for Scrapinghub's API

Language:PythonLicense:BSD-3-ClauseStargazers:200Issues:118Issues:62

sample-projects

Sample projects showcasing Scrapinghub tech

shub

Scrapinghub Command Line Client

Language:PythonLicense:BSD-3-ClauseStargazers:126Issues:21Issues:155

scrapy-poet

Page Object pattern for Scrapy

Language:PythonLicense:BSD-3-ClauseStargazers:110Issues:11Issues:39

number-parser

Parse numbers written in natural language

Language:PythonLicense:BSD-3-ClauseStargazers:103Issues:9Issues:39

web-poet

Web scraping Page Objects core library

Language:PythonLicense:BSD-3-ClauseStargazers:88Issues:9Issues:37

scrapinghub-stack-scrapy

Software stack with latest Scrapy and updated deps

Language:DockerfileLicense:BSD-3-ClauseStargazers:63Issues:23Issues:14

scrapy-frontera

More flexible and featured Frontera scheduler for Scrapy

Language:PythonLicense:BSD-3-ClauseStargazers:35Issues:87Issues:7
Language:DockerfileStargazers:32Issues:29Issues:0

scrapinghub-entrypoint-scrapy

Scrapy entrypoint for Scrapinghub job runner

Language:PythonLicense:BSD-3-ClauseStargazers:25Issues:25Issues:14

andi

Library for annotation-based dependency injection

Language:PythonLicense:BSD-3-ClauseStargazers:18Issues:9Issues:3
Language:PythonLicense:BSD-3-ClauseStargazers:12Issues:17Issues:8

hcf-backend

Crawl Frontier HCF backend

Language:PythonLicense:BSD-3-ClauseStargazers:7Issues:85Issues:9

webstruct-demo

HTTP demo for https://github.com/scrapinghub/webstruct

Language:PythonLicense:MITStargazers:4Issues:4Issues:0

marathon-apps-collectd-plugin

marathon-apps-collectd-plugin

Language:PythonLicense:GPL-2.0Stargazers:2Issues:14Issues:0
Language:ErlangStargazers:1Issues:13Issues:0

grafana

Gorgeous metric viz, dashboards & editors for Graphite, InfluxDB & OpenTSDB

Language:GoLicense:NOASSERTIONStargazers:1Issues:4Issues:0

asgi_rabbitmq

RabbitMQ backend for ASGI

Language:PythonLicense:BSD-3-ClauseStargazers:0Issues:11Issues:0
Language:ErlangStargazers:0Issues:15Issues:0
Language:ErlangStargazers:0Issues:15Issues:0