Scrapinghub

article-extraction-benchmark

Article extraction benchmark: dataset and evaluation scripts

webstruct

NER toolkit for HTML data

js2xml

Convert Javascript code to an XML document

sample-projects

Sample projects showcasing Scrapinghub tech

scrapy-autoextract

Zyte Automatic Extraction integration for Scrapy

scrapy-autounit

Automatic unit test generation for Scrapy.

portia2code

exporters

Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations

autoextract-spiders

Pre-built Scrapy spiders for AutoExtract

product-extraction-benchmark

autopager

Detect and classify pagination links

shublang

Pluggable DSL that uses pipes to perform a series of linear transformations to extract data

varanus

A command line spider monitoring tool

autoextract-poet

web-poet definitions for AutoExtract

collection-scanner

HubStorage collection scanner library

hadoop-jmx-exporter

HDFS & YARN jmx metrics prometheus exporter

autoextract-examples

locode

pgcontents

A Postgres-backed ContentsManager implementation for IPython

baseimage-docker

A minimal Ubuntu base image modified for Docker-friendliness

dockerfiles-stunnel

secure services with stunnel

kafka-consumer-group-exporter

Prometheus Kafka Consumer Group Exporter

docker-erlang-otp

the Official Erlang OTP image on Docker Hub

erlang_consul_node_discovery

hbase-thirdparty

Mirror of Apache HBase Third Party Libs

jira

Python JIRA Library is the easiest way to automate JIRA. Support for py27 was dropped on 2019-10-14, do not raise bugs related to it.

kafka-docker

mochiweb

MochiWeb is an Erlang library for building lightweight HTTP servers.

shublangjs

woodpecker

An opinionated fork of the Drone CI system