Gallaecio

parsel

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

andi

Library for annotation-based dependency injection

dateparser

python parser for human readable dates

form2request

AI-powered Python 3.8+ library to build HTTP requests out of HTML forms.

Formasaurus

Formasaurus tells you the type of an HTML form and its fields using machine learning

OpenNutriTracker

🍴 OpenNutriTracker is a free and open source calorie tracker with a focus on simplicity and privacy.

protego

A pure-Python robots.txt parser with support for modern conventions.

pycones24

PyConEs 2024 Vigo

python-zyte-api

Python client for Zyte Data API

scrapinghub-entrypoint-scrapy

Scrapy entrypoint for Scrapinghub job runner

scrapinghub-stack-scrapy

Software stack with latest Scrapy and updated deps

scrapy-crawlera

Crawlera middleware for Scrapy

scrapy-feedexporter-onedrive

Export to OneDrive

scrapy-feedstock

A conda-smithy repository for scrapy.

scrapy-frontera

More flexible and featured Frontera scheduler for Scrapy

scrapy-poet

Page Object pattern for Scrapy

scrapy-spider-metadata

scrapy-zyte-api

Zyte Data API integration for Scrapy

shub

Scrapinghub Command Line Client

sklearn-crfsuite

scikit-learn inspired API for CRFsuite

transitous

Free and open public transport routing.

twisted

Event-driven networking engine written in Python.

w3lib

Python library of web-related functions

web-poet

Web scraping Page Objects core library

web-scraping-tutorial-project

https://docs.zyte.com/web-scraping/tutorial/index.html

xtractmime

https://mimesniff.spec.whatwg.org/ implementation for Python

zyte-common-items

Contains the common item definitions used in Zyte.

zyte-spider-templates

Spider templates for automatic crawlers.

zyte-spider-templates-project