Preetwinder

gurl-cython

Cython wrapper around the Chromium GURL component

dotfiles

frontera

A scalable frontier for web crawlers

GSoC16-FinalSubmission

Final work submission to GSoC describing the work I did for my project.

hbase-docker

HBase running in Docker

scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

Scrapy-docker-test

ScrapyStreaming

A proof of concept for Scrapy Streaming functionality.

w3lib

Python library of web-related functions