cdmatters / scraper-practice

miniprojects built to develop scraping ability

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

scraper-practice

This repository is a a repository filled with exercises in learn how to Scrape

A) RealPython Projects: these projects are exercises based on the Pt2 of the Real Python course

hackernews - prepares an introduction to Scrapy, by scraping just the list of titles of https:\news.ycombinator.com :

wikipedia - prepares an introduction to Scrapy, by scraping the list of films made in 2014

socrata - prepares an introduction to Scrapy, by crawling and scraping socrata and outputting to a database in sqlite3

B) Original Projects: these projects are exercises devised by CM to further skills or just for kicks!

angelcrunch - this project is designed to investigate the data available on angellist and crunchbase as requested as part of an exercise for work

About

miniprojects built to develop scraping ability


Languages

Language:Python 96.6%Language:C 2.4%Language:XSLT 0.9%Language:GAP 0.1%Language:Shell 0.0%Language:Objective-C 0.0%