mgonzo / gator

A python script to get aggregated results from Craigslist

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Gator

This is my first Python script. It's been fun. It has tests for the fetch command.

Tests are run with py.test

Gator is a Craigslist screen scraper to aggregate results from all US sites into a Sqlite database. I've got a couple of big ticket items that I need to sell and thought it would be great if I could easily get data from across all states. Of course, there's a couple of websites that do this already, but I liked the idea of stuffing the results into a db file and being able to interact with it later.

TODO: Currently, the only command available is 'gator fetch', which retrieves the results and stores them in db/gator.db. When I get time, I'd like to add some commands for generating reports from the db. Probably gonna need some updates to the schema as well for storing results from multiple searches easily.

Usage:

./gator fetch --query=sunfish --category=boa

About

A python script to get aggregated results from Craigslist


Languages

Language:HTML 86.8%Language:Python 13.2%