Django Dynamic Scraper (DDS) is an app for Django build on top of the scraping framework Scrapy.
Scrapy is an application framework for crawling web sites and extracting structured data which can be used for a wide range of useful applications, like data mining, information processing or historical archival.