Charith47 / scrapy

Web scraper for popular news sites in Sri Lanka. Built using beautiful-soup.

scrapy

Python web scraper for popular news sites in Sri Lanka Used BeautifulSoup for parsing html (bs4) and Mongodb for storing news items