Curiosity Scraper
A web scraper setup to grab articles from the science and technology category of Curiosity.com — one of my favorite educational article sources. Complete with a comment section for each scraped article.
Currently setup to scrape:
- Image URL
- Title
- Subtitle
- Link to full article
Built With
- MongoDB - NoSQL Database
- Mongoose - Object modeling
- Express - Routing
- Express-Handlebars - Templating
- Cheerio - Scraping
- BodyParser - Parsing middleware
- JQuery - Event Handling & DOM manipulation
- Materialize - Front-end styling
Disclaimer
All content is scraped from Curiosity.com