Alek-S / Scrapeosaurus

Hacker News Web Scraper - Mongo, Express, HandleBars, Cheerio, Mocha, Supertest

Home Page:http://bit.ly/2sS6s3x

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Build Status Dependency Status Known Vulnerabilities

Scrapeosaurus

Try It Now: Live Page Link

When the button is clicked, the Y Combinator News HTML is fetched by the server. The server will then parse out the front page stories. If the story has no yet been added, then it's saved to a Mongo database.

Once scraped, the page redirects to the article section where all saved stories can be viewed. Likewise, comments can be added or removed to individual stories. Comments are persisted in Mongo as a nested element in the same collection.

example

Technology Used

Node.js, Express, Express-Handlebars, Mongoose / MongoDB, Cheerio, Request, jQuery

Middleware Stack

Morgan, Helmet

Testing and Deployment

Travis CI, Mocha, Supertest, Snyk, Gemnasium, Heroku

Test

About

Hacker News Web Scraper - Mongo, Express, HandleBars, Cheerio, Mocha, Supertest

http://bit.ly/2sS6s3x

License:MIT License


Languages

Language:JavaScript 58.0%Language:CSS 27.6%Language:HTML 14.5%