cslin82 / Mongo-News-Scraper

Scraper for Mozilla News using Mongoose/MongoDB on Node.js/Express

Home Page:https://mozilla-blog-scraper.herokuapp.com/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Mongo-News-Scraper

Task

This full-stack news app uses Express, Handlebars, Node.js, Mongoose/MongoDB, cheerio, jQuery, and Bootstrap to allow users to save/unsave and comment on posts from the Mozilla Blog. It introduces the use of MongoDB and Mongoose.

Concepts and technologies

  • New: Mongoose and MongoDB
  • New: Scraping server-side using cheerio
  • Express.js running on Node.js
  • Handlebars.js and rendering middleware
  • Using APIs and AJAX calls
  • NPM for JS library management
  • Custom Node.js modules and modular design, spreading logic and data across multiple files
  • Deploying full-stack apps to Heroku
  • Front-end technolgies (HTML, CSS, jQuery), HTML forms
  • New: Bootstrap 4.1

Enhancements

  • Use jQuery or other animations for notes appearing and disappearing
  • Add UI for scraping deeper
  • Incorporate data validation
  • Polish frontend
  • Write mocha/chai tests

TODO

  • Write help page
  • Clean up code and logic
  • Consolidate methods
  • Make deletes also delete ref in article model
  • Use return data from API AJAX calls
  • Convert scrape request to axios
  • Move moment calls to handlebars helpers

About

Scraper for Mozilla News using Mongoose/MongoDB on Node.js/Express

https://mozilla-blog-scraper.herokuapp.com/


Languages

Language:JavaScript 68.4%Language:Handlebars 22.9%Language:HTML 8.7%