kepa4 / news-scraper

a news article site scraper

Home Page:https://strawberry-pie-45482.herokuapp.com/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

news-scraper

A Web Scraper for New York Times World News section

Technologies used

  • Express
  • Mongodb
  • Mongoose
  • Handlebars
  • Axios
  • Cheerio

Setup

    git clone git@github.com:kepa4/news-scraper.git
    npm install
    node server.js 

if you want to scrape for new articles, replace /articles in the url with /scrape

bugs

  • Cant Post comments on any articles that isn't the first one

Future Implementation

  • A way to delete comments
  • An easier way to scrape again

About

a news article site scraper

https://strawberry-pie-45482.herokuapp.com/


Languages

Language:JavaScript 74.7%Language:HTML 25.3%