The application is deployed on Heroku:
https://flowmar-mongo-news-scraper.herokuapp.comTo Do:
Create UI OutlineStyle UISet up Connection to DatbaseSet up RoutesCreate a model for ArticlesScrape articles from news website- Display scraped articles, 20 at a time when button clicked.
- Create a model for user Notes
- Create a model for a User
- Populate the Notes based on the User
In this assignment, you'll create a web app that lets users leave comments on the latest news. But you're not going to actually write any articles; instead, you'll flex your Mongoose and Cheerio muscles to scrape news from another site.
-
Create a GitHub repo for this assignment and clone it to your computer. Any name will do -- just make sure it's related to this project in some fashion.
-
Run
npm init. When that's finished, install and save these npm packages: -
express
-
express-handlebars
-
mongoose
-
body-parser
-
cheerio
-
request
-
NOTE: If you want to earn complete credit for your work, you must use all six of these packages in your assignment.
-
In order to deploy your project to Heroku, you must set up an mLab provision. mLab is remote MongoDB database that Heroku supports natively. Follow these steps to get it running:
-
Create a Heroku app in your project directory.
-
Run this command in your Terminal/Bash window:
heroku addons:create mongolab- This command will add the free mLab provision to your project.
-
You'll need to find the URI string that connects Mongoose to mLab. Run this command to grab that string:
heroku config | grep MONGODB_URI- Notice the value that appears after
MONGODB_URI =>. This is your URI string. Copy it to a document for safekeeping.
-
When you’re ready to connect Mongoose with your remote database, simply paste the URI string as the lone argument of your
mongoose.connect()function. That’s it! -
Your site doesn't need to match the demo's style, but feel free to attempt something similar if you'd like. Otherwise, just be creative!
-
Create an app that follows this user story:
-
Whenever a user visits your site, the app will scrape stories from a news outlet of your choice. The data should at least include a link to the story and a headline, but feel free to add more content to your database (photos, bylines, and so on).
-
Use Cheerio to grab the site content and Mongoose to save it to your MongoDB database.
-
All users can leave comments on the stories you collect. They should also be allowed to delete whatever comments they want removed. All stored comments should be visible to every user.
-
You'll need to use Mongoose's model system to associate comments with particular articles.
-
-
Go back to Saturday's activities if you need a refresher on how to partner one model with another.
-
Whenever you scrape a site for stories, make sure an article isn't already represented in your database before saving it; we don't want duplicates.
-
Don't just clear out your database and populate it with scraped articles whenever a user accesses your site.
- If your app deletes stories every time someone visits, your users won't be able to see any comments except the ones that they post.
Attempt to complete homework assignment as described in instructions. If unable to complete certain portions, please pseudocode these portions to describe what remains to be completed.
If you have any questions about this project or the material we have covered, please post them in the community channels in slack so that your fellow developers can help you! If you're still having trouble, you can come to office hours for assistance from your instructor and TAs.
That goes threefold for this week: MongoDB and Mongoose compose a challenging data management system. If there's anything you find confusing about these technologies, don't hesitate to speak with someone from the Bootcamp team.
Good Luck!
Coding Boot Camp (C) 2016. All Rights Reserved.