Mission_to_Mars
Web scrape information about Mars for analysis and create an app to display analysis.
Project Overview
Using web scraping to gather the latest data about the planet Mars by pulling data from multiple websites, storing it in a database then presenting the collected data for a web app.
Resources | Sites scraped:
- https://astrogeology.usgs.gov/search/results?q=hemisphere+enhanced&k1=target&v1=Mars
- https://mars.nasa.gov/news/
Objective
Created several files which were all used to create the web page for visualization of the results:
- In Jupyter Notebook, create a dataframe to hold a table of facts about the planet Mars.
- After using Chrome DevTools to inspect the html, in VS Code create an html file to identify
the elements and classes to scrape.
- In VS Code create a file execute the scraping of the websites selected.
- In VS Code create a file using FLASK to create a web page with the results of the scraping.
Finally, create a portfolio.
Steps:
1. Use Splinter and ChromeDriver to automate web scraping for Mars data by identifying the HTML tags,
using Chrome DevTools, to identify information we want to gather.
2. Use BeautifulSoup to parse and extract the Mars data.
3. Use MongoBD to store data retrieved for easy access.
4. Use Flask visualize scraping results on a web app.
5. Create Portfolio
- Selected one of the templates provided and customized the html and css files to create my own portfolio.
Portfolio Images:
Challenge
Pull high-resolution images of Mars hemisphere and use DevTool to find the proper elements to scrape. Update the Mongo database with the new data and later the design of the web app to accommodate these images.
Resources | Site scraped:
- https://astrogeology.usgs.gov/search/results?q=hemisphere+enhanced&k1=target&v1=Mars
Objectives
- Use BeautifulSoup and Splinter to automate a web browser and scrape hit-resolution images.
- Use a MongoDB to store data from the web scrape.
- Update the web application and Flask to display the data from the web scrape.
- Use Bootstrap to style the web app.