rrochlin / WebScrapingETLDemo

Demo of a web scraper integrated with an ETL to store info in a SQL database

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Web Scraping Demo

This project is intended as a demo for developing a python web scraping application

Overview

The script relies on beautiful soup and python requests to query the first 200 pages of the amazon results for gaming monitors. It then filters the targetted elements to remove non monitors. It publishes the results to an excel file and also a psql database hosted on AWS.

About

Demo of a web scraper integrated with an ETL to store info in a SQL database

License:MIT License


Languages

Language:Python 100.0%