theharshgupta / urap-scrape

This is an ongoing project based on a research study to analyze the retail, residential electricity prices in the US as part of Undergraduate Research Apprenticeship Program (URAP) (Meredith Fowlie and Jenya Kahn Lang) at University of California, Berkeley.

Residential Electricity Price Scraping - UC Berkeley

Web scraping residential electricity prices in the United States.

1. Massachusetts
2. Connecticut
3. Texas (Incomplete)
4. New York (Incomplete)

Installation

1. Download the project repository

git clone https://github.com/theharshgupta/urap-scrape.git
cd urap-scrape

2. Make sure Python 3 is set Download Python

3. Downloading dependencies

   1. Download Chromedriver 76 or before (for Mac/Windows/Linux). Unzip this and add chromedriver file to the project folder

   2. Install project dependencies from requirements.txt using pip install -r requirements.txt (make sure when you run this command from your terminal, you are in your project directory) [Note: Use pigar to generate new requirements.txt]

Massachussets

MA Instructions

Connecticut

CT Instructions

Texas

TEXAS Instructions

New York

NEW YORK Instructions