This project is a price tracker for various products in Nigeria. It scrapes data from multiple sources, cleans the data using Python, and visualizes it through a dashboard created using Power BI.
Data scraping: Python scripts (DataScraping) are used to scrape data from National bureau of statistics
Data cleaning: The scraped data is cleaned and processed to remove duplicates, handle missing values, and standardize formats
Dashboard: A Power BI dashboard is created to visualize the cleaned data and track the prices of different products over time
- Python 3
- Libraries: requirements.txt
- Power BI Desktop (for viewing/editing the dashboard)
-
Clone the repository: git clone https://github.com/zalihat/Nigerian-Price-Watch.git
-
Install dependencies: pip install -r requirements.txt
-
Open the Power BI dashboard file (.pbix) using Power BI Desktop
- Run the Python scripts to scrape and clean the data.
- Open the Power BI dashboard to visualize the cleaned data.
pip install -r requirements.txt
cd DataPreprocessing
python Preprocess.py URL COMMODITY MONTH YEAR DATA_BACKUP_PATH PATH_OR_BUFFER
Example
To get the price of selected food for december 2022
python Preprocess.py "https://nigerianstat.gov.ng/elibrary" "food" "december" 2022 "SELECTED FOOD DECEMEBER 2022.xlsx" "data.csv"
Contributions are welcome! Please fork the repository and submit a pull request with your changes.
Thanks to https://nigerianstat.gov.ng for providing the data.