Fama Market Price
Junior data engineer challenge to scrape latest market price from official portal of Federal Agricutural Marketing Authority (FAMA).
Description
Scrape latest farm, wholesale and retail market prices from FAMA website. The prices are then combined together into a single table. The table shall be exported to a .csv
file. The .csv
file will have the following columns:
Market price type
: Farm, Wholesale or RetailCentre
: Name of the centreVariety Name
: Name of the varietyGrade
: Grade of the varietyUnit
: Unit of the varietyMax Price
: Maximum price of the varietyAverage Price
: Average price of the varietyMin. Price
: Minimum price of the variety
Getting Started
Dependencies
Installing
Clone this repository:
git clone https://github.com/muame-amr/fama-market-price
cd fama-market-price
Create a new virual environment:
Conda
conda create -n <env_name> python=3.9
conda activate <env_name>
Virtualenv
python3 -m venv <env_name>
source <env_name>/bin/activate
Install all the requirements:
pip install -r requirements.txt
Executing program
Run script.py
to execute the program:
python script.py
<date>_market_price.csv
file will be created in the public folder.
License
This project is licensed under the MIT License - see the LICENSE.md file for details