valentinoli / anthroproject

Setup instructions

1. Install Python 3. On macOS you can do it with homebrew:

brew install python

2. Navigate to the project's directory:

cd anthroproject

3. Set up your Python virtual environment:

python -m venv ./env-anthroproject

This creates a folder for your virtual environment env-anthroproject where all the required packages are saved.

4. Activate the virtual environment. Here is how you to it on Windows:

.\env-anthroproject\Scripts\activate

Here is how you do it on macOS:

source env-anthroproject/bin/activate

5. Install the required Python packages (in the activated environment):

pip install -r requirements.txt

6. Put your credentials file in the folder.

7. Run the Python script

python json2csv.py

The script downloads the AWS raw JSON data files, executes transformations, and outputs into CSV files

The JSON files are stored in data/json/ and the resulting CSV files are stored in data/csv/