nvm use
yarn
To fetch + process all data in one step, run:
yarn prepare-data
Depending on your internet connection this may take upwards of 20-30 minutes.
Data source: Wildland Fire Open Data, a project of the National Interagency Fire Center (NIFC).
1. Fetch fire perimeter data for all years + states in static/data/fire-data-config.json:
yarn fetch-all-fires
1a. Fetch fires for a specific state + year if necessary for backfilling / debugging:
yarn fetch-fires --year=2018 --state=CA
2. Process metadata for fire perimeters:
yarn process-all-fires
2a. Reprocess fires for a specific state + year if necessary for backfilling / debugging:
yarn reprocess-fires --year=2018 --state=CA
A previous iteration of this project scraped data from Geospatial Multi-Agency Coordination (GeoMAC). As of May 1, 2020, cleaned, normalized GeoMAC data are now hosted by NIFC. GeoMAC data prep is as follows:
- Fetch + process the fire perimeter data:
yarn geomac-fetch-all-fires
(Note, GeoMAC's server sometimes issues 404s when trying to download, and the scraper is not as robust as it could be. You may need to run more than once to pick up all fire perimeters.)
- Merge fires per state + year:
yarn geomac-merge-all-fires
- Process metadata for fire perimeters:
yarn geomac-process-all-fires
Alternative: run yarn geomac-prepare-data to try to run all the above steps automatically. Depending on your internet connection this may take upwards of 20-30 minutes.
First, follow the steps above to fetch + process fire perimeter data. Then, run the application:
yarn start
The codebase uses Parcel's tilde path resolution to pacakge external data files alongside the bundled application and make them available for runtime XHR loading (via axios). These assets exist within static/data, and are imported explicitly in hooks:
use-all-fires-for-year-requestuse-complete-fires-for-year-requestuse-fire-metadata
To add a new year of data:
- Add the year to
static/config/fire-data-config.json importthe datasets corresponding to the new year in each of the above hooks, and add that import to the<*>_FOR_YEARmap below theimports.