bkatiemills / copernicus-ssh

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Copernicus sea level anomaly port

This repo contains scripts to process and post the sea level anomaly data found at https://cds.climate.copernicus.eu/cdsapp#!/dataset/satellite-sea-level-global?tab=overview. This proceeds in two steps: calculating weekly averages from the upstream daily data, and then composing these into timeseries documents in mongodb.

Part 1: computing daily averages

  • branch: main
  • data preperation: all the daily upstream data from Copernicus (2021 version) in data/
  • run in the containerized environment described by Dockerfile with run.sh.
  • doublecheck results using proofread.py in the environment defined by Dockerfile-proofread

Part 2: populating mongodb

  • branch: db-population
  • data preparation: all results from step 1 as well as basins file in /bulk/copernicus-sla/
  • create empty copernicusSLA collection with appropriate script in https://github.com/argovis/db-schema; make sure shared timeseriesMeta collection also exists if not already
  • run in the containerized environment described by Dockerfile with cargo run
  • doublecheck results using proofread.py in environment defined by Dockerfile-proofread

About


Languages

Language:Rust 93.5%Language:Python 5.6%Language:Shell 0.6%Language:Dockerfile 0.2%