MarvinBertin / Weather-Data-Eng-Pipeline

Lambda Architecture Pipeline with NEXRAD Radar Data

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Lambda Architecture (Batch & Streaming) Pipeline with NEXRAD Radar Data

The NEXRAD data is a public dataset hosted on amazon.

Dataset Information:

  • Stands for Next Generation Weather Radar
  • Network of 160 high-resolution Doppler radar sites that detects precipitation and atmospheric movement
  • Historical archives from June 1991 to present
  • Real-time streaming (5 minute intervals from each site)
  • Both streams are available on aws S3 buckets
  • Enables Storm Prediction
  • Study of weather's impact on various sectors

Notebooks rendered on nbviewer (recommended for animated plots):

About

Lambda Architecture Pipeline with NEXRAD Radar Data


Languages

Language:Jupyter Notebook 100.0%Language:Python 0.0%