mozilla / bigquery-backfill

Scripts and historical records related to backfills in Mozilla's telemetry pipeline

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

bigquery-backfill

Scripts and historical records related to backfills in Mozilla's telemetry pipeline

Layout

There is a script directory containing relatively pristine reference scripts that you can copy and paste into a new backfill scenario and modify for your particular needs.

There is a backfill directory where each subdirectory should be a dated backfill event, containing all the scripts used and a description of the overall scenario.

Setup

Most of these backfill scenarios will assume that you have gcp-ingestion checked out locally. mvn invocations in scripts likely assume that you're in the ingestion-beam directory of that repo.

About

Scripts and historical records related to backfills in Mozilla's telemetry pipeline

License:Mozilla Public License 2.0


Languages

Language:Python 66.6%Language:Shell 33.4%