mtoto / cloud-sql-db

Prototyping data ingestion through Cloud Functions and Cloud Storage Transfer on GCP.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Data wrangling in the cloud

This repo consists of the assets for a two-part blog series I have written on loading and managing data on Google Cloud.

extract

This directory relates to the post Serverless data ingestion into BigQuery which describes how to use Cloud Functions and BigQuery transfer to load data.

dbt

The contents of dbt/ is the subject of the post No frills data warehousing with dbt and is an example of a dbt package that facilitates building robust and scalable datapipelines run exclusively on the database's execution engine.

About

Prototyping data ingestion through Cloud Functions and Cloud Storage Transfer on GCP.


Languages

Language:Python 100.0%