prashiyn / invariate-data-pipeline

This Shopify tap produces JSON-formatted data following the Singer spec.

🥪 Invariate Data Pipeline 🦘

Meltano dbt project for data pipeline for ecommerce ( specifically Shopify)

Using with Meltano

This project is preconfigured with a Meltano configuration file, meltano.yml. Meltano can be used as follows:

One-time workstation setup:

> meltano install  # Install the plugins declared by the project

Sample usage for end-to-end development:

> meltano run el    # Run the job titled 'el' to extract and load data
> meltano run t     # Run the job titled 't' to transform data
> meltano run bi    # Build and serve the Evidence BI reports

Dynamically Build and serve the Evidence BI reports:

meltano invoke evidence:dev    # 

Do a full end-to-end build on "prod":

> meltano --environment=prod run elt evidence:build