Peiran Quan's repositories
pipeline_azure_databricks
data lakehouse with delta architecture
demo_internal
rebase
MEAN-App-GCP-Hosting
MEAN-App-GCP-Hosting
pipe-to-gbq
pipe production data from local machine to google bigquery
ADF_BigQuery
How to authenticate to Google Big Query when connecting from Azure Data Factory v2
ado_pipelines_example
example pipelines for deploying dbt via Azure DevOps pipelines
bigquery-oreilly-book
Source code accompanying: BigQuery: The Definitive Guide by Lakshmanan & Tigani to be published by O'Reilly Media
CSharpAzureHosting
Immigrating cloud project from GCP to Azure
Databricks_Notebook
My Databricks works
dbt-bq-using
dbt cli project
delta_explore
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
docker-cheat-sheet
Docker Cheat Sheet
gcp-realtime-pipeline-project
This project uses GCP pub/sub and dataflow to create a realtime data pipeline which ingest data from a virtual store created using dash in realtime.
Internal_Issues_Tracker
Angular directly linking to firebase, skipping backend node and express
Modularization_Python_Docker_Demo
The Demo for Blog: Modularization using Python and Docker (MicroService)
nodejsbuilding
PWAbuildingsteps
PowerBI_M_Queries
PowerBI_M_Queries for production data preparations and visualization
predicting_mks_speed
use machine learning technique to predict upcoming mks speed
ProductionPlannerCaller
Testing Production Planner API from Python Client
PythonStatistics
Data ETL on Local machine
SnowflakeGuiHacks
UI Prototypes for snowflake related concepts
spark
Apache Spark - A unified analytics engine for large-scale data processing
WebAppGCPHosting
new project for assembly lines, issues tracker: