Toshifumi Tsutsumi's repositories
stairlight
A data lineage tool detects table dependencies from rendered SQL statements.
stairlight-app
A web application rendering table dependency graph with tosh2230/stairlight, using Graphviz, Streamlit and Google Cloud Run.
streamlit-run
Streamlit apps on Cloud Run with Identity-Aware Proxy (IAP).
aws-glue-crawlflow
Run AWS Glue Crawler and check the status by AWS Step functions.
pubsub-dataflow-bigquery
Google Cloud Dataflow for 'Exactly-Once' streaming insertion, from Google Cloud Pub/Sub to Google BigQuery.
airbyte-platform
The platform fundament of Airbyte powering all your ELT pipelines. Please file issues in https://github.com/airbytehq/airbyte
pycon-jp-2021
Sample codes for PyCon JP 2021, "Introduction to Python logging".
beam
Apache Beam is a unified programming model for Batch and Streaming
bigquery-table-history
Diff daily changes by BigQuery INFORMATION_SCHEMA.PARTITIONS records.
cdc-rds-bq
Change data capture from Amazon RDS to Google BigQuery
cfn-drift-detector
AWS CloudFormation stack drift detector
debezium-server-mysql-pubsub
Change data capture from MySQL to Google Cloud Pub/Sub by Debezium Server.
imgc
Executes commands on multiple container images and outputs results to standard output.
practice-aws-batch
AWS Batch on AWS Fargate, calling from AWS Step Functions.
py-queuing-hub
Multi-cloud Queuing Hub for Python
pycon-apac-2023
Unpacking ModuleNotFoundError
rbtrslt
Ruby client for Google Cloud Translation
target-bigquery
A Singer (https://singer.io) target that writes data to Google BigQuery.