data-governance
There are 23 repositories under data-governance topic.
- OpenMetadata
open-metadata / OpenMetadata
Open Standard for Metadata. A Single place to Discover, Collaborate and Get your data right.
Language:TypeScript 4276 - soda-core
sodadata / soda-core
:zap: Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io
Language:Python 1778 - elementary
elementary-data / elementary
The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
Language:HTML 1754 MarquezProject / marquez
Collect, aggregate, and visualize a data ecosystem's metadata
Language:Java 1637reata / sqllineage
SQL Lineage Analysis Tool powered by Python
Language:Python 1148- odd-platform
opendatadiscovery / odd-platform
First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.
Language:Java 1125 - Language:Java 765
data-drift / data-drift
Metrics Observability & Troubleshooting
Language:HTML 302tokern / data-lineage
Generate and Visualize Data Lineage from query history
Language:Python 296- titan
Titan-Systems / titan
Snowflake infrastructure-as-code. Provision environments, automate deploys, CI/CD. Manage RBAC, users, roles, and data access. Declarative Python Resource API. Change Management tool for the Snowflake data warehouse.
Language:Python 281 tuva-health / tuva
Main repo including core data model, data marts, reference data, terminology, and the clinical concept library
GoogleCloudPlatform / bigquery-data-lineage
Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.
Language:Java 136- docker-apache-atlas
sburn / docker-apache-atlas
This Apache Atlas is built from the latest release source tarball and patched to be run in a Docker container.
Language:Shell 135 - datachecks
waterdipai / datachecks
Open Source Data Quality Monitoring.
Language:Python 129 - opendatadiscovery-specification
ODD Specification is a universal open standard for collecting metadata.
daxa-ai / pebblo
Pebblo enables developers to safely load data and promote their Gen AI app to deployment
Language:Python 108odpi / data-governance
Egeria's Guidance on Governance as well as large media files such as presentations and movies
hivemq / hivemq-edge
HiveMQ Edge is an MQTT gateway that enables interoperability between OT devices and IT systems. It translates diverse protocols into MQTT for streamlined communication and helps organize data into a unified namespace, making managing and streaming data across your infrastructure easier.
Language:Java 81- mara-schema
mara / mara-schema
Mapping of DWH database tables to business entities, attributes & metrics in Python, with automatic creation of flattened tables
Language:Python 62 - document-processing-pipeline-for-regulated-industries
aws-samples / document-processing-pipeline-for-regulated-industries
A boilerplate solution for processing image and PDF documents for regulated industries, with lineage and pipeline operations metadata services.
Language:Python 59 conduktor / conduktor-poc-kafka-protocol
POC to demonstrate how to alter incoming/outgoing records in Kafka. It's a toy, don't use it in production.
Language:Java 59provectus / data-quality-gate
Data Quality Gate based on AWS
Language:Python 55Tinkoff / data-detective
Data catalog for everything in your company
Language:Python 48Open-source metadata collector based on ODD Specification
Language:Python 42WeBankBlockchain / Data-Export
Data-Export支持将链上数据导出到MySQL、ES等便于进行大数据处理的存储介质中，解决区块链数据复杂查询、分析、可视化和处理的问题。
Language:Java 42Identify and tokenize sensitive data automatically using Cloud DLP and Dataflow
Language:Java 37- pace
getstrm / pace
Data policy IN, dynamic view OUT: PACE is the Policy As Code Engine. It helps you to programatically create and apply a data policy to a processing platform like Databricks, Snowflake or BigQuery (or plain 'ol Postgres, even!) with definitions imported from Collibra, Datahub, ODD and the like.
Language:Kotlin 31 - data-platforms-tools
ryandawsonuk / data-platforms-tools
Guide to data platforms and tools
Data-Stash是基于FISCO-BCOS的数据仓库组件，通过解析节点的binlog日志，生成该节点状态的全量备份，从而使节点能够实现冷热数据分离和数据裁剪。
Language:Java 31Data-Reconcile是一款基于区块链的对账组件，提供基于区块链智能合约账本的通用化数据对账解决方案，并提供了一套可动态扩展的对账框架，支持定制化开发。
Language:Java 29- stairlight
tosh2230 / stairlight
A data lineage tool detects table dependencies from rendered SQL statements.
Language:Python 26 datasphere-oss / datasphere-service
an open source dataworks platform
Language:Java 21mesmacosta / datacatalog-util
A Python package to centralize some Google Cloud Data Catalog scripts, this repo contains commands like bulk CSV operations that help leverage Data Catalog features.
Language:Python 20Configuration and schema sync for Metabase from Python
Language:Python 19ricardolsmendes / datacatalog-tag-manager
Python package to manage Google Cloud Data Catalog tags, loading metadata from external sources -- currently supports the CSV file format
Language:Python 18yu-iskw / dbt-artifacts-loader
Load dbt artifacts uploaded to GCS to BigQuery in order to track historical dbt results
Language:Python 17