lineage
There are 5 repositories under lineage topic.
apache / hamilton
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
Language:Jupyter Notebook 2303- elementary
elementary-data / elementary
The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
Language:HTML 2181 reata / sqllineage
SQL Lineage Analysis Tool powered by Python
Language:Python 1576- odd-platform
opendatadiscovery / odd-platform
First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.
Language:Java 1365 - Language:Python 1245
- Language:Scala 647
- Language:Python 451
shenwei356 / taxonkit
A Practical and Efficient NCBI Taxonomy Toolkit, also supports creating NCBI-style taxdump files for custom taxonomies like GTDB/ICTV
Language:Go 446melin / superior-sql-parser
基于 antlr4 的多种数据库SQL解析器，获取SQL中元数据，可用于数据平台产品中的多个场景：ddl语句提取元数据、sql 权限校验、表级血缘、sql语法校验等场景。支持spark、flink、gauss、starrocks、Oracle、MYSQL、Postgresql，sqlserver,、db2等
Language:ANTLR 373MGeurts / genealogy
Genealogy is a free and open-source family tree PHP application to record family members and their relationships, build with LARAVEL 12.
Language:PHP 279Serg-Norseman / GEDKeeper
GEDKeeper - program for work with personal genealogical database
Language:C# 192- Language:Java 180
pinellolab / STREAM
STREAM: Single-cell Trajectories Reconstruction, Exploration And Mapping of single-cell data
Language:Jupyter Notebook 176ground-context / ground
An open-source, vendor-neutral data context service.
Language:Java 160- Language:C# 156
slidoapp / dbt-superset-lineage
Make dbt docs and Apache Superset talk to one another
Language:Python 153zyxue / ncbitax2lin
🐞 Convert NCBI taxonomy dump into lineages
Language:Python 149- Purview-ADB-Lineage-Solution-Accelerator
microsoft / Purview-ADB-Lineage-Solution-Accelerator
A connector to ingest Azure Databricks lineage into Microsoft Purview
Language:C# 92 - Language:C 82
- Language:HTML 70
raystack / compass
Compass is an enterprise data catalog that makes it easy to find, understand, and govern data.
Language:Go 65starlake-ai / jsqltranspiler
Rewrite BigQuery, Redshift, Snowflake and Databricks queries into DuckDB compatible SQL (with deep transformation of functions, data types and format characters) using Java.
Language:Java 62flyteorg / datacatalog
Data Catalog is a service for indexing parameterized, strongly-typed data artifacts across revisions. It also powers Flytes memoization system
Language:Go 53- rhombicLanguage:TypeScript 47
Solution Accelerator to help build Purview custom connectors
Language:Jupyter Notebook 45Open-source metadata collector based on ODD Specification
Language:Python 44Correia-jpv / fucking-awesome-privacy
Awesome Privacy - A curated list of services and alternatives that respect your privacy because PRIVACY MATTERS. With repository stars⭐ and forks🍴
- Language:JavaScript 38
- Language:Python 36
HewlettPackard / cmf
CMF library helps to collect and store information associated with ML pipelines. It tracks the lineages for artifacts and executions of distributed AI pipelines. It provides API's to record and query the metadata associated with ML pipelines. The framework adopts a data first approach and all artifacts recorded in the framework are versioned and identified by the content hash.
Language:Python 35- stairlight
tosh2230 / stairlight
A data lineage tool detects table dependencies from rendered SQL statements.
Language:Python 30 NCBI taxonomic identifier (taxid) changelog, including taxids deletion, new adding, merge, reuse, and rank/name changes.
Language:R 29- lineage
datayoga-io / lineage
Generate beautiful documentation for your data pipelines in markdown format
Language:TypeScript 28 sfX-android / android_vendor_extendrom
modifying / extending the Android build process
Language:Shell 22
