data-observability
There are 17 repositories under data-observability topic.
- OpenMetadata
open-metadata / OpenMetadata
Open Standard for Metadata. A Single place to Discover, Collaborate and Get your data right.
Language:TypeScript 4276 - soda-core
sodadata / soda-core
:zap: Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io
Language:Python 1778 - elementary
elementary-data / elementary
The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
Language:HTML 1754 - Language:HTML 1526
- odd-platform
opendatadiscovery / odd-platform
First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.
Language:Java 1125 - piperiderLanguage:Python 469
dbt package that is part of Elementary, the dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
Language:Python 348data-drift / data-drift
Metrics Observability & Troubleshooting
Language:HTML 302- datachecks
waterdipai / datachecks
Open Source Data Quality Monitoring.
Language:Python 129 re-data / dbt-re-data
re_data - fix data issues before your users & CEO would discover them 😊
Language:Python 96- swiple
Swiple / swiple
Swiple enables you to easily observe, understand, validate and improve the quality of your data
Language:Python 78 oslabs-beta / DataDoc
Endpoint downtime detection, monitoring, and traffic simulation developer tool
Language:JavaScript 66Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
Language:Python 61- dqo
dqops / dqo
Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observability. Configure data quality checks from the UI or in YAML files, let DQOps run the data quality checks daily to detect data quality issues.
Language:Java 55 Open-source metadata collector based on ODD Specification
Language:Python 42- data-observability-installer
DataKitchen / data-observability-installer
Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team is the first to know and the first to solve with visibility across and down your data estate. Save time with simple, fast data quality test generation and execution. Trust your data, tools, and systems end to end.
Language:Python 15 Open Standard for Metadata. A Single place to Discover, Collaborate and Get your data right.
Language:CSS 11:zap: Prevent downstream data quality issues by integrating the Soda Library into your CI/CD pipeline.
Language:Python 11- dataops-observability
DataOps Observability is part of DataKitchen's Open Source Data Observability. DataOps Observability monitors every data journey from data source to customer value, from any team development environment into production, across every tool, team, environment, and customer so that problems are detected, localized, and understood immediately.
Language:Python 10 - dataops-testgen
DataOps TestGen is part of DataKitchen's Open Source Data Observability. DataOps TestGen delivers simple, fast data quality test generation and execution by data profiling, new dataset screening and hygiene review, algorithmic generation of data quality validation tests, ongoing testing of new data refreshes, & continuous data anomaly monitoring
Language:Python 10 kiwicom / terraform-provider-montecarlo
This open-source Terraform provider enables users to seamlessly integrate the Monte Carlo data reliabillity platform into their infrastructure as a code (IaC) workflows.
Language:Go 9- dataops-observability-agents
DataOps Observability Integration Agents are part of DataKitchen's Open Source Data Observability. They connect to various ETL, ELT, BI, data science, data visualization, data governance, and data analytic tools. They provide logs, messages, metrics, overall run-time start/stop, subtask status, and scheduling information to DataOps Observability.
Language:Python 7 cgnorthcutt / reliablity_framework_for_rag
Demo showing how the Trustworthy Language Model add reliability to LLM outputs and improves RAG, agents, and data enrichment worfklows. can be used to improve fine-tuning of LLMs, accuracy of LLM outputs, and smart routing for RAG and agents.
Language:Jupyter Notebook 4datasphere-oss / datasphere
DataSphere is the first open-source cloud-native data observability platform that helps you trace the whole data infrastructure in your warehouses, lakes and databases.
Language:Java 4GuinsooLab / stealthward
dbt native framework built to observe modern data stack
Language:HTML 4Open-source GCP metadata collector based on ODD Specification
Language:Python 4- Language:Python 4
- Language:Python 4
annamatias / dataengineer
Códigos, plataformas, ferramentas e processos em alta;
Language:Python 1Jaimeloeuf / Jevents
A simple to use EventEmitter and Data-Observer python package.
Language:Python 1- swiple-action
Automatically validate datasets, poll task status, and display validation results in a GitHub using Swiple pull request.
Language:Python 1 SachinVarghese / pgamber
Data observability for postgreSQL using alibi-detect
Language:Go 0mark-antal-csizmadia / em-simple
Expectation Maximization (EM) algorithm for estimating maximum likelihood (ML) parameters of partially observed data on a three-node Bayesian Network Probabilistic Graphical Model.
Language:Jupyter Notebookrishuatgithub / data-lin-observability
Data Lineage Observability Project
Language:Shell
