data-quality

There are 28 repositories under data-quality topic.

applied-ml
eugeneyan / applied-ml
📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.
applied-machine-learning production applied-data-science machine-learning data-science reinforcement-learning data-engineering recsys search deep-learning data-quality data-discovery computer-vision natural-language-processing
19692
ydataai / pandas-profiling
Create HTML profiling reports from pandas DataFrame objects
pandas-profiling pandas-dataframe statistics jupyter-notebook exploration data-science python pandas machine-learning deep-learning exploratory-data-analysis eda data-quality html-report data-exploration data-analysis jupyter big-data-analytics data-profiling hacktoberfest
Language:Python 8973
great-expectations / great_expectations
Always know what to expect from your data.
cleandata data-engineering data-profilers data-profiling data-quality data-science data-unit-tests datacleaner datacleaning dataquality dataunittest eda exploratory-analysis exploratory-data-analysis exploratorydataanalysis mlops pipeline pipeline-debt pipeline-testing pipeline-tests
Language:Python 6611
cleanlab / cleanlab
The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels
weak-supervision machine-learning confident-learning robust-machine-learning learning-with-confident-examples learning-with-noisy-labels noisy-data data-cleaning audio-classification classification data-quality data-science exploratory-data-analysis image-classification label-errors noisy-labels text-classification data-centric-ai data-centric-machine-learning
Language:Python 3419
feast-dev / feast
Feature Store for Machine Learning
machine-learning features ml big-data feature-engineering feature-store python mlops data-engineering data-science data-quality
Language:Python 3196
lakeFS
treeverse / lakeFS
Git-like capabilities for your object storage
data-engineering data-versioning go object-storage data-lake aws-s3 data-quality azure-blob-storage google-cloud-storage golang git-for-data lakefs apache-spark apache-sparksql hadoop-filesystem datalake datalakes hacktoberfest data-version-control
Language:Go 2482
whylabs / whylogs
The open source standard for data logging
ai-pipelines approximate-statistics statistical-properties data-quality calculate-statistics python logging mlops dataops aiops ml-pipelines data-pipeline dataset machine-learning data-science
Language:HTML 1152
re-data / re-data
re_data - fix data issues before your users & CEO would discover them 😊
data-analysis data-monitoring data-observability data-quality data-quality-checks data-quality-monitoring data-reliability data-testing dataquality dbt dbt-packages open-source-tooling
Language:HTML 1054
soda-core
sodadata / soda-core
Data profiling, testing, and monitoring for SQL accessible data.
airflow airflow-operators data-analytics data-engineering data-monitoring data-observability data-pipeline-monitoring data-profiling data-quality data-quality-framework data-quality-monitoring data-reliability data-science data-testing data-unit-tests metrics monitoring python
Language:Python 848
linkedin / feathr
Feathr – An Enterprise-Grade, High Performance Feature Store
feature-engineering feature-store artificial-intelligence mlops data-engineering data-quality machine-learning mlops-workflow
Language:Scala 675
pointblank
rich-iannone / pointblank
Data quality assessment and metadata reporting for data frames and database tables
data-validation database-tables data-dictionaries easy-to-understand data-frames reporting-tool data-profiler data-management schema-validation data-verification data-checker data-assertions yaml-configuration data-inference testing-tools data-quality
Language:R 639
WeBankFinTech / Qualitis
Qualitis is a one-stop data quality management platform that supports quality verification, notification, and management for various datasource. It is used to solve various data quality problems caused by data processing. https://github.com/WeBankFinTech/Qualitis
quality quality-check quality-improvement data-quality linkis dss datashperestudio workflow data-quality-model compare
Language:Java 459
polyaxon / datatile
A library for managing, validating, summarizing, and visualizing data.
pandas pandas-summary dataframes data-analysis data-science spark dask plotly statistics matplotlib data-profiling data-visualization data-summary data-reporting data-exploration dataops mlops data-quality data-quality-monitoring data-quality-checks
Language:Python 415
odd-platform
opendatadiscovery / odd-platform
First open-source data discovery and observability platform. ODD Platform is based on ODD Specification.
alerting bigdata data-catalog data-discovery data-engineering data-exploration data-governance data-lineage data-pipelines data-platform data-profiling data-quality data-science datacatalog hacktoberfest lineage metadata metadata-management observability oss
Language:TypeScript 191
whylabs / whylogs-java
Profile and monitor your ML data pipeline end-to-end
ai-pipelines approximate-statistics dataset data-quality statistics whylogs aiops mlops spark apache-spark java statistical-properties calculate-statistics
Language:Java 178
ubisoft / mobydq
:whale: Tool to automate data quality checks on data pipelines
data-quality data-pipeline data-warehouse big-data data-quality-checks data-quality-monitoring
Language:Vue 177
frederick0329 / TracIn
Implementation of Estimating Training Data Influence by Tracing Gradient Descent (NeurIPS 2020)
influence data-quality
Language:Jupyter Notebook 167
Hyhyhyhyhyhyh / Django-Data-quality-system
数据治理、数据质量检核/监控平台（Django+jQuery+MySQL）
data-quality data-quality-checks data-quality-monitor data-quality-monitoring
Language:Python 150
AKSW / RDFUnit
An RDF Unit Testing Suite
shacl rdf data-quality data-quality-checks schema schema-validation web-ontology-language validation unit-testing data-validation
Language:Java 133
vmware / versatile-data-kit
Versatile Data Kit is a data engineering framework that enables Data Engineers to develop, troubleshoot, deploy, run, and manage data processing workloads.
data-science data-engineering sql trino data-quality data-lineage etl elt data-pipelines data-engineer data-warehouse warehouse analytics sqlite3 trinodb snowflake
Language:Python 118
NBi
Seddryck / NBi
NBi is a testing framework (add-on to NUnit) for Business Intelligence and Data Access. The main goal of this framework is to let users create tests with a declarative approach based on an Xml syntax. By the means of NBi, you don't need to develop C# or Java code to specify your tests! Either, you don't need Visual Studio or Eclipse to compile your test suite. Just create an Xml file and let the framework interpret it and play your tests. The framework is designed as an add-on of NUnit but with the possibility to port it easily to other testing frameworks.
nunit database cube etl business-intelligence test-automation test-framework data-quality data-quality-checks
Language:C# 96
great-expectations / airflow-provider-great-expectations
Great Expectations Airflow operator
data-science airflow-operators data-quality data-testing
Language:Python 93
awesome-data-catalogs
opendatadiscovery / awesome-data-catalogs
📙 Awesome Data Catalogs and Observability Platforms.
data-catalog data-discovery metadata dataops awesome observability data-engineering data-quality big-data opensource open-source ml awesome-list oss opendata datadiscovery metadata-management datacatalog
84
Impetus / jumbune
Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http://jumbune.com. More details of open source offering are at,
hadoop-cluster yarn yarn-hadoop-cluster optimization-framework hadoop hadoop-monitor data-quality data-analysis devops-tools developer-tools monitoring-tool hadoop-monitoring cluster-monitoring apm aiops
Language:Java 69
DataQualityDashboard
OHDSI / DataQualityDashboard
A tool to help improve data quality standards in observational data science.
data-quality
Language:JavaScript 64
socialpoint-labs / sqlbucket
Lightweight library to write, orchestrate and test your SQL ETL. Writing ETL with data integrity in mind.
data-engineering-workflows data-integrity data-quality data-quality-checks etl etl-framework sql
Language:Python 64
aws-samples / amazon-deequ-glue
Automated data quality suggestions and analysis with Deequ on AWS Glue
deequ aws-glue aws data-quality
Language:Scala 63
ucd-dnp / leila
Librería para la evaluación de calidad de datos, e interacción con el portal de datos.gov.co
data-science data-quality report-generator eda exploratory-data-analysis python espanol ucd
Language:Jupyter Notebook 57
great_expectations_action
great-expectations / great_expectations_action
A GitHub Action that makes it easy to use Great Expectations to validate your data pipelines in your CI workflows.
actions data-science mlops data-quality data-integrity continuous-integration
Language:Jupyter Notebook 54
re-data / dbt-re-data
re_data - fix data issues before your users & CEO would discover them 😊
data-quality dbt data-monitoring data-observability data-testing dbt-packages sql
Language:Python 50
sodadata / soda-spark
Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
data-engineering data-observability data-quality data-testing pyspark python soda-sql spark
Language:Python 49
ammsa / DTCleaner
DTCleaner: data cleaning using multi-target decision trees.
data-science data-quality data-cleaning data-mining data-preprocessing data-wrangling
Language:Java 37
tkleykamp / DataOps
DataOps for Government
data-quality analytics dataops-principles dataops government
32
kevinadhiguna / dqlab-career-track
A collection of scripts written to complete DQLab Data Analyst Career Track 📊
dqlab career-track python data-manipulation data-quality data-visualization exploratory-data-analysis sql machine-learning data-analyst data-analysis dqlab-career-track
Language:Python 30
mikulskibartosz / check-engine
Data validation library for PySpark 3.0.0
big-data data-quality data-validation pyspark
Language:Python 28
astutic / Acharya
A Data Centric MLOps tool for your Named Entity Recognition projects
mlops data-centric ai named-entity-recognition ner machine-learning natural-language-processing datasets annotation-tool text-annotation text-annotation-tool data-labeling data-labeling-tools annota annotation-processing data-centric-ai data-quality data-quality-monitoring
26

ezoic increase your site revenue

Related Topics

r rstats statistics r-package shiny