nayanex

data-downtime-challenge

databricks-sdk-py

Databricks SDK for Python (Beta)

delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

bundle-examples

Examples of Databricks Asset Bundles

DependencyCheck

OWASP dependency-check is a software composition analysis utility that detects publicly disclosed vulnerabilities in application dependencies.

ydata-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

PyData-Global-2023-Improving-Open-Data-Quality-using-Python

This repo has the complete materials of the tutorial session Improving Open Data Quality using Python, presented at PyData Global 2023 conference

community-demo-2024-04-16

Demos for the community meeting

gx_tutorials

gx-databricks-bigquery-public

How to leverage the power of Databricks notebooks and GX data quality checks to create validated data workflows

hands-on-great-expectations-with-spark

How to evaluate the Quality of your Data with Great Expectations and Spark.

Azure-Databricks-NYC-Taxi-Workshop

An Azure Databricks workshop leveraging the New York Taxi and Limousine Commission Trip Records dataset

DataFactoryCICD

Complete Azure Data Factory CICD Process Via Azure Pipeline

gq-great-expectations

Great Expectations Data Quality Checks is a specialized repository designed to harness the capabilities of the great_expectations Python library. With a focus on ensuring data quality, this project provides robust tools and methodologies to validate and check data across various sources.

great_expectations

Always know what to expect from your data.

lakeFS

lakeFS - Data version control for your data lake | Git for data

data_quality

The repo contains a few notebooks for you to get started with Databricks and Great Expectations. Have fun!

drunken-data-quality

Spark package for checking data quality

deequ

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

dataframe-rules-engine

Extensible Rules Engine for custom Dataframe / Dataset validation

python-deequ

Python API for Deequ

GitPython

GitPython is a python library used to interact with Git repositories.

Azure-DataFactory

azure.datafactory.tools

Tools for deploying Data Factory (v2) in Microsoft Azure

azure-devops-extension-sample

Sample web extension for Azure DevOps

cli

Databricks CLI

terragrunt

Terragrunt is a flexible orchestration tool that allows Infrastructure as Code written in OpenTofu/Terraform to scale.

azure-agent-self-hosted-toolkit

Toolkit to run azure agents under linux

python-certifi

(Python Distribution) A carefully curated collection of Root Certificates for validating the trustworthiness of SSL certificates while verifying the identity of TLS hosts.

azure-devops-cli-extension

Azure DevOps Extension for Azure CLI