scimaksim

dbsql_sme

DBSQL SME Repo contains demos, tutorials, blog code, advanced production helper functions and more!

mlflow

Open source platform for the machine learning lifecycle

spark

Apache Spark - A unified analytics engine for large-scale data processing

ucx

Automated migrations to Unity Catalog

databricks-ml-examples

Mr.-Ranedeer-AI-Tutor

A GPT-4 AI Tutor Prompt for customizable personalized learning experiences.

jupyterlab-s3-browser

A JupyterLab extension for browsing S3-compatible object storage

training-oreilly-iceberg

delta-examples

Delta Lake examples

databricks

Repository of sample Databricks notebooks

databricksActuarialWorkbench

mosaic

An extension to the Apache Spark framework that allows easy and fast processing of very large geospatial datasets.

geopandas

Python tools for geographic data

prql

PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement

ML-DataEng-Pipelines

To show the usefulness of data engineering and ML pipelines.

delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

terraform-databricks-lakehouse-blueprints

Set of Terraform automation templates and quickstart demos to jumpstart the design of a Lakehouse on Databricks. This project has incorporated best practices across the industries we work with to deliver composable modules to build a workspace to comply with the highest platform security and governance standards.

delta-live-tables-notebooks

dbldatagen

Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines

debezium

Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

FLAML

A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.

autogluon

Fast and Accurate ML in 3 Lines of Code

system-design-primer

Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

dbdemos

Demos to implement your Databricks Lakehouse

pyspark-style-guide

This is a guide to PySpark code style presenting common situations and the associated best practices based on the most frequent recurring topics across the PySpark repos we've encountered.

databricks-sync

An experimental tool to synchronize source Databricks deployment with a target Databricks deployment.

migrate

Old scripts for one-off ST-to-E2 migrations. Use "terraform exporter" linked in the readme.

diviner

Grouped time series forecasting engine

mlops-v2

Azure MLOps (v2) solution accelerators. Enterprise ready templates to deploy your machine learning models on the Azure Platform.

interpret

Fit interpretable models. Explain blackbox machine learning.