Databricks's repositories
Spark-The-Definitive-Guide
Spark: The Definitive Guide's Code Repository
spark-sklearn
(Deprecated) Scikit-learn integration package for Apache Spark
spark-avro
Avro Data Source for Apache Spark
spark-corenlp
Stanford CoreNLP wrapper for Apache Spark
spark-perf
Performance tests for Apache Spark
spark-knowledgebase
Spark Knowledge Base
benchmarks
A place in which we publish scripts for reproducible benchmarks.
sbt-databricks
An sbt plugin for deploying code to Databricks Cloud
pig-on-spark
proof-of-concept implementation of Pig-on-Spark integrated at the logical node level
xgb-regressor
MLflow XGBoost Regressor
databricks-accelerators
Accelerate the use of Databricks for customers [public repo]
genomics-pipelines
secondary analysis pipelines parallelized with apache spark
terraform-databricks-mlops-aws-infrastructure
This module sets up multi-workspace model registry between a Databricks AWS development (dev) workspace, staging workspace, and production (prod) workspace, allowing READ access from dev/staging workspaces to staging & prod model registries.
terraform-databricks-aws-workspace
Terraform module to create Databricks AWS E2 workspace
spark-salesforce
Spark data source for Salesforce
terraform-databricks-mlops-azure-infrastructure-with-sp-creation
This module sets up multi-workspace model registry between an Azure Databricks development (dev) workspace, staging workspace, and production (prod) workspace, allowing READ access from dev/staging workspaces to staging & prod model registries. It also creates the relevant Azure Active Directory (AAD) applications for the service principals.
build-tooling
Databricks Education department's curriculum build tool chain
test-infra
Test infrastructure for the Kubernetes project.