Databricks

Spark-The-Definitive-Guide

Spark: The Definitive Guide's Code Repository

spark-sklearn

(Deprecated) Scikit-learn integration package for Apache Spark

spark-csv

CSV Data Source for Apache Spark 1.x

spark-sql-perf

spark-avro

Avro Data Source for Apache Spark

spark-corenlp

Stanford CoreNLP wrapper for Apache Spark

spark-perf

Performance tests for Apache Spark

spark-knowledgebase

Spark Knowledge Base

benchmarks

A place in which we publish scripts for reproducible benchmarks.

mlflow

Open source platform for the machine learning lifecycle

sbt-databricks

An sbt plugin for deploying code to Databricks Cloud

simr

Spark In MapReduce (SIMR) - launching Spark applications on existing Hadoop MapReduce infrastructure

devbox

pig-on-spark

proof-of-concept implementation of Pig-on-Spark integrated at the logical node level

xgb-regressor

MLflow XGBoost Regressor

databricks-accelerators

Accelerate the use of Databricks for customers [public repo]

genomics-pipelines

secondary analysis pipelines parallelized with apache spark

spark-sklearn-docs

mlflow-example-sklearn-elasticnet-wine

terraform-databricks-mlops-aws-infrastructure

This module sets up multi-workspace model registry between a Databricks AWS development (dev) workspace, staging workspace, and production (prod) workspace, allowing READ access from dev/staging workspaces to staging & prod model registries.

subpar

Subpar is a utility for creating self-contained python executables. It is designed to work well with Bazel.

terraform-databricks-aws-workspace

Terraform module to create Databricks AWS E2 workspace

spark-salesforce

Spark data source for Salesforce

terraform-databricks-mlops-azure-infrastructure-with-sp-creation

This module sets up multi-workspace model registry between an Azure Databricks development (dev) workspace, staging workspace, and production (prod) workspace, allowing READ access from dev/staging workspaces to staging & prod model registries. It also creates the relevant Azure Active Directory (AAD) applications for the service principals.

azure-databricks-demos

build-tooling

Databricks Education department's curriculum build tool chain

govmm-1

Virtual Machine Manager for Go (govmm) is a suite of packages that provide Go APIs for creating and managing virtual machines.

lsbrepo

sjsonet-old

test-infra

Test infrastructure for the Kubernetes project.