databricks

There are 46 repositories under databricks topic.

getredash / redash
Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
redash python visualization analytics bi redshift bigquery athena mysql postgresql dashboard javascript business-intelligence databricks spark spark-sql hacktoberfest
Language:Python 25459
Tencent / APIJSON
🏆 零代码、全功能、强安全 ORM 库 🚀 后端接口和文档零代码，前端(客户端) 定制返回 JSON 的数据和结构。 🏆 A JSON Transmission Protocol and an ORM Library 🚀 provides APIs and Docs without writing any code.
postgresql-database tidb sqlserver oracle clickhouse postgresql hive hadoop tdengine low-code lowcode nocode serverless baas crud milvus elasticsearch influxdb databricks snowflake
Language:Java 16943
databrickslabs / dolly
Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform
databricks gpt chatbot dolly
Language:Python 10807
tobymao / sqlglot
Python SQL Parser and Transpiler
transpiler sql python parser optimizer bigquery duckdb hive mysql postgres presto snowflake spark sqlite sqlparser trino tsql clickhouse redshift databricks
Language:Python 6079
SynapseML
microsoft / SynapseML
Simple and Distributed Machine Learning
spark pyspark azure scala microsoft ml machine-learning databricks cognitive-services lightgbm http model-deployment deep-learning ai apache-spark data-science synapse big-data onnx opencv
Language:Scala 5020
databricks / dbrx
Code examples and resources for DBRX, a large language model developed by Databricks
databricks gen-ai generative-ai llm llm-inference llm-training mosaic-ai
Language:Python 2484
delta-io / delta-rs
A native Rust library for Delta Lake, with bindings into Python
databricks delta delta-lake pandas pandas-dataframe python rust
Language:Rust 2014
dotnet / spark
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
analytics apache-spark azure bigdata csharp databricks dotnet dotnet-core dotnet-standard emr fsharp hdinsight machine-learning microsoft spark spark-sql spark-streaming streaming tpcds tpch
Language:C# 2010
multiwoven
Multiwoven / multiwoven
🔥🔥🔥 Open Source Alternative to Hightouch, Census, and RudderStack - Reverse ETL & Customer Data Platform (CDP)
data-engineering reverse-etl data-pipeline data-activation etl react ruby self-hosted open-source dbt bigquery data-warehouse databricks postresql redshift snowflake typescript hacktoberfest cdp customer-data-platform
Language:Ruby 725
Azure-Samples / modern-data-warehouse-dataops
DataOps for the Modern Data Warehouse on Microsoft Azure. https://aka.ms/mdw-dataops.
automatedtesting azure cicd data databricks datafactory dataops devops mdw
Language:Shell 552
synmetrix
synmetrix / synmetrix
Synmetrix – production-ready open source semantic layer on Cube
business-intelligence clickhouse redshift big-data cube cubejs databricks prestodb druid firebolt snowflake dremio data-engineering llm bigquery semantic-layer vertica
Language:JavaScript 491
databrickslabs / dbx
🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.
ci cicd databricks databricks-api databricks-cli mlops
Language:Python 437
terraform-provider-databricks
databricks / terraform-provider-databricks
Databricks Terraform Provider
aws azure databricks databricks-automation gcp terraform terraform-provider
Language:Go 426
mlops-platforms
thoughtworks / mlops-platforms
Compare MLOps Platforms. Breakdowns of SageMaker, VertexAI, AzureML, Dataiku, Databricks, h2o, kubeflow, mlflow...
mlops kubeflow mlflow sagemaker dataiku databricks h2oai azureml google-ai-platform knime machine-learning data-science datarobot pachyderm seldon iguazio
378
databricks / mlops-stacks
This repo provides a customizable stack for starting new ML projects on Databricks that follow production best-practices out of the box.
databricks machine-learning mlops
Language:Python 377
databricks / databricks-sdk-py
Databricks SDK for Python (Beta)
databricks databricks-sdk python
Language:Python 323
databrickslabs / dbldatagen
Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines
data-generation databricks datagen datageneration datagenerator delta-live-tables deltalake faker pyspark python spark spark-streaming synthetic-data
Language:Python 291
microsoft / nutter
Testing framework for Databricks notebooks
databricks-notebooks databricks azuredevops
Language:Python 272
Azure / azure-event-hubs-spark
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
spark spark-streaming azure scala eventhubs real-time streaming continuous apache apache-spark microsoft event-hubs connector databricks stream structured-streaming bigdata ingestion kafka
Language:Scala 232
databrickslabs / overwatch
Capture deep metrics on one or all assets within a Databricks workspace
databricks monitoring
Language:Scala 221
adidas / lakehouse-engine
The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
big-data configuration-driven data-engineering data-quality databricks delta-lake framework great-expectations lakehouse spark
Language:Python 206
databrickslabs / cicd-templates
Manage your Databricks deployments and CI with code.
cd-pipeline databricks azure-devops mlops ci gitlab github-actions aws azure
Language:Python 200
databricks / dbt-databricks
A dbt adapter for Databricks.
databricks dbt etl sql
Language:Python 199
Azure / azure-cosmosdb-spark
Apache Spark Connector for Azure Cosmos DB
azure-cosmos-db cosmos-db spark connector jupyter-notebook databricks azure-databricks lambda-architecture changefeed databricks-notebooks pyspark apache-spark
Language:Scala 198
databrickslabs / ucx
Automated migrations to Unity Catalog
databricks unity-catalog databricks-cli-installable
Language:Python 198
databricks / terraform-databricks-examples
Examples of using Terraform to deploy Databricks resources
aws azure databricks databricks-module gcp lakehouse terraform terraform-module
Language:HCL 191
analytics-toolbox-core
CartoDB / analytics-toolbox-core
A set of UDFs and Procedures to extend BigQuery, Snowflake, Redshift, Postgres and Databricks with Spatial Analytics capabilities
bigquery snowflake carto gis redshift geospatial databricks postgres sql analytics-toolbox
Language:JavaScript 186
aloneguid / stowage
Bloat-free, no BS cloud storage SDK.
aws-s3 azure-storage databricks gcp-storage
Language:C# 165
lamastex / scalable-data-science
Scalable Data Science, course sets in big data Using Apache Spark over databricks and their mathematical, statistical and computational foundations using SageMath.
apache-spark databricks data-science scala
Language:HTML 164
databricks / databricks-sql-python
Databricks SQL Connector for Python
databricks dwh python3 sql
Language:Python 145
VariantSpark
aehrc / VariantSpark
machine learning for genomic variants
variant-spark gwas random-forest genome association-studies vcf variantspark notebook databricks bioinformatics aws emr
Language:JavaScript 138
dataflint / spark
Performance Observability for Apache Spark
apache-spark big-data observability optimization data-pipeline data-pipelines databricks dataproc emr etl spark-operator
Language:TypeScript 138
databricks / cli
Databricks CLI
command-line-interface databricks
Language:Go 117
DataThirstLtd / azure.databricks.cicd.tools
Tools for Deploying Databricks Solutions in Azure
powershell databricks devops azure
Language:PowerShell 97
ApacheSpark
martandsingh / ApacheSpark
This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.
apachespark data-analysis data-engineering database databricks datalake deltalake etl-pipeline hadoop hive spark spark-sql spark-streaming timetravel etl pyspark sql
Language:Python 88
yokawasa / databricks-notebooks
Collection of Sample Databricks Spark Notebooks ( mostly for Azure Databricks )
databricks azure azuredatabricks python spark elt streaming
Language:Jupyter Notebook 79

databricks

getredash / redash

Tencent / APIJSON

databrickslabs / dolly

tobymao / sqlglot

microsoft / SynapseML

databricks / dbrx

delta-io / delta-rs

dotnet / spark

Multiwoven / multiwoven

Azure-Samples / modern-data-warehouse-dataops

synmetrix / synmetrix

databrickslabs / dbx

databricks / terraform-provider-databricks

thoughtworks / mlops-platforms

databricks / mlops-stacks

databricks / databricks-sdk-py

databrickslabs / dbldatagen

microsoft / nutter

Azure / azure-event-hubs-spark

databrickslabs / overwatch

adidas / lakehouse-engine

databrickslabs / cicd-templates

databricks / dbt-databricks

Azure / azure-cosmosdb-spark

databrickslabs / ucx

databricks / terraform-databricks-examples

CartoDB / analytics-toolbox-core

aloneguid / stowage

lamastex / scalable-data-science

databricks / databricks-sql-python

aehrc / VariantSpark

dataflint / spark

databricks / cli

DataThirstLtd / azure.databricks.cicd.tools

martandsingh / ApacheSpark

yokawasa / databricks-notebooks