databricks

There are 45 repositories under databricks topic.

getredash / redash
Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
analytics athena bi bigquery business-intelligence dashboard databricks hacktoberfest javascript mysql postgresql python redash redshift spark spark-sql visualization
Language:Python 25104
Tencent / APIJSON
🏆 零代码、全功能、强安全 ORM 库 🚀 后端接口和文档零代码，前端(客户端) 定制返回 JSON 的数据和结构。 🏆 A JSON Transmission Protocol and an ORM Library 🚀 provides APIs and Docs without writing any code.
postgresql-database tidb sqlserver oracle clickhouse postgresql hive hadoop tdengine low-code lowcode nocode serverless baas crud milvus elasticsearch influxdb databricks snowflake
Language:Java 16730
databrickslabs / dolly
Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform
chatbot databricks dolly gpt
Language:Python 10791
tobymao / sqlglot
Python SQL Parser and Transpiler
bigquery clickhouse databricks duckdb hive mysql optimizer parser postgres presto python redshift snowflake spark sql sqlite sqlparser transpiler trino tsql
Language:Python 5718
SynapseML
microsoft / SynapseML
Simple and Distributed Machine Learning
ai apache-spark azure big-data cognitive-services data-science databricks deep-learning http lightgbm machine-learning microsoft ml model-deployment onnx opencv pyspark scala spark synapse
Language:Scala 4987
databricks / dbrx
Code examples and resources for DBRX, a large language model developed by Databricks
databricks gen-ai generative-ai llm llm-inference llm-training mosaic-ai
Language:Python 2429
dotnet / spark
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
analytics apache-spark azure bigdata csharp databricks dotnet dotnet-core dotnet-standard emr fsharp hdinsight machine-learning microsoft spark spark-sql spark-streaming streaming tpcds tpch
Language:C# 2001
delta-io / delta-rs
A native Rust library for Delta Lake, with bindings into Python
databricks delta delta-lake pandas pandas-dataframe python rust
Language:Rust 1879
optscale
hystax / optscale
FinOps and MLOps platform to run ML/AI and regular cloud workloads with optimal performance and cost.
aws azure cloud cloud-cost cloud-cost-intelligence cost-optimization data-science databricks devops experiment-tracking finops gcp kubernetes ml mlflow mlops paas-instrumentation paas-profiling s3-optimization
Language:Python 1018
multiwoven
Multiwoven / multiwoven
🔥🔥🔥 Open Source Alternative to Hightouch, Census, and RudderStack.
bigquery cdp customer-data-platform data-activation data-engineering data-pipeline data-warehouse databricks dbt etl hacktoberfest open-source postresql react redshift reverse-etl ruby self-hosted snowflake typescript
Language:Ruby 654
Azure-Samples / modern-data-warehouse-dataops
DataOps for the Modern Data Warehouse on Microsoft Azure. https://aka.ms/mdw-dataops.
automatedtesting azure cicd data databricks datafactory dataops devops mdw
Language:Shell 539
mlcraft
mlcraft-io / mlcraft
Synmetrix – open source semantic layer / Boost your LLM precision
business-intelligence clickhouse redshift big-data cube cubejs databricks prestodb druid firebolt snowflake dremio data-engineering llm bigquery semantic-layer vertica
Language:JavaScript 473
databrickslabs / dbx
🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.
ci cicd databricks databricks-api databricks-cli mlops
Language:Python 435
terraform-provider-databricks
databricks / terraform-provider-databricks
Databricks Terraform Provider
aws azure databricks databricks-automation gcp terraform terraform-provider
Language:Go 411
mlops-platforms
thoughtworks / mlops-platforms
Compare MLOps Platforms. Breakdowns of SageMaker, VertexAI, AzureML, Dataiku, Databricks, h2o, kubeflow, mlflow...
mlops kubeflow mlflow sagemaker dataiku databricks h2oai azureml google-ai-platform knime machine-learning data-science datarobot pachyderm seldon iguazio
371
databricks / databricks-sdk-py
Databricks SDK for Python (Beta)
databricks python databricks-sdk
Language:Python 304
databricks / mlops-stacks
This repo provides a customizable stack for starting new ML projects on Databricks that follow production best-practices out of the box.
databricks machine-learning mlops
Language:Python 281
databrickslabs / dbldatagen
Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines
datagen pyspark python data-generation faker spark spark-streaming delta-live-tables deltalake databricks synthetic-data datageneration datagenerator
Language:Python 270
microsoft / nutter
Testing framework for Databricks notebooks
azuredevops databricks databricks-notebooks
Language:Python 265
Azure / azure-event-hubs-spark
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
spark spark-streaming azure scala eventhubs real-time streaming continuous apache apache-spark microsoft event-hubs connector databricks stream structured-streaming bigdata ingestion kafka
Language:Scala 232
databrickslabs / overwatch
Capture deep metrics on one or all assets within a Databricks workspace
databricks monitoring
Language:Scala 217
databrickslabs / cicd-templates
Manage your Databricks deployments and CI with code.
cd-pipeline databricks azure-devops mlops ci gitlab github-actions aws azure
Language:Python 200
Azure / azure-cosmosdb-spark
Apache Spark Connector for Azure Cosmos DB
azure-cosmos-db cosmos-db spark connector jupyter-notebook databricks azure-databricks lambda-architecture changefeed databricks-notebooks pyspark apache-spark
Language:Scala 197
databricks / dbt-databricks
A dbt adapter for Databricks.
dbt sql etl databricks
Language:Python 188
adidas / lakehouse-engine
The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
big-data configuration-driven data-engineering data-quality databricks delta-lake framework great-expectations lakehouse spark
Language:Python 187
analytics-toolbox-core
CartoDB / analytics-toolbox-core
A set of UDFs and Procedures to extend BigQuery, Snowflake, Redshift, Postgres and Databricks with Spatial Analytics capabilities
bigquery snowflake carto gis redshift geospatial databricks postgres sql analytics-toolbox
Language:JavaScript 185
databricks / terraform-databricks-examples
Examples of using Terraform to deploy Databricks resources
aws azure databricks gcp lakehouse terraform terraform-module databricks-module
Language:HCL 183
databrickslabs / ucx
Your best companion for upgrading to Unity Catalog. UCX will guide you, the Databricks customer, through the process of upgrading your account, groups, workspaces, jobs etc. to Unity Catalog.
databricks unity-catalog databricks-cli-installable
Language:Python 164
lamastex / scalable-data-science
Scalable Data Science, course sets in big data Using Apache Spark over databricks and their mathematical, statistical and computational foundations using SageMath.
apache-spark databricks data-science scala
Language:HTML 164
aloneguid / stowage
Bloat-free, no BS cloud storage SDK.
databricks aws-s3 azure-storage gcp-storage
Language:C# 160
VariantSpark
aehrc / VariantSpark
machine learning for genomic variants
variant-spark gwas random-forest genome association-studies vcf variantspark notebook databricks bioinformatics aws emr
Language:JavaScript 138
databricks / databricks-sql-python
Databricks SQL Connector for Python
databricks dwh python3 sql
Language:Python 132
dataflint / spark
Performance Observability for Apache Spark
apache-spark big-data data-pipeline data-pipelines databricks dataproc emr etl observability optimization spark-operator
Language:TypeScript 127
databricks / cli
Databricks CLI
command-line-interface databricks
Language:Go 107
DataThirstLtd / azure.databricks.cicd.tools
Tools for Deploying Databricks Solutions in Azure
powershell databricks devops azure
Language:PowerShell 97
ApacheSpark
martandsingh / ApacheSpark
This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.
apachespark data-analysis data-engineering database databricks datalake deltalake etl etl-pipeline hadoop hive pyspark spark spark-sql spark-streaming sql timetravel
Language:Python 82

databricks

getredash / redash

Tencent / APIJSON

databrickslabs / dolly

tobymao / sqlglot

microsoft / SynapseML

databricks / dbrx

dotnet / spark

delta-io / delta-rs

hystax / optscale

Multiwoven / multiwoven

Azure-Samples / modern-data-warehouse-dataops

mlcraft-io / mlcraft

databrickslabs / dbx

databricks / terraform-provider-databricks

thoughtworks / mlops-platforms

databricks / databricks-sdk-py

databricks / mlops-stacks

databrickslabs / dbldatagen

microsoft / nutter

Azure / azure-event-hubs-spark

databrickslabs / overwatch

databrickslabs / cicd-templates

Azure / azure-cosmosdb-spark

databricks / dbt-databricks

adidas / lakehouse-engine

CartoDB / analytics-toolbox-core

databricks / terraform-databricks-examples

databrickslabs / ucx

lamastex / scalable-data-science

aloneguid / stowage

aehrc / VariantSpark

databricks / databricks-sql-python

dataflint / spark

databricks / cli

DataThirstLtd / azure.databricks.cicd.tools

martandsingh / ApacheSpark