yokawasa / databricks-notebooks

Collection of Sample Databricks Spark Notebooks ( mostly for Azure Databricks )

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

databricks-notebook

Collection of Sample Databricks Spark Notebooks ( mostly for Azure Databricks )

Sample Notebooks

Notebook Description Lang
File Operations Sample Various file operations sample such as Azure Blob Storage mount & umount, ls/rm/cp/mv, read CSV file, etc Python
ELT Sample: Azure Blob Stroage - Databricks - CosmosDB In this notebook, you extract data from Azure Blob Storage into Databricks cluster, run transformations on the data in Databricks cluster, and then load the transformed data into Azure Cosmos DB Python
ELT Sample: Azure Blob Stroage - Databricks - SQLDW In this notebook, you extract data from Azure Blob Storage into Databricks cluster, run transformations on the data in Databricks cluster, and then load the transformed data into Azure SQL Data Warehouse Python
Streaming Sample: Cosmos DB ChangeFeed - Databricks In this notebook, you read a live stream of tweets that stored in Cosmos DB by leveraging Apache Spart to read the Cosmos DB's Change Feed, and run transformations on the data in Databricks cluster Python
Streaming Sample: Azure Event Hub - Databricks In this notebook, you connect Azure Event Hub (hyper-scale data ingestion service) with Azure Databricks to stream data into an Apache Spark cluster in near real-time Python

Contributing

Bug reports and pull requests are welcome on GitHub at https://github.com/yokawasa/databricks-notebook

About

Collection of Sample Databricks Spark Notebooks ( mostly for Azure Databricks )

License:MIT License


Languages

Language:Jupyter Notebook 95.4%Language:Shell 4.6%