johndutchover / dbr-scala

Exploring Databricks for Scala

Exploring Databricks

Use IntelliJ IDEA with Databricks Connect for Scala

Databricks Connect

What is Databricks Connect?

Databricks Community Edition

• Only supports web-based notebooks.

Sample Compute Cluster

Databricks Runtime Version

• 14.3 LTS (includes Apache Spark 3.5.0, Scala 2.12)
  • Apache Spark 14.3.x-scala2.12
  • Scala version 2.12.15
  • Java SDK 1.8.0_392 (Azul Systems, Inc.)

Driver type: Community Optimized

• 15.3 GB Memory
• 2 Cores
• 1 DBU

Build tools

• sbt version 1.9.8