A set of utility functions and classes to aid in build Spark jobs on the Azure Databricks Platform.
- Spark Job
- Job Configuration
- Secrets
- Spark Session
The Structure module provides functions for building a more abstract definition of a Hive table schema and abstractions for creating table, column and cell data which can be provided as the data argument when creating a dataframe.