Monitoring Databricks in AWS
This repository contains libraries and init scripts to support various monitoring solutions for AWS deployments
/cloudwatch
Contains the init script for monitoring databricks with AWS cloudwatch
/custom-metrics
Contains a sample notebook for generating custom metrics
/datadog
Contains the init script for installing and configuring datadog agent on databricks clusters
/log4j-json-layout
Contains the library which adds support for structured logging via Json in log4j 1.2
/spark-statsd
Adds statsd metrics sink to DBR