niwilso / data-drift-monitor

Example code for integrating a custom data drift monitor into an MLOps solution using Azure Databricks and MLFlow.

Clinical Data Drift Monitoring Example

In "Building a clinical data drift monitoring system with Azure DevOps, Azure Databricks, and MLflow", we detail our approach to implementing data drift monitoring of healthcare data for Philips in a Microsoft Commercial Software Engineering (CSE) and Philips collaboration.

This repository contains example code and provides documentation on how to set up a data drift monitoring pipeline in Azure DevOps using the open source New York Times COVID-19 dataset.

Where to start

• How to create a Databricks workspace to run the code
• How to set up the data drift monitoring pipeline
• Data drift monitoring pipeline code
• Overview of the data drift monitoring code