model-monitoring

There are 12 repositories under model-monitoring topic.

mlops-zoomcamp
DataTalksClub / mlops-zoomcamp
Free MLOps course from DataTalks.Club
machine-learning mlops model-deployment model-monitoring workflow-orchestration
Language:Jupyter Notebook 9899
evidentlyai / evidently
Evaluate and monitor ML models from validation to production. Join our Discord: https://discord.com/invite/xZjKRaNp8b
data-drift data-science hacktoberfest html-report jupyter-notebook machine-learning machine-learning-operations mlops model-monitoring pandas-dataframe production-machine-learning
Language:Jupyter Notebook 4706
deepchecks / deepchecks
Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
machine-learning ml model-validation data-validation mlops data-science python jupyter-notebook model-monitoring data-drift html-report deep-learning pytorch pandas-dataframe
Language:Python 3400
giskard
Giskard-AI / giskard
🐢 Open-Source Evaluation & Testing for LLMs and ML models
ai-red-team ai-safety ai-security ai-testing ethical-artificial-intelligence fairness-ai llm llm-eval llm-evaluation llm-security llmops ml-safety ml-testing ml-validation mlops model-monitoring rag-evaluation red-team-tools responsible-ai trustworthy-ai
Language:Python 3199
phoenix
Arize-ai / phoenix
AI Observability & Evaluation
ai-monitoring ai-observability ai-roi clustering llm-eval llmops ml-monitoring ml-observability mlops model-monitoring model-observability umap
Language:Jupyter Notebook 2768
nannyml
NannyML / nannyml
nannyml: post-deployment data science in python
machine-learning ml mlops performance-monitoring data-science monitoring python data-drift model-monitoring data-analysis visualization deep-learning jupyter-notebook machinelearning postdeploymentdatascience performance-estimation
Language:Python 1764
traceloop / openllmetry
Open-source observability for your LLM application, based on OpenTelemetry
llmops observability open-telemetry metrics monitoring opentelemetry datascience ml model-monitoring opentelemetry-python python good-first-issue help-wanted artifical-intelligence generative-ai good-first-issues llm open-source
Language:Python 1344
traceloop / openllmetry-js
Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry
datascience llmops metrics ml model-monitoring monitoring observability opentelemetry opentelemetry-javascript typescript javascript generative-ai nextjs open-source
Language:TypeScript 228
MAIF / eurybia
⚓ Eurybia monitors model drift over time and securizes model deployment with data validation
python data-validation drift html-report machine-learning data-drift domain-classifier drift-detection model-monitoring production-machine-learning datadrift-classifier model-drift
Language:Jupyter Notebook 203
whitebox
squaredev-io / whitebox
[Not Actively Maintained] Whitebox is an open source E2E ML monitoring platform with edge capabilities that plays nicely with kubernetes
machine-learning monitoring observability python explainability explainable-ai ml-monitoring mlflow mlops modelops accuracy accuracy-metrics accuracy-score confusion-matrix f1-score recall model-monitoring k8s kubernetes xai
Language:Python 181
NimbleBoxAI / nbox
The official python package for NimbleBox. Exposes all APIs as CLIs and contains modules to make ML 🌸
data-science machine-learning ml-infrastructure ml-platform ml-service mlops mlops-pipeline mlops-workflow model-deployment model-management model-monitoring model-serving practical-mlops mlops-automation mlops-tool
Language:Python 88
aws-samples / amazon-sagemaker-mlops-workshop
MLOps workshop with Amazon SageMaker
sagemaker sagemaker-studio sagemaker-processing sagemaker-deployment tensorflow2 sagemaker-pipelines machine-learning mlops-workshop model-monitoring amazon-sagemaker
Language:Jupyter Notebook 80
inferencedb
aporia-ai / inferencedb
🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)
machine-learning model-serving kafka s3 model-monitoring mlops
Language:Python 77
VectorInstitute / cyclops
Toolkit for evaluating and monitoring AI models in clinical settings
clinical-data drift-detection mimic-iv omop-cdm clinical-decision-support healthcare mimic-iii physionet model-monitoring data-drift machine-learning deep-learning evaluation eicu-crd clinical-research electronic-health-record electronic-medical-record
Language:Python 66
evidentlyai / ml_observability_course
Free Open-source ML observability course for data scientists and ML engineers. Learn how to monitor and debug your ML models in production.
data-drift data-quality data-quality-checks llmops machine-learning-operations ml-monitoring ml-observability ml-pipelines mlops model-monitoring model-performance production-machine-learning
Language:Jupyter Notebook 59
rstudio / vetiver-python
Version, share, deploy, and monitor models.
mlops model-deploy model-monitoring model-versioning python
Language:Python 57
awesome-mlops / awesome-ml-monitoring
A curated list of awesome open source tools and commercial products for monitoring data quality, monitoring model performance, and profiling data 🚀
mlops aiops dataops datascience machine-learning concept-drift data-cleaning data-drift data-management data-monitoring data-quality data-science deep-learning machine-learning-platform model-drift model-explainability model-management model-monitoring model-performance
51
Arize-ai / client_python
A python library to send data to Arize AI!
ml-monitoring model-monitoring ai-monitoring performance-monitoring drift-monitoring data-quality-monitoring ml-observability ai-observability model-performance-management model-explainability ai-roi
Language:Python 41
jomariya23156 / full-stack-on-prem-cv-mlops
"1 config, 1 command from Jupyter Notebook to serve Millions of users", Full-stack On-Premises MLOps system for Computer Vision from Data versioning to Model monitoring and drift detection.
api computer-vision data-versioning deep-learning deployment docker drift-detection full-stack jupyter machine-learning ml-platform mlops model-monitoring monitoring on-premise python system ui website workspace
Language:Jupyter Notebook 37
prabhuomkar / bitbeast
Experiments with Model Training, Deployment & Monitoring
machine-learning model-deployment model-monitoring model-training
Language:Python 33
katonic-dev / explainit
A modern, enterprise-ready business intelligence web application
data-visualization drift-detection mlops python data-science machine-learning machine-learning-operations model-monitoring pandas-dataframe production-machine-learning
Language:Python 32
JakobLS / mlops-credit-risk
MLOps for deploying a Credit Risk model
docker-compose evidentlyai gcp grafana-dashboard makefile mlflow model-monitoring model-registry prefect experiment-tracking
Language:HTML 20
OLAMIDE100 / Capstone-Project-Mlops-ZoomCamp
This is a capstone project associated with MLOps Zoomcamp. The end goal of the project is to build an end-to-end machine learning project containing feature engineering, training, validation, tracking, modeel deployment, hosting, and general engineering best practices aimed at making house price predictions.
cloud-computing datatalksclub house-price-prediction machine-learning mlops model-monitoring model-training orchestration
Language:Python 11
basirati / model_monitoring
Model Monitoring using Prometheus and Grafana
docker-compose grafana mlops model-monitoring monitoring prometheus
Language:Jupyter Notebook 9
fiddler-labs / fiddler-examples
explainable-ai model-monitoring ai-observability
Language:Jupyter Notebook 9
Ezzaldin97 / Batch-Serving-ML-Pipeline
create a robust, simple, effecient, and modern end to end ML Batch Serving Pipeline Using set of modern open-source/free Platforms/Tools
batch-processing data-version-control experiment-tracking forecasting machine-learning machine-learning-application machine-learning-pipelines mlops model-monitoring scheduling
Language:Python 8
Arize-ai / client_java
Java client to interact with Arize API
ml-monitoring model-monitoring ai-monitoring performance-monitoring drift-monitoring data-quality-monitoring ml-observability model-observability ai-observability model-performance-management model-explainability ai-roi
Language:Java 7
cmigpereira / mlops-zoomcamp-project
Repo for my MLOps Zoomcamp project
machine-learning workflow-orchestration mlops model-deployment model-monitoring
Language:Python 6
awesome-mlops / awesome-mlops-kubernetes
A curated list of awesome open source tools and commercial products that will help you train, deploy, monitor, version, scale, and secure your production machine learning on kubernetes 🚀
deep-learning kubernetes machine-learning ml mlops operator dataops machine-learning-operations machine-learning-pipelines machine-learning-projects machine-learning-training machine-learning-workflow ml-pipeline ml-workbench model-management model-monitoring model-training orchestration workflow
5
aditikhare007 / Building-Production-Grade-LLMs
Aditi @ Building Production Grade LLMs - * Thank you AI community for visiting my repository - Stay tuned for awesome Dev-ops AI Learning Resources ** ** If you find the repository useful please give it a star - Thank you for visiting my repository - Happy Learning **
ai devops docker kubernetes-deployment llmops mlops model-monitoring modeldeployment production-code production-deployment
3
arthur-ai / arthur-sandbox
Example projects for Arthur Model Monitoring Platform
ai-explainability ai-monitoring ai-observability ml-monitoring ml-observability model-explainability model-monitoring model-performance-management
Language:Jupyter Notebook 3
newron-sdk
NewronAI / newron-sdk
Newron is a data-centric ML platform to easily build, manage, deploy and continuously improve models through data driven development.
deep-learning machine-learning mlops data-science data-versioning experiment-tracking hyperparameter-optimization hyperparameter-search hyperparameter-tuning keras ml-platform model-monitoring model-reproducibility model-versioning pytorch tensorflow model-registry python3
Language:Python 3
silverstone1903 / reco-model-monitoring
fastapi + prometheus + grafana 💣
mlops prometheus-grafana model-monitoring monitoring recommender-systems docker-compose fastapi docker
Language:Python 3
aimlnerd / database-visualizer-tool
Demonstrate how to use graphana to easily create dashboard from data in postgres without redeveloping dashboard UI using angular/react etc. Example use case is machine learning model monitoring
data-science data-visualization graphana postgresql visualization machine-learning mlops model-monitoring machine-learning-monitoring
2
vathymut / dsos
Dataset shift with outlier scores
r model-validation machine-learning data-validation statistical-tests mlops performance-monitoring dataset-shifts drift-detection statistical-process-control data-drift model-monitoring
Language:R 2
ashkan-mokarian / mlops-zoomcamp
Notes, homeworks, and projects for MLOps Zoomcamp @ datatalks.club
learning mlops model-deployment model-monitoring workflow-orchestration
Language:Jupyter Notebook 1

model-monitoring

DataTalksClub / mlops-zoomcamp

evidentlyai / evidently

deepchecks / deepchecks

Giskard-AI / giskard

Arize-ai / phoenix

NannyML / nannyml

traceloop / openllmetry

traceloop / openllmetry-js

MAIF / eurybia

squaredev-io / whitebox

NimbleBoxAI / nbox

aws-samples / amazon-sagemaker-mlops-workshop

aporia-ai / inferencedb

VectorInstitute / cyclops

evidentlyai / ml_observability_course

rstudio / vetiver-python

awesome-mlops / awesome-ml-monitoring

Arize-ai / client_python

jomariya23156 / full-stack-on-prem-cv-mlops

prabhuomkar / bitbeast

katonic-dev / explainit

JakobLS / mlops-credit-risk

OLAMIDE100 / Capstone-Project-Mlops-ZoomCamp

basirati / model_monitoring

fiddler-labs / fiddler-examples

Ezzaldin97 / Batch-Serving-ML-Pipeline

Arize-ai / client_java

cmigpereira / mlops-zoomcamp-project

awesome-mlops / awesome-mlops-kubernetes

aditikhare007 / Building-Production-Grade-LLMs

arthur-ai / arthur-sandbox

NewronAI / newron-sdk

silverstone1903 / reco-model-monitoring

aimlnerd / database-visualizer-tool

vathymut / dsos

ashkan-mokarian / mlops-zoomcamp