mlcommons / cm4mlops

A collection of portable, reusable and cross-platform automation recipes (CM scripts) with a human-friendly interface and minimal dependencies to make it easier to build, run, benchmark and optimize AI, ML and other applications and systems across diverse and continuously changing models, data sets, software and hardware (cloud/edge)

Home Page:http://docs.mlcommons.org/cm4mlops/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Unified and cross-platform CM interface for DevOps, MLOps and MLPerf

License Python Version Powered by CM. Downloads

This repository contains reusable and cross-platform automation recipes to run DevOps, MLOps, AIOps and MLPerf via a simple and human-readable Collective Mind interface (CM) while adapting to different opearting systems, software and hardware.

All СM scripts have a simple Python API, extensible JSON/YAML meta description and unifed input/output to make them reusable in different projects either individually or by chaining them together into portable automation workflows, applications and web services adaptable to continuously changing models, data sets, software and hardware.

These automation recipes are being developed and maintained by the MLCommons Task Force on Automation and Reproducibility with great contributions from the community.

License

Apache 2.0

Citing this project

Please use this BibTeX file.

Catalog

See the automatically generated catalog online.

Tests

CM script automation test CM script automation features test MLPerf loadgen with HuggingFace bert onnx fp32 squad model MLPerf inference MLCommons C++ ResNet50 image classification with ONNX

Acknowledgments

This open-source technology is being developed by the MLCommons Task Force on Automation and Reproducibility as a community effort based on user feedback.

We would like to thank all volunteers, collaborators and contributors for their support, fruitful discussions, and useful feedback!

We thank cKnowledge.org, cTuning foundation and MLCommons for sponsoring this project!

About

A collection of portable, reusable and cross-platform automation recipes (CM scripts) with a human-friendly interface and minimal dependencies to make it easier to build, run, benchmark and optimize AI, ML and other applications and systems across diverse and continuously changing models, data sets, software and hardware (cloud/edge)

http://docs.mlcommons.org/cm4mlops/

License:Apache License 2.0


Languages

Language:Python 72.3%Language:Shell 9.2%Language:C++ 8.2%Language:Dockerfile 4.5%Language:C 3.3%Language:Batchfile 2.1%Language:HCL 0.2%Language:Cuda 0.1%Language:Java 0.1%