mlops

There are 286 repositories under mlops topic.

Made-With-ML
GokuMohandas / Made-With-ML
Learn how to responsibly develop, deploy and maintain production machine learning applications.
machine-learning deep-learning pytorch natural-language-processing data-science python mlops data-engineering data-quality
Language:Jupyter Notebook 33329
jina
jina-ai / jina
🔮 Build multimodal AI services via cloud native technologies
neural-search cloud-native deep-learning machine-learning framework vector-search-engine grpc kubernetes microservices semantic-search multimodal crossmodal creative-ai aiops mlops pipeline workflow airflow fastapi generative-ai
Language:Python 18499
EthicalML / awesome-production-machine-learning
A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
machine-learning mlops interpretability explainability responsible-ai deep-learning machine-learning-operations ml-ops ml-operations privacy-preserving privacy-preserving-ml privacy-preserving-machine-learning data-mining large-scale-ml production-ml large-scale-machine-learning production-machine-learning awesome awesome-list
13759
label-studio
heartexlabs / label-studio
Label Studio is a multi-type data labeling and annotation tool with standardized output format
computer-vision deep-learning image-annotation annotation-tool annotation labeling labeling-tool image-labeling image-labelling-tool boundingbox image-classification annotations semantic-segmentation dataset datasets label-studio data-labeling text-annotation yolo mlops
Language:Python 13209
nni
microsoft / nni
An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
automated-machine-learning automl bayesian-optimization data-science deep-learning deep-neural-network distributed feature-engineering hyperparameter-optimization hyperparameter-tuning machine-learning machine-learning-algorithms mlops model-compression nas neural-architecture-search neural-network python pytorch tensorflow
Language:Python 12967
qdrant
qdrant / qdrant
Qdrant - Vector Database for the next generation of AI applications. Also available in the cloud https://cloud.qdrant.io/
approximate-nearest-neighbor-search embeddings-similarity hnsw image-search knn-algorithm machine-learning matching mlops nearest-neighbor-search neural-network neural-search recommender-system search search-engine search-engines similarity-search vector-database vector-search vector-search-engine
Language:Rust 10853
visenger / awesome-mlops
A curated list of references for MLOps
machine-learning mlops data-science engineering federated-learning devops software-engineering ai ml
10230
aws / amazon-sagemaker-examples
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
sagemaker aws reinforcement-learning machine-learning deep-learning examples jupyter-notebook mlops data-science training inference
Language:Jupyter Notebook 8435
great-expectations / great_expectations
Always know what to expect from your data.
pipeline-tests dataquality datacleaning datacleaner data-science data-profiling pipeline pipeline-testing cleandata dataunittest data-unit-tests eda exploratory-data-analysis exploratory-analysis exploratorydataanalysis data-quality data-engineering pipeline-debt data-profilers mlops
Language:Python 8425
kedro
kedro-org / kedro
A Python framework for creating reproducible, maintainable and modular data science code.
pipeline kedro hacktoberfest mlops experiment-tracking python machine-learning
Language:Python 8409
chiphuyen / machine-learning-systems-design
A booklet on machine learning systems design with exercises. NOT the repo for the book "Designing Machine Learning Systems"
data-science machine-learning-production mlops
Language:HTML 7910
dagster-io / dagster
An orchestration platform for the development, production, and observation of data assets.
data-pipelines dagster workflow data-science workflow-automation python scheduler data-orchestrator etl analytics data-engineering mlops orchestration data-integration metadata
Language:Python 7583
mlops-zoomcamp
DataTalksClub / mlops-zoomcamp
Free MLOps course from DataTalks.Club
machine-learning mlops model-deployment model-monitoring workflow-orchestration
Language:Jupyter Notebook 7130
metaflow
Netflix / metaflow
:rocket: Build and manage real-life data science projects with ease!
machine-learning data-science productivity model-management ai ml ml-platform ml-infrastructure python r rstats reproducible-research r-package mlops datascience high-performance-computing kubernetes aws azure gcp
Language:Python 6691
weaviate
weaviate / weaviate
Weaviate is an open source vector database that stores both objects and vectors, allowing for combining vector search with structured filtering with the fault-tolerance and scalability of a cloud-native database, all accessible through GraphQL, REST, and various language clients.
search-engine semantic-search semantic-search-engine vector-search vector-search-engine vector-database approximate-nearest-neighbor-search image-search hnsw information-retrieval mlops nearest-neighbor-search neural-search recommender-system similarity-search vectors generative-search hybrid-search weaviate graphql
Language:Go 6284
wandb
wandb / wandb
🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.
machine-learning experiment-track deep-learning keras tensorflow pytorch hyperparameter-search reinforcement-learning mlops data-science collaboration hyperparameter-optimization reproducibility hyperparameter-tuning data-versioning model-versioning ml-platform
Language:Python 6149
activeloopai / deeplake
Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
datasets deep-learning machine-learning data-science pytorch tensorflow data-version-control python ai ml mlops computer-vision cv image-processing datalake langchain llm large-language-models vector-database vector-search
Language:Python 6076
BentoML
bentoml / BentoML
Unified Model Serving Framework 🍱
ai aws-sagemaker bentoml deep-learning generative-ai inference-server kubernetes llmops lmops machine-learning microservices ml-infrastructure ml-platform mlops model-deployment model-management model-serving
Language:Python 4974
clearml
allegroai / clearml
ClearML - Auto-Magical CI/CD to streamline your ML workflow. Experiment Manager, MLOps and Data-Management
version-control experiment-manager version control experiment deeplearning deep-learning machine-learning machinelearning ai trains trainsai clearml k8s devops mlops
Language:Python 4448
feast-dev / feast
Feature Store for Machine Learning
big-data data-engineering data-quality data-science feature-store features machine-learning ml mlops python
Language:Python 4354
aimhubio / aim
Aim 💫 — An easy-to-use & supercharged open-source AI metadata tracker (experiment tracking, AI agents tracing)
python ai data-science data-visualization experiment-tracking machine-learning metadata metadata-tracking ml mlflow mlops pytorch tensorboard tensorflow visualization prompt-engineering
Language:Python 3761
SeldonIO / seldon-core
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
aiops deployment kubernetes machine-learning machine-learning-operations mlops production-machine-learning serving
Language:HTML 3748
pytorch / serve
Serve, optimize and scale PyTorch models in production
pytorch machine-learning mlops serving docker kubernetes optimization cpu gpu metrics deep-learning
Language:Java 3488
evidentlyai / evidently
Evaluate and monitor ML models from validation to production. Join our Discord: https://discord.com/invite/xZjKRaNp8b
data-drift jupyter-notebook pandas-dataframe machine-learning model-monitoring html-report production-machine-learning machine-learning-operations mlops data-science hacktoberfest
Language:Python 3480
flyte
flyteorg / flyte
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
flyte machine-learning golang scale workflow data-science data-analysis data kubernetes-operator kubernetes orchestration-engine mlops dataops grpc python production production-grade declarative
Language:Python 3436
polyaxon / polyaxon
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
deep-learning machine-learning artificial-intelligence data-science reinforcement-learning kubernetes tensorflow pytorch keras mxnet caffe ml k8s jupyter notebook jupyterlab pipelines workflow mlops hyperparameter-optimization
3323
kubeflow / pipelines
Machine Learning Pipelines for Kubeflow
kubeflow-pipelines mlops kubeflow machine-learning kubernetes pipeline data-science
Language:Python 3200
ploomber / ploomber
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
workflow machine-learning data-science data-engineering mlops papermill jupyter jupyter-notebooks pipelines vscode pycharm notebooks
Language:Python 3084
postgresml / postgresml
PostgresML is an AI application database. Download open source models from Huggingface, or train your own, to create and index LLM embeddings, generate text, or make online predictions using only SQL.
machine-learning ml mlops postgresql rust
Language:Rust 3060
zenml
zenml-io / zenml
ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
ai automl data-science deep-learning devops-tools hacktobe hacktoberfest machine-learning metadata-tracking ml mlops pipelines production-ready pytorch tensorflow workflow zenml
Language:Python 2887
FedML-AI / FedML
FedML - The federated learning and analytics library enabling secure and collaborative machine learning on decentralized data anywhere at any scale. Supporting large-scale cross-silo federated learning, cross-device federated learning on smartphones/IoTs, and research simulation. MLOps and App Marketplace are also enabled (https://open.fedml.ai).
federated-learning deep-learning distributed-training blockchain edge-ai machine-learning on-device-training inference-engine marketplace mlops privacy security
Language:Python 2871
SkalskiP / courses
This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)
computer-vision deep-learning deep-neural-networks machine-learning mlops multimodal transformers tutorial natural-language-processing nlp generative-model stable-diffusion
Language:Python 2824
deepchecks / deepchecks
Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
machine-learning ml model-validation data-validation mlops data-science python jupyter-notebook model-monitoring data-drift html-report deep-learning pytorch pandas-dataframe
Language:Python 2703
ashleve / lightning-hydra-template
PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡
pytorch-lightning project-structure config deep-learning hydra template pytorch reproducibility best-practices mlops
Language:Python 2692
God-Level-Data-Science-ML-Full-Stack
hemansnation / God-Level-Data-Science-ML-Full-Stack
A collection of scientific methods, processes, algorithms, and systems to build stories & models. This roadmap contains 16 Chapters, whether you are a fresher in the field or an experienced professional who wants to transition into Data Science & AI
python datastructures numpy pandas matplotlib scikit-learn machine-learning deep-learning pytorch data-science computer-vision data-structures-and-algorithms data-visualization mlops natural-language-processing statistics tableau data-engineering data-system-design
Language:Jupyter Notebook 2625
kelvins / awesome-mlops
:sunglasses: A curated list of awesome MLOps tools
awesome machine-learning machine-learning-engineering mle mlops data-science ml ai
Language:Python 2460