mlops

There are 380 repositories under mlops topic.

vllm-project / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
amd cuda deepseek gpt hpu inference inferentia llama llm llm-serving llmops mlops model-serving pytorch qwen rocm tpu trainium transformer xpu
Language:Python 43381
airflow
apache / airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
airflow apache apache-airflow python scheduler workflow automation dag data-engineering data-integration data-orchestrator data-pipelines data-science elt etl machine-learning mlops orchestration workflow-engine workflow-orchestration
Language:Python 39450
Made-With-ML
GokuMohandas / Made-With-ML
Learn how to design, develop, deploy and iterate on production-grade ML applications.
data-engineering data-quality data-science deep-learning distributed-ml distributed-training llms machine-learning mlops natural-language-processing python pytorch ray
Language:Jupyter Notebook 38355
qdrant
qdrant / qdrant
Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
neural-network search-engine knn-algorithm hnsw vector-search nearest-neighbor-search image-search embeddings-similarity recommender-system vector-search-engine mlops search-engines neural-search similarity-search vector-database machine-learning search ai-search ai-search-engine
Language:Rust 22827
serve
jina-ai / serve
☁️ Build multimodal AI applications with cloud-native stack
neural-search cloud-native deep-learning machine-learning framework grpc kubernetes multimodal mlops pipeline fastapi generative-ai docker jaeger llmops opentelemetry cncf microservice orchestration prometheus
Language:Python 21492
label-studio
HumanSignal / label-studio
Label Studio is a multi-type data labeling and annotation tool with standardized output format
annotation annotation-tool annotations boundingbox computer-vision data-labeling dataset datasets deep-learning image-annotation image-classification image-labeling image-labelling-tool label-studio labeling labeling-tool mlops semantic-segmentation text-annotation yolo
Language:JavaScript 21423
EthicalML / awesome-production-machine-learning
A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
awesome awesome-list data-mining deep-learning explainability interpretability large-scale-machine-learning large-scale-ml machine-learning machine-learning-operations ml-operations ml-ops mlops privacy-preserving privacy-preserving-machine-learning privacy-preserving-ml production-machine-learning production-ml responsible-ai
18283
taipy
Avaiga / taipy
Turns Data and AI algorithms into production-ready web applications in no time.
automation data-engineering data-ops data-visualization datascience developer-tools mlops orchestration pipeline pipelines python taipy-gui workflow taipy-core hacktoberfest hacktoberfest2023 data-integration job-scheduler scenario scenario-analysis
Language:Python 17937
argoproj / argo-workflows
Workflow Engine for Kubernetes
workflow kubernetes argo dag knative airflow machine-learning argo-workflows workflow-engine hacktoberfest cloud-native cncf k8s gitops mlops batch-processing data-engineering pipelines
Language:Go 15503
nni
microsoft / nni
An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
automated-machine-learning automl bayesian-optimization data-science deep-learning deep-neural-network distributed feature-engineering hyperparameter-optimization hyperparameter-tuning machine-learning machine-learning-algorithms mlops model-compression nas neural-architecture-search neural-network python pytorch tensorflow
Language:Python 14160
stas00 / ml-engineering
Machine Learning Engineering Open Book
ai inference large-language-models llm machine-learning machine-learning-engineering mlops pytorch scalability slurm training transformers
Language:Python 13297
visenger / awesome-mlops
A curated list of references for MLOps
machine-learning mlops data-science engineering federated-learning devops software-engineering ai ml
13012
weaviate
weaviate / weaviate
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database.
search-engine semantic-search semantic-search-engine vector-search vector-search-engine vector-database approximate-nearest-neighbor-search image-search hnsw information-retrieval mlops nearest-neighbor-search neural-search recommender-system similarity-search vectors generative-search hybrid-search weaviate grpc
Language:Go 12979
dagster-io / dagster
An orchestration platform for the development, production, and observation of data assets.
data-pipelines dagster workflow data-science workflow-automation python scheduler data-orchestrator etl analytics data-engineering mlops orchestration data-integration metadata
Language:Python 12836
mlops-zoomcamp
DataTalksClub / mlops-zoomcamp
Free MLOps course from DataTalks.Club
machine-learning mlops model-deployment model-monitoring workflow-orchestration
Language:Jupyter Notebook 11713
bentoml / OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
bentoml fine-tuning llama llama2 llama3-1 llama3-2 llama3-2-vision llm llm-inference llm-ops llm-serving llmops mistral mlops model-inference open-source-llm openllm vicuna
Language:Python 11069
aws / amazon-sagemaker-examples
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
sagemaker aws reinforcement-learning machine-learning deep-learning examples jupyter-notebook mlops data-science training inference
Language:Jupyter Notebook 10378
great-expectations / great_expectations
Always know what to expect from your data.
pipeline-tests dataquality datacleaning datacleaner data-science data-profiling pipeline pipeline-testing cleandata dataunittest data-unit-tests eda exploratory-data-analysis exploratory-analysis exploratorydataanalysis data-quality data-engineering pipeline-debt data-profilers mlops
Language:Python 10301
kedro
kedro-org / kedro
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
pipeline kedro hacktoberfest mlops experiment-tracking python machine-learning machine-learning-engineering
Language:Python 10246
wandb
wandb / wandb
The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.
machine-learning experiment-track deep-learning keras tensorflow pytorch hyperparameter-search reinforcement-learning mlops data-science collaboration hyperparameter-optimization reproducibility hyperparameter-tuning data-versioning model-versioning ml-platform jax ai
Language:Python 9698
chiphuyen / machine-learning-systems-design
A booklet on machine learning systems design with exercises. NOT the repo for the book "Designing Machine Learning Systems"
data-science machine-learning-production mlops
Language:HTML 9370
metaflow
Netflix / metaflow
Build, Manage and Deploy AI/ML Systems
machine-learning data-science productivity model-management ai ml ml-platform ml-infrastructure python r r-package mlops datascience high-performance-computing kubernetes aws azure gcp llm llmops
Language:Python 8690
activeloopai / deeplake
Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
datasets deep-learning machine-learning data-science pytorch tensorflow python ai ml mlops computer-vision cv image-processing datalake langchain llm large-language-models vector-database vector-search multi-modal
Language:Python 8506
BentoML
bentoml / BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
model-serving mlops llmops generative-ai llm-inference model-inference-service inference-platform deep-learning llm-serving machine-learning python multimodal ml-engineering llm ai-inference
Language:Python 7563
flyte
flyteorg / flyte
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
data data-analysis data-science dataops declarative fine-tuning flyte golang grpc hacktoberfest kubernetes kubernetes-operator llm machine-learning mlops orchestration-engine production python scale workflow
Language:Go 6151
evidentlyai / evidently
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
data-drift jupyter-notebook pandas-dataframe machine-learning model-monitoring html-report mlops data-science hacktoberfest data-quality data-validation generative-ai llm llmops
Language:Jupyter Notebook 5959
SkalskiP / courses
This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)
computer-vision deep-learning deep-neural-networks machine-learning mlops multimodal transformers tutorial natural-language-processing nlp generative-model stable-diffusion
Language:Python 5944
clearml
clearml / clearml
ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
version-control experiment-manager version control experiment deeplearning deep-learning machine-learning machinelearning ai trains trainsai clearml k8s devops mlops
Language:Python 5916
feast-dev / feast
The Open Source Feature Store for AI/ML
big-data data-engineering data-quality data-science feature-store features machine-learning ml mlops python
Language:Python 5901
aimhubio / aim
Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
python ai data-science data-visualization experiment-tracking machine-learning metadata metadata-tracking ml mlflow mlops pytorch tensorboard tensorflow visualization prompt-engineering
Language:Python 5470
superduper
superduper-io / superduper
Superduper: End-to-end framework for building custom AI applications and agents.
ai mlops torch transformers mongodb python pytorch ml database data inference distributed-ml llm-inference pretrained-models chatbot semantic-search llm-serving llmops vector-search rag
Language:Python 5021
tensorchord / Awesome-LLMOps
An awesome & curated list of best LLMOps tools for developers
ai-development-tools awesome-list llmops mlops
Language:Shell 4669
ashleve / lightning-hydra-template
PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡
best-practices config deep-learning hydra mlops project-structure pytorch pytorch-lightning reproducibility template
Language:Python 4566
zenml
zenml-io / zenml
ZenML 🙏: The bridge between ML and Ops. https://zenml.io.
ai automl data-science deep-learning devops-tools hacktoberfest llm llmops machine-learning metadata-tracking ml mlops pipelines production-ready pytorch tensorflow workflow zenml
Language:Python 4499
SeldonIO / seldon-core
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
kubernetes machine-learning deployment serving mlops aiops machine-learning-operations production-machine-learning
Language:HTML 4497
giskard
Giskard-AI / giskard
🐢 Open-Source Evaluation & Testing for AI & LLM systems
agent-evaluation ai-red-team ai-security ai-testing fairness-ai llm llm-eval llm-evaluation llm-security llmops ml-testing ml-validation mlops rag-evaluation red-team-tools responsible-ai trustworthy-ai
Language:Python 4434