mlops

There are 410 repositories under mlops topic.

Made-With-ML
GokuMohandas / Made-With-ML
Learn how to design, develop, deploy and iterate on production-grade ML applications.
data-engineering data-quality data-science deep-learning distributed-ml distributed-training llms machine-learning mlops natural-language-processing python pytorch ray
Language:Jupyter Notebook 44307
airflow
apache / airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
airflow apache apache-airflow automation dag data-engineering data-integration data-orchestrator data-pipelines data-science elt etl machine-learning mlops orchestration python scheduler workflow workflow-engine workflow-orchestration
Language:Python 43165
qdrant
qdrant / qdrant
Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
neural-network search-engine knn-algorithm hnsw vector-search nearest-neighbor-search image-search embeddings-similarity recommender-system vector-search-engine mlops search-engines neural-search similarity-search vector-database machine-learning search ai-search ai-search-engine
Language:Rust 27037
label-studio
HumanSignal / label-studio
Label Studio is a multi-type data labeling and annotation tool with standardized output format
computer-vision deep-learning image-annotation annotation-tool annotation labeling labeling-tool image-labeling image-labelling-tool boundingbox image-classification annotations semantic-segmentation dataset datasets label-studio data-labeling text-annotation yolo mlops
Language:JavaScript 25391
mlflow
mlflow / mlflow
The open source developer platform to build AI agents and models with confidence. Enhance your AI applications with end-to-end tracking, observability, and evaluations, all in one integrated platform.
agentops agents ai ai-governance apache-spark evaluation langchain llm-evaluation llmops machine-learning ml mlflow mlops model-management observability open-source openai prompt-engineering
Language:Python 22911
serve
jina-ai / serve
☁️ Build multimodal AI applications with cloud-native stack
neural-search cloud-native deep-learning machine-learning framework grpc kubernetes multimodal mlops pipeline fastapi generative-ai docker jaeger llmops opentelemetry cncf microservice orchestration prometheus
Language:Python 21781
EthicalML / awesome-production-machine-learning
A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
machine-learning mlops interpretability explainability responsible-ai deep-learning machine-learning-operations ml-ops ml-operations privacy-preserving privacy-preserving-ml privacy-preserving-machine-learning data-mining large-scale-ml production-ml large-scale-machine-learning production-machine-learning awesome awesome-list
19593
taipy
Avaiga / taipy
Turns Data and AI algorithms into production-ready web applications in no time.
automation data-engineering data-ops data-visualization datascience developer-tools mlops orchestration pipeline pipelines python taipy-gui workflow taipy-core hacktoberfest hacktoberfest2023 data-integration job-scheduler scenario scenario-analysis
Language:Python 18866
argoproj / argo-workflows
Workflow Engine for Kubernetes
workflow kubernetes argo dag knative airflow machine-learning argo-workflows workflow-engine hacktoberfest cloud-native cncf k8s gitops mlops batch-processing data-engineering pipelines
Language:Go 16176
stas00 / ml-engineering
Machine Learning Engineering Open Book
ai debugging gpus inference large-language-models llm machine-learning machine-learning-engineering mlops network pytorch scalability slurm storage training transformers
Language:Python 15697
weaviate
weaviate / weaviate
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database.
search-engine semantic-search semantic-search-engine vector-search vector-search-engine vector-database approximate-nearest-neighbor-search image-search hnsw information-retrieval mlops nearest-neighbor-search neural-search recommender-system similarity-search vectors generative-search hybrid-search weaviate grpc
Language:Go 15010
NirDiamant / agents-towards-production
This repository delivers end-to-end, code-first tutorials covering every layer of production-grade GenAI agents, guiding you from spark to scale with proven patterns and reusable blueprints for real-world launches.
agent agent-framework agents ai-agents genai generative-ai llm llms mlops multi-agent production tool-integration tutorials
Language:Jupyter Notebook 14830
dagster-io / dagster
An orchestration platform for the development, production, and observation of data assets.
analytics dagster data-engineering data-integration data-orchestrator data-pipelines data-science etl hacktoberfest metadata mlops orchestration python scheduler workflow workflow-automation
Language:Python 14388
nni
microsoft / nni
An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
automl deep-learning neural-architecture-search hyperparameter-optimization distributed bayesian-optimization automated-machine-learning machine-learning machine-learning-algorithms data-science tensorflow pytorch neural-network deep-neural-network model-compression feature-engineering nas python hyperparameter-tuning mlops
Language:Python 14291
mlops-zoomcamp
DataTalksClub / mlops-zoomcamp
Free MLOps course from DataTalks.Club
machine-learning mlops model-deployment model-monitoring workflow-orchestration
Language:Jupyter Notebook 13624
visenger / awesome-mlops
A curated list of references for MLOps
ai data-science devops engineering federated-learning machine-learning ml mlops software-engineering
13423
bentoml / OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
bentoml fine-tuning llama llama2 llama3-1 llama3-2 llama3-2-vision llm llm-inference llm-ops llm-serving llmops mistral mlops model-inference open-source-llm openllm vicuna
Language:Python 11928
great-expectations / great_expectations
Always know what to expect from your data.
pipeline-tests dataquality datacleaning datacleaner data-science data-profiling pipeline pipeline-testing cleandata dataunittest data-unit-tests eda exploratory-data-analysis exploratory-analysis exploratorydataanalysis data-quality data-engineering pipeline-debt data-profilers mlops
Language:Python 10913
aws / amazon-sagemaker-examples
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
sagemaker aws reinforcement-learning machine-learning deep-learning examples jupyter-notebook mlops data-science training inference
Language:Jupyter Notebook 10803
kedro
kedro-org / kedro
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
pipeline kedro hacktoberfest mlops experiment-tracking python machine-learning machine-learning-engineering
Language:Python 10629
wandb
wandb / wandb
The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.
machine-learning experiment-track deep-learning keras tensorflow pytorch hyperparameter-search reinforcement-learning mlops data-science collaboration hyperparameter-optimization reproducibility hyperparameter-tuning data-versioning model-versioning ml-platform jax ai
Language:Python 10532
tensorzero
tensorzero / tensorzero
TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluation, and experimentation.
ai ai-engineering anthropic artificial-intelligence deep-learning genai generative-ai gpt large-language-models llama llm llmops llms machine-learning ml ml-engineering mlops openai python rust
Language:Rust 10525
chiphuyen / machine-learning-systems-design
A booklet on machine learning systems design with exercises. NOT the repo for the book "Designing Machine Learning Systems", which is `dmls-book`
data-science machine-learning-production mlops
Language:HTML 9619
metaflow
Netflix / metaflow
Build, Manage and Deploy AI/ML Systems
machine-learning model-management ai ml ml-platform ml-infrastructure python mlops datascience high-performance-computing kubernetes aws azure gcp llm llmops agents generative-ai cost-optimization distributed-training
Language:Python 9617
activeloopai / deeplake
Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
datasets deep-learning machine-learning data-science pytorch tensorflow python ai ml mlops computer-vision cv image-processing datalake langchain llm large-language-models vector-database vector-search multi-modal
Language:Python 8889
BentoML
bentoml / BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
model-serving mlops llmops generative-ai llm-inference model-inference-service inference-platform deep-learning llm-serving machine-learning python multimodal ml-engineering llm ai-inference
Language:Python 8191
microsoft / agent-lightning
The absolute trainer to light up AI agents.
agent agentic-ai llm mlops reinforcement-learning
Language:Python 7972
evidentlyai / evidently
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
data-drift jupyter-notebook pandas-dataframe machine-learning model-monitoring html-report mlops data-science hacktoberfest data-quality data-validation generative-ai llm llmops
Language:Jupyter Notebook 6806
flyte
flyteorg / flyte
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
flyte machine-learning golang scale workflow data-science data-analysis data kubernetes-operator kubernetes orchestration-engine mlops dataops grpc python production declarative fine-tuning llm hacktoberfest
Language:Go 6580
feast-dev / feast
The Open Source Feature Store for AI/ML
machine-learning features ml big-data feature-store python mlops data-engineering data-science data-quality
Language:Python 6472
clearml
clearml / clearml
ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
version-control experiment-manager version control experiment deeplearning deep-learning machine-learning machinelearning ai trains trainsai clearml k8s devops mlops
Language:Python 6354
SkalskiP / courses
This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)
computer-vision deep-learning deep-neural-networks machine-learning mlops multimodal transformers tutorial natural-language-processing nlp generative-model stable-diffusion
Language:Python 6227
aimhubio / aim
Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
python ai data-science data-visualization experiment-tracking machine-learning metadata metadata-tracking ml mlflow mlops pytorch tensorboard tensorflow visualization prompt-engineering
Language:Python 5857
lancedb / lance
Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
machine-learning computer-vision data-format deep-learning python apache-arrow duckdb mlops data-analysis data-analytics data-science dataops data-centric embeddings rust llms
Language:Rust 5674
tensorchord / Awesome-LLMOps
An awesome & curated list of best LLMOps tools for developers
ai-development-tools awesome-list llmops mlops
Language:Shell 5409
superduper
superduper-io / superduper
Superduper: End-to-end framework for building custom AI applications and agents.
ai chatbot data database distributed-ml inference llm-inference llm-serving llmops ml mlops mongodb pretrained-models python pytorch rag semantic-search torch transformers vector-search
Language:Python 5225