ml-infrastructure

There are 8 repositories under ml-infrastructure topic.

metaflow
Netflix / metaflow
Build, Manage and Deploy AI/ML Systems
agents ai aws azure data-science datascience gcp generative-ai high-performance-computing kubernetes llm llmops machine-learning ml ml-infrastructure ml-platform mlops model-management python
Language:Python 9468
skypilot-org / skypilot
Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 17+ clouds, or on-prem).
cloud-computing data-science deep-learning gpu hyperparameter-tuning machine-learning tpu job-queue job-scheduler cloud-management distributed-training ml-infrastructure multicloud spot-instances ml-platform cost-management cost-optimization finops llm-serving llm-training
Language:Python 8717
determined
determined-ai / determined
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
deep-learning machine-learning ml-platform ml-infrastructure hyperparameter-optimization hyperparameter-search distributed-training pytorch tensorflow hyperparameter-tuning kubernetes data-science mlops keras
Language:Go 3187
mryab / efficient-dl-systems
Efficient Deep Learning Systems course materials (HSE, YSDA)
deep-learning efficient-deep-learning pytorch cuda distributed-training machine-learning ml-infrastructure mlops
Language:Jupyter Notebook 895
RunLLM / aqueduct
Aqueduct is no longer being maintained. Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure.
data-science machine-learning ml-infrastructure ai data ml ml-monitoring python python3 mlops orchestration llm llms kubernetes
Language:Go 520
Netflix / metaflow-service
:rocket: Metadata tracking and UI service for Metaflow!
machine-learning ai ml ml-infrastructure data-science productivity ml-platform ui metaflow
Language:Python 211
machine-learning-apps / actions-ml-cicd
A Collection of GitHub Actions That Facilitate MLOps
machine-learning ml-ops data-science devops ml-infrastructure mlops argo kubernetes machine-learning-platform
Language:Jupyter Notebook 207
hamelsmu / ktext
Utilities for preprocessing text for deep learning with Keras
machine-learning keras ml-infrastructure nlp-machine-learning python-3 deep-learning
Language:Jupyter Notebook 180
mlinfra
mlinfra-io / mlinfra
deploy ML Infrastructure and MLOps tooling anywhere quickly and with best practices with a single command
mlops platform-engineering distributed-ml python software-engineering ml-infrastructure
Language:Python 110
Project-MONAI / monai-deploy-app-sdk
MONAI Deploy App SDK offers a framework and associated tools to design, develop and verify AI-driven applications in the healthcare imaging domain.
monai healthcare medical-imaging image-processing dicom deploy workflow pipeline ai ml deep-learning machine-learning model-deployment model-serving mlops ml-platform ml-infrastructure python pytorch
Language:Jupyter Notebook 108
slai-labs / get-beam
Run GPU inference and training jobs on serverless infrastructure that scales with you.
artificial-intelligence machine-learning python serverless cloud-computing cost-optimization data-science deep-learning distributed-computing gpu-acceleration gpu-computing hpc llm-serving llm-training ml-infrastructure mlops serverless-architectures
Language:Shell 102
NimbleBoxAI / nbox
The official python package for NimbleBox. Exposes all APIs as CLIs and contains modules to make ML 🌸
data-science machine-learning ml-infrastructure ml-platform ml-service mlops mlops-pipeline mlops-workflow model-deployment model-management model-monitoring model-serving practical-mlops mlops-automation mlops-tool
Language:Python 87
RubixML / Server
A standalone inference server for trained Rubix ML estimators.
machine-learning http-server model-server infrastructure api model-deployment microservice json-api php rest-api rubix-ml inference inference-engine php-ml ml-infrastructure php-machine-learning inference-server rubix-server
Language:PHP 62
velda-io / velda
Run GPU or batch jobs directly from your dev environment
cloud-computing cloud-management job-scheduler ml-infrastructure ml-platform workflow
Language:Go 57
determined-ai / determined-examples
Example ML projects that use the Determined library.
deep-learning distributed-training hyperparameter-tuning keras machine-learning ml-infrastructure pytorch tensorflow
Language:Python 32
kubeflow / blog
Kubeflow blog based on fastpages
kubeflow blog data-science machine-learning fastpages kubernetes kubeflow-community ml-infrastructure
Language:Jupyter Notebook 32
fuzzylabs / vertex-edge
A tool for training models to Vertex on Google Cloud Platform.
machine-learning deep-learning google-cloud-platform mlops ai gcp ml-infrastructure vertex-edge
Language:Python 31
metaflow-card-notebook
outerbounds / metaflow-card-notebook
Render Jupyter Notebooks With Metaflow Cards
metaflow metaflow-cards jupyter jupyter-notebook machine-learning mlops python ml visualization ml-infrastructure data-science data-visualization datascience
Language:Python 31
rflow
otaviog / rflow
RFlow - A workflow framework for agile machine learning
machine-learning workflow data-science ml ml-infrastructure ml-pipeline python productivity
Language:Python 17
openlayer-ai / openlayer-python
The official Python library for Openlayer, the Continuous Model Improvement Platform for AI. 📈
ai data-centric machine-learning machine-learning-operations ml ml-infrastructure mlops model-deployment model-explainability synthetic-dataset-generation tensorflow unbox openlayer
Language:Python 15
redbco / infermesh
GPU-aware inference mesh for large-scale AI serving
ai-inference ai-infrastructure distributed-systems fault-tolerance gpu-inference high-availability inference-engine ml-infrastructure model-serving observability rust service-mesh gpu-mesh
Language:Rust 8
dao-duc-tung / sagemaker-ml-system
A SageMaker-based ML system solution
sagemaker mlops ml-infrastructure ml-platform ml-system
Language:Jupyter Notebook 7
arindas / tfug-ml-mq-infer
Transcript and slides for the talk "Message Queues: Function and role in ML Inference" on 18th June 2023 at TFUG Kolkata
inference message-queue ml-infrastructure
5
gershonc / mlflow_showcase
Showcase of MLflow capabilities
ml ai mlflow tracking-algorithm ml-infrastructure ml-engineering ml-pipeline model-deployment model-development model-testing
Language:Jupyter Notebook 3
Propheto-io / propheto
Main python package for deploying and managing machine learning models in production
ai ml mlops data-science python productivity machine-learning mlops-workflow ml-infrastructure
Language:Python 3
fastmachinelearning / gw-iaas
Deep learning inference-as-a-service tools and pipelines for gravitational wave physics
deep-learning inference gravitational-waves ml-infrastructure
Language:Python 2
yennanliu / HousePricePredAPI
ML api predict house price wrapped in Docker and deployed to AWS ECS/Fargate | #DE |#ML
machine-learning ml api ml-infrastructure ml-pipeline python flask flask-api scikit-learn aws docker ecs ecr fargate
Language:Python 2
AxelGard / grazing-cira
Cira set in production
algorithmic-trading cira hosting ml-infrastructure ml-pipeline
Language:Python 1
anastasiamkh / aws-dataflow-simulator
Python package that simplifies the creation of AWS infrastructure for simulating real-time data streaming and batch processing, ideal for integrating into machine learning projects.
aws data-engineering-infrastructure data-engineering-pipeline data-science-projects infrastructure-as-code ml-engineering ml-infrastructure ml-project-template
Language:Python 0
decenter-ai.streamlit.app
DeCenter-AI / decenter-ai.streamlit.app
Decenteralized AI training platform for all
ai-infra decenter-ai infrastructure infrastructure-services ml-infrastructure decenter decentralized prototyping blockchain mlops off-chain-compute on-chain-compute
Language:Python 0
ai-enhanced-engineer / ml-production-service
Reference implementation for deploying ML models from notebooks to production
ai-engineering artifical-intelligence machine-learning machine-learning-production ml-engineering ml-infrastructure ml-production production-code production-ready
Language:Python
NANDHARAJ5 / ai-access
🤖 Access various AI models effortlessly with this unified PHP library, streamlining development through a consistent API and easy provider switching.
chatgpt claude cloud-computing cloud-management data-science deep-learning gpu information-retrieval job-queue machine-learning ml-infrastructure ml-platform nextjs rag shadowsocks tpu v2ray vpn
Language:PHP
st00mp / cloud-broker
🔮 Cloud Broker is a web application that aggregates and displays GPU offers from different cloud providers (currently only AWS) to facilitate finding the best options for training artificial intelligence models. The application allows filtering offers by GPU type, provider, region, and price.
ai-training cloud-computing cost-optimization developer-tools gpu infrastructure-monitoring ml-infrastructure preemptible spot-instances
Language:TypeScript

ml-infrastructure

Netflix / metaflow

skypilot-org / skypilot

determined-ai / determined

mryab / efficient-dl-systems

RunLLM / aqueduct

Netflix / metaflow-service

machine-learning-apps / actions-ml-cicd

hamelsmu / ktext

mlinfra-io / mlinfra

Project-MONAI / monai-deploy-app-sdk

slai-labs / get-beam

NimbleBoxAI / nbox

RubixML / Server

velda-io / velda

determined-ai / determined-examples

kubeflow / blog

fuzzylabs / vertex-edge

outerbounds / metaflow-card-notebook

otaviog / rflow

openlayer-ai / openlayer-python

redbco / infermesh

dao-duc-tung / sagemaker-ml-system

arindas / tfug-ml-mq-infer

gershonc / mlflow_showcase

Propheto-io / propheto

fastmachinelearning / gw-iaas

yennanliu / HousePricePredAPI

AxelGard / grazing-cira

anastasiamkh / aws-dataflow-simulator

DeCenter-AI / decenter-ai.streamlit.app

ai-enhanced-engineer / ml-production-service

NANDHARAJ5 / ai-access

st00mp / cloud-broker