bentoml

There are 4 repositories under bentoml topic.

bentoml / OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
bentoml fine-tuning llama llama2 llama3-1 llama3-2 llama3-2-vision llm llm-inference llm-ops llm-serving llmops mistral mlops model-inference open-source-llm openllm vicuna
Language:Python 10950
bentoml / Yatai
Model Deployment at Scale on Kubernetes 🦄️
bentoml kubernetes mlops model-deployment model-serving k8s machine-learning
Language:TypeScript 797
aarnphm / whispercpp
Pybind11 bindings for Whisper.cpp
audio-transcription bazel bentoml mlops-workflow nix pybind11 python3 whisper whisper-cpp
Language:C++ 328
Pythondeveloper6 / Awesome-MLOPS
All the available resources to master MLOPS from scratch
aws-sagemaker azure-ml dagshub dvc git kubeflow mlflow zenml automl pycaret bentoml docker fastapi mlops gradio shape streamlit django
290
bentoml / gallery
BentoML Example Projects 🎨
machine-learning machine-learning-library model-serving model-management model-deployment aws-sagemaker serverless aws-lambda gcp-cloud-functions azure-machine-learning data-science machine-learning-workflow gallery bentoml
138
yuqwu / Replace-Anything
A simple web application that lets you replace any part of an image with an image generated based on your description.
ai bentoml huggingface-diffusers inpainting python segment-anything stable-diffusion
Language:Python 116
Serving-Machine-Learning-Models
Nneji123 / Serving-Machine-Learning-Models
This repository contains instructions, template source code and examples on how to serve/deploy machine learning models using various frameworks and applications such as Docker, Flask, FastAPI, BentoML, Streamlit, MLflow and even code on how to deploy your machine learning model as an android app.
docker machine-learning actions bentoml css deployment dvc fastapi flask heroku heroku-deployment html5 kivymd mlflow mlops streamlit webapp
Language:CSS 53
dtemir / fellowship-prediction
Analyzes your GitHub Profile and presents you with a report on how likely you are to become the next MLH Fellow!
bentoml firebase flask heroku python react
Language:Jupyter Notebook 49
audiolizr
ahmedbesbes / audiolizr
A bentoML-powered API to transcribe audio and make sense of it
bentoml bentoml-service docker nlp openai openai-whisper pytube speech-recognition t5 torch transformers
Language:Python 39
swiss-ai-center / a-guide-to-mlops
A simple yet complete guide to MLOps tools and practices - from a conventional way to a modern approach of working with ML projects.
best-practices ml mlops bentoml cml dvc
Language:Dockerfile 31
MLZoomcamp2022
MemoonaTahira / MLZoomcamp2022
My repo for the Machine Learning Engineering bootcamp 2022 by DataTalks.Club
bentoml deep-learning deployment docker machine-learning machine-learning-engineering python aws-ec2 aws-fargate aws-lambda kserve kubernetes tensorflow-serving tflite
Language:Jupyter Notebook 21
jerife / MLOps-on-kubernetes
MLOps Implementing "Brain Computer Interface" on Kubernetes
brain-computer-interface machine-learning mlops model-serving signal-processing gcp google-kubernetes-engine bentoml gke google-cloud-platform grafana kubeflow kubeflow-pipelines kubernetes mlflow prometheus wandb weights-and-biases deep-learning
Language:Python 12
ttop32 / KoGPT2novel
Generate novel text - novel finetuned from skt KoGPT2 base v2 - 한국어
bentoml deployment docker fastai fine-tuning finetune generate-text gpt2 huggingface kogpt2 korean korean-nlp korean-text-processing kubernates kubernaut nlp okteto pytorch transformer web
Language:Jupyter Notebook 12
bentoml / diffusers-examples
API serving for your diffusers models
bentoml diffusers model-deployment model-serving
Language:Python 11
YeonwooSung / MLOps
Miscellaneous codes and writings for MLOps
ai ai-as-a-service aws llm llm-inference llm-ops ml-serving mlops multimodal bentoml triton-inference-server apache-iceberg data-intensive-applications docker kubernetes spark spark-nlp rag vector-database vectordb
Language:Jupyter Notebook 11
vaibhavsatpathy / psAI-clOps
End to End MLOps
mlops tensorflow2 bentoml mlflow neural-networks
Language:Python 10
getlegist / versailles
🏛 ML Inference Pipeline for Legist
bentoml huggingface machine-learning
Language:Python 9
cheat-tos / serving
DKT Project Served by Airflow / BentoML / Docker Swarm
deepknowledgetracing dkt airflow docker dockerswarm bentoml
Language:Python 8
bentoml / yatai-chart
Helm Chart for installing Yatai on Kubernetes ⎈
bentoml helm kubernetes mlops model-deployment yatai
Language:Mustache 7
dudeperf3ct / Model-Deployment
Deploying machine learning model using 10+ different deployment tools
bentoml fastapi kserve kubernetes mlops mlserver rayserve seldon serverless-framework
Language:Python 7
bentoml / plugins
the swish knife to all things bentoml.
bazel bentoml mlops nix
Language:Starlark 6
aliabbasjaffri / fashion-mnist-metaflow-bentoml-pipeline
A pipeline built on MetaFlow for training Fashion MNIST dataset using Pytorch, experiment tracking using MLFlow and model deployment using BentoML
pytorch fashionmnist metaflow bentoml mlflow
Language:Python 5
MLH-Fellowship / 0.1.2-sentiment-analysis-visualization
Machine Learning Web Application. Helps to visualize a character-by-character breakdown of how sentiment analysis classifies text
sentiment-analysis-visualization visualizations machine-learning machine-learning-algorithms keras keras-neural-networks lstm lstm-sentiment-analysis bentoml
Language:Python 4
MLH-Fellowship / Auto-Tagger
To automatically tag people in various chat groups
auto-tagging bentoml discord-bot named-entity-recognition
Language:Python 4
MLH-Fellowship / Flask-ML
Flask-ML grants any type of user (not only data scientist) an easy and compact UI Tool that supports BentoML to process images based on state-of-the-art machine learning approaches.
flask hackathon bentoml popen javascript jinja2-templates html5 bootstrap
Language:Python 4
raj-pulapakura / Image-Search-Engine
Upload an image and find similar images easily!
ai aws bentoml computer-vision image-processing machine-learning mobilenetv3 neural-network nextjs pytorch resnet50 responsive searchengine siamese-network vercel
Language:Jupyter Notebook 4
bentoml / BentoBurr
This repository shows how to deploy a Burr Application with BentoML.
agents bentoml bentoml-service burr deployment example python
Language:Python 3
sayakpaul / BentoML-Explorations
Contains my experiments made with the mighty library BentoML
scikit-learn bentoml python rest-api tensorflow zomato
Language:Jupyter Notebook 3
so1s / so1s-model-template
모델 컨테이너화를 위한 템플릿
bentoml docker-image
3
aliabbasjaffri / mnist-zenml-bentoml-pipeline
A pipeline built on ZenML for training digit MNIST dataset using Pytorch, experiment tracking using MLFlow and model deployment using BentoML
pytorch pipeline mnist zenml bentoml mlflow
Language:Python 2
dudeperf3ct / 10-bentoml-deploy
bentoml aws-lambda azure-functions kubernetes transformers mlops docker
Language:Python 2
izam-mohammed / MLOps-Blueprints
My practices in mlops tools 🥵. Feel free to explore the various scripts and files ⚙️. I am just diving into the world of production-ready Machine Learning with streamlined workflows. 🤖
bentoml dvc ml mlflow mlops practices tfx zenml mlops-basics
Language:Jupyter Notebook 2
JBris / pymc-mlflow-deployment
Testing deployment of PyMC models using MLFlow and BentoML.
bayesian-inference bayesian-statistics bentoml bentoml-service devops docker mlflow mlflow-tracking mlflow-tracking-server mlops pymc boto3 botocore hydra minio minio-server mlops-workflow pymc-experimental
Language:Python 2
lsjsj92 / python_bentoml_example
Python bentoML(API serving for machine learning model) example & tutorial code
bentoml deep-learning machine-learning mlops python
Language:Python 2
y9yk / mlops-utils
MLOps Utility
bentoml gcp mlops
Language:Python 2
kingabzpro / Deploying-Llama-3.3-70B
Serve Llama 3.3 70B (with AWQ quantization) using vLLM and deploy it on BentoCloud.
bentocloud bentoml cloud fastapi llama3-3 mlops vllm
Language:Python 1

bentoml

bentoml / OpenLLM

bentoml / Yatai

aarnphm / whispercpp

Pythondeveloper6 / Awesome-MLOPS

bentoml / gallery

yuqwu / Replace-Anything

Nneji123 / Serving-Machine-Learning-Models

dtemir / fellowship-prediction

ahmedbesbes / audiolizr

swiss-ai-center / a-guide-to-mlops

MemoonaTahira / MLZoomcamp2022

jerife / MLOps-on-kubernetes

ttop32 / KoGPT2novel

bentoml / diffusers-examples

YeonwooSung / MLOps

vaibhavsatpathy / psAI-clOps

getlegist / versailles

cheat-tos / serving

bentoml / yatai-chart

dudeperf3ct / Model-Deployment

bentoml / plugins

aliabbasjaffri / fashion-mnist-metaflow-bentoml-pipeline

MLH-Fellowship / 0.1.2-sentiment-analysis-visualization

MLH-Fellowship / Auto-Tagger

MLH-Fellowship / Flask-ML

raj-pulapakura / Image-Search-Engine

bentoml / BentoBurr

sayakpaul / BentoML-Explorations

so1s / so1s-model-template

aliabbasjaffri / mnist-zenml-bentoml-pipeline

dudeperf3ct / 10-bentoml-deploy

izam-mohammed / MLOps-Blueprints

JBris / pymc-mlflow-deployment

lsjsj92 / python_bentoml_example

y9yk / mlops-utils

kingabzpro / Deploying-Llama-3.3-70B