atineoSE / vllm_ubiops_deployment

A simple deployment package to run vLLM inference server on UbiOps

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

This repository is not active

About

A simple deployment package to run vLLM inference server on UbiOps


Languages

Language:Python 53.7%Language:Jupyter Notebook 46.3%