serverless-inference

There are 0 repository under serverless-inference topic.

ServerlessLLM
ServerlessLLM / ServerlessLLM
Serverless LLM Serving for Everyone.
large-language-models model-as-a-service model-serving serverless-inference cuda pytorch huggingface-transformers
Language:Python 588
Picovoice / serverless-picollm
LLM Inference on AWS Lambda
aws-lambda llm llm-compression llm-inference serverless serverless-inference
Language:Python 10
tensorchord / modelz-py
Python SDK and CLI for modelz.ai, which is a developer-first platform for prototyping and deploying machine learning models.
serverless llm machine-learning serverless-inference inference
Language:Python 7