trainium

There are 1 repository under trainium topic.

vllm-project / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
amd cuda gpt inference inferentia llama llm llm-serving llmops mlops model-serving pytorch rocm trainium transformer
Language:Python 19677