Giters

Doohae / llmss

LLM simple serving (tensor model parallel, pubsub, grpc)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

llmss

LLM simple serving (tensor model parallel, pubsub, grpc)

About

LLM simple serving (tensor model parallel, pubsub, grpc)

License:MIT License

Languages

Language:Python 100.0%