Shuming Shi's repositories
inferflow
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
Language:C++MIT000
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).