modelscope / dash-infer

DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including x86 and ARMv9.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

modelscope/dash-infer Stargazers