Giters

mistralai / mistral-inference

Official inference library for Mistral models

Home Page:https://mistral.ai/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

speed up inference?

xxyp opened this issue · comments

commented

employing Codestral-22B-v0.1 by Mistral-inference, the speed seems slow. there any methods to speed up the inference ?