feifeibear / LLMSpeculativeSampling

Fast inference from large lauguage models via speculative decoding

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

feifeibear/LLMSpeculativeSampling Stargazers