Geek Repo
Github PK Tool:Github PK Tool
scalable and robust tree-based speculative decoding algorithm
TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
A framework for few-shot evaluation of language models.
