Equationliu / Kangaroo

Implementation of Kangaroo: Lossless Self-Speculative Decoding via Double Early Exiting

https://arxiv.org/abs/2404.18911

Geek Repo

Github PK Tool