LongRope support for Phi 3
EricLBuehler opened this issue · comments
Eric Buehler commented
Reference implementation: https://github.com/EricLBuehler/mistral.rs/blob/master/mistralrs-core/src/layers.rs#L69
Guoqing Bao commented
Reference implementation: https://github.com/EricLBuehler/mistral.rs/blob/master/mistralrs-core/src/layers.rs#L69
Supported, please refer to latest updates.
Eric Buehler commented
Thank you, that looks great. Implemented in #46.