microsoft / LongRoPE

LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

microsoft/LongRoPE Stargazers