Giters

asahi417 / lmppl

Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

asahi417/lmppl Stargazers