LaplaceKorea / extreme-bert

ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.

https://extreme-bert.github.io/extreme-bert-page

Geek Repo

Github PK Tool