Extreme BERT (extreme-bert)

Extreme BERT

extreme-bert

Geek Repo

Accelerate your pretraining of customized language models on customized datasets

Location:Hong Kong

Home Page:https://extreme-bert.github.io/extreme-bert-page

Github PK Tool:Github PK Tool

Extreme BERT's repositories

extreme-bert

ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.

Language:PythonLicense:Apache-2.0Stargazers:282Issues:11Issues:4