Yaozeng / roberta-tf

tf version roberta using google bert source code

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Using google bert for RoBERTa

first, using convert_pytorch_checkpoint_to_tf.py convert wieght

second, edit config file

third, modified modelling:using_token_type=False start=2

Fourth, change bert tokenizer to roberta tokenizer

About

tf version roberta using google bert source code

License:Apache License 2.0


Languages

Language:Python 89.1%Language:Jupyter Notebook 10.9%