lukemelas / simple-bert

A simple PyTorch implementation of BERT, complete with pretrained models and training scripts.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

BERT

This repository is a simple, easy-to-use PyTorch implementation of BERT. It is based on Dong-Hyun Lee's pytorchic-bert, which is in turn based off of HuggingFace's implementation.

Key features:

  • Load pre-trained weights from TensorFlow
  • Finetune BERT for text classification
  • Pretrain BERT from scratch on your own text data

More details coming soon!

About

A simple PyTorch implementation of BERT, complete with pretrained models and training scripts.


Languages

Language:Python 98.0%Language:Shell 2.0%