liuyukid / transformers-ner

Pytorch-Named-Entity-Recognition-with-transformers

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

transformers-ner

Pytorch-Named-Entity-Recognition-with-transformers

Support chinese ner and english ner datasets

dataset list

  1. cluener(chinese)
  2. conll2003(english)

model_list

  1. (bert, albert, electra, roberta, distilbert, camembert, xlm, xlmroberta) + softmax
  2. (bert, albert, electra, roberta, distilbert, camembert, xlm, xlmroberta) + crf
  3. (bert, albert, electra, roberta, distilbert, camembert, xlm, xlmroberta) + span

requirement

  1. Pytorch=1.1.0+
  2. transformers=2.8.0

run the code

  1. sh scripts/run_xxx_ner.sh

About

Pytorch-Named-Entity-Recognition-with-transformers


Languages

Language:Python 98.2%Language:Shell 1.8%