RemusMaz / NER_ro

Named Entity Recognition - LiRo Workshop

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

For this project the following dependencies are to be installed.

pip install -q transformers pytorch_lightning nervaluate

Linux:
wget -q https://raw.githubusercontent.com/dumitrescustefan/ronec/master/data/train.json
wget -q https://raw.githubusercontent.com/dumitrescustefan/ronec/master/data/valid.json
wget -q https://raw.githubusercontent.com/dumitrescustefan/ronec/master/data/test.json

Windows:
iwr -outf train.json -Uri https://raw.githubusercontent.com/dumitrescustefan/ronec/master/data/train.json -UseBasicParsing
iwr -outf valid.json -Uri https://raw.githubusercontent.com/dumitrescustefan/ronec/master/data/valid.json -UseBasicParsing
iwr -outf test.json -Uri https://raw.githubusercontent.com/dumitrescustefan/ronec/master/data/test.json -UseBasicParsing

In src/train.py is the training and evaluation for the model.

TODO add code for saving and loading the model plus writing code for evaluation.

About

Named Entity Recognition - LiRo Workshop


Languages

Language:Python 100.0%