huggingface / hmtl

🌊HMTL: Hierarchical Multi-Task Learning - A State-of-the-Art neural network model for several NLP tasks based on PyTorch and AllenNLP

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

What columns of the *._conll are used for NER training?

poojanarayanc opened this issue · comments

Not an issue, but a query really. Have been looking at training my own models, just wondered if all columns of the *._conll files are used for NER training or is it just the NER tags?

Hello, thanks for your interest.
For training NER, only the column with the NER tags are actually retained when loading the training set (and obviously the column with the text too).
Victor

Thanks, that's very helpful to know!