O que é NER?
Named-Entitity Recognition (NER) também conhecido como extração de entidades é uma tarefa de processamento de linguagem natural (NLP) voltada para a classificação de sequências (de tokens).
Materiais
Definição básica
- https://towardsdatascience.com/named-entity-recognition-with-nltk-and-spacy-8c4a7d88e7da
- https://medium.com/elinttech/uma-vis%C3%A3o-geral-sobre-named-entity-recognition-ner-4dc4e3b5e37a
Artigos acadêmicos
Estudos guiados a NLP
- https://cursosextensao.usp.br/course/view.php?id=2721
- @lucasbrandao4770: https://colab.research.google.com/drive/1dhEJ2VuphulLVwg9GKf0L9wEaVePN5cB
- https://github.com/thunlp/NLP-THU
- https://github.com/NielsRogge/Transformers-Tutorials
- https://github.com/EricFillion/happy-transformer
- https://github.com/keon/awesome-nlp
- https://github.com/ivan-bilan/The-NLP-Pandect
- https://github.com/dair-ai/Transformers-Recipe
NER Tagging Schemes
- https://www.sciencedirect.com/science/article/pii/S1110866520301596
- https://en.wikipedia.org/wiki/Inside%E2%80%93outside%E2%80%93beginning_(tagging)
Implementações
- Simple-transformers: https://github.com/ThilinaRajapakse/simpletransformers/blob/master/examples/named_entity_recognition/named_entity_recognition.py
- Flair: https://github.com/flairNLP/flair/tree/master/examples/ner
- FARM: https://github.com/deepset-ai/FARM/blob/master/examples/ner.py
- Transformers: https://github.com/huggingface/notebooks/blob/main/examples/token_classification.ipynb
Datasets
- https://huggingface.co/datasets?task_categories=task_categories:token-classification
- @piegu: https://forum.ailab.unb.br/t/datasets-em-portugues/251
- https://github.com/davidsbatista/NER-datasets
Exemplos
Dicas
- Por @perkhad rota de estudo:
- Estudar os formatos (esquemas) padrões (ex. Conll)
- Ler o artigo sobre bi-lstm para ner
- Testar frameworks alto nível do transformers (ex: Flairnlp, Simple-transformers FARM)
- Ir para implementação do Transformers