Giters

rdgozum / next-word-prediction

Generative Pretrained Transformer 2 (GPT-2) for Language Modeling using the PyTorch-Transformers library.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Missing word prediction?

hwsamuel opened this issue · comments

commented

This is a neat library, thanks! Instead of just predicting the next word, is it possible to predict a missing word? I'm new to GPT2 so not sure if that's even supported, e.g. "I would like to have a **** and then have breakfast". My guess is that this would actually be more accurate as there is more context for the ML to know the missing word.