renatoviolin / next_word_prediction

Using transformers to predict next word and predict <mask> word

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Next word prediction

Simple application using transformers models to predict next word or a masked word in a sentence.

The purpose is to demo and compare the main models available up to date.

The first load take a long time since the application will download all the models. Beside 6 models running, inference time is acceptable even in CPU.

Application

This app implements two variants of the same task (predict token). The first one consider the is at end of the sentence, simulating a prediction of the next word of the sentece.

The second variant is necessary to include a token where you want the model to predict the word.

Word prediction

Running

cd web-app
python app.py

Open your browser http://localhost:8000

About

Using transformers to predict next word and predict <mask> word


Languages

Language:Python 40.3%Language:HTML 38.3%Language:JavaScript 17.0%Language:CSS 4.3%