myhub / TransformerDemo

Pytorch nn.Transformer Demo

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Pytorch nn.Transformer Demo

A demo to predict odd numbers. Given the input [2, 4, 6], this program generates the output [3, 5, 7]. Given the input [100, 102, 104], this program generates the output [101, 103, 105].

Create a folder named "model", where the weights of trained model will be saved, and train the model using

python predict_odd_numbers.py

The validation loss will be around 1.7.

Test the model using

python predict_odd_numbers.py --test_model model/xxx.pt

Codes in the model.py come from this notebook.

About

Pytorch nn.Transformer Demo

License:MIT License


Languages

Language:Python 100.0%