li10141110 / Transformer-OCR

Scene Text Recognition via Transformer

model architecture:

Results across a number of methods and datasets:

Heat map of the source attention (encoder memory) score of the first layer of decoder:

The transformer source code from:http://nlp.seas.harvard.edu/2018/04/03/attention.html