KodAgge / Img2Latex

An Encoder-Decoder model converting handwritten mathematical expressions to LaTeX-code

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

DD2424_Img2Latex

In this project we built an Encoder-Decoder model to convert images of handwritten mathematical expressions to rendable LaTeX-code. The encoder consists of a 6-layered convolutional neural network (CNN) with batch normalization and max-pooling. The decoder consists of a long short-term memory (LSTM) neural network with a soft attention mechanism. For prediction, beam search was used.

The model was trained on the CROHME dataset.

Some cherry picked results

Result A Result B Result C Result D

The expressions above were written by the authors themselves.

About

An Encoder-Decoder model converting handwritten mathematical expressions to LaTeX-code


Languages

Language:Python 96.5%Language:Jupyter Notebook 2.9%Language:JavaScript 0.6%