NicolasAG / Caption2Image

Trying to generate images from text captions describing the image

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Probabilistic Graphical Models Project: Caption to Images

Combining both the image captioning and VAE tutorial

https://github.com/yunjey/pytorch-tutorial/tree/master/tutorials/03-advanced/image_captioning https://github.com/yunjey/pytorch-tutorial/tree/master/tutorials/03-advanced/variational_auto_encoder

follow instructions from the image_captioning tutorial to build the vocabulary and resize the images.

python build_vocab.py --caption_path <path to captions_train2014.json>

python resize.py --image_dir <path to train2014>

then train the model with python train.py

--

Supporting Slides: https://github.com/NicolasAG/Caption2Image/blob/master/doc/slides.pdf

Report: https://github.com/NicolasAG/Caption2Image/blob/master/doc/report.pdf

--

Original repository: https://github.com/ppartha03/PGM-Project

About

Trying to generate images from text captions describing the image


Languages

Language:Python 98.5%Language:Shell 1.5%