Aryavir07 / Image-Captioning-Using-CNN-and-LSTM

Generating Captions for images using CNN & LSTM on Flickr8K dataset.The generation of captions from images has various practical benefits, ranging from aiding the visually impaired.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Image Captioning Using CNN and LSTM

Caption generation is a challenging artificial intelligence problem where a textual description must be generated for a given photograph.

It requires both methods from computer vision to understand the content of the image and a language model from the field of natural language processing to turn the understanding of the image into words in the right order. Recently, deep learning methods have achieved state-of-the-art results on examples of this problem.

Deep learning methods have demonstrated state-of-the-art results on caption generation problems. What is most impressive about these methods is a single end-to-end model can be defined to predict a caption, given a photo, instead of requiring sophisticated data preparation or a pipeline of specifically designed models.

Dataset: Flickr 8k : https://www.kaggle.com/adityajn105/flickr8k Description: https://github.com/jbrownlee/Datasets/releases/download/Flickr8k/Flickr8k_text.zip

Model

1_rfYN2EELhLvp2Van3Jo-Yw

download

Final Results:

download download

Some Fails:

downloaddownload

About

Generating Captions for images using CNN & LSTM on Flickr8K dataset.The generation of captions from images has various practical benefits, ranging from aiding the visually impaired.


Languages

Language:Jupyter Notebook 100.0%