hjpwhu / one-network-many-uses

Four-in-one deep network: image search, image captioning, similar words and similar images using a single model

Home Page:https://towardsdatascience.com/one-neural-network-many-uses-build-image-search-image-captioning-similar-words-and-similar-1e22080ce73d

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

One neural network, many uses

Jupyter notebook corresponding to tutorial: One neural network network, many uses: image captioning, image search, similar images and similar words using one model

Requires following packages:

  • PyTorch
  • Numpy
  • Matplotlib

Dataset NOT included (please download separately)

To follow along, you'll need to download the Flickr8K dataset. Fill this form and you'll receive a download link on your email. (There's also a direct link to download the 1GB Flickr8K dataset, though not sure how long it'll stay like that). Extract the zip file in the 'Flicker8k_Dataset' folder in the same directory as your notebook. You'll also need to download captions from here. Extract captions in the folder 'caption_datasets'.

Example performance

Image caption example:

art 1

Similar words example

art 2

Similar images example

asrt 3

Image search example

search example

search example

Made by @paraschopra

MIT License.

About

Four-in-one deep network: image search, image captioning, similar words and similar images using a single model

https://towardsdatascience.com/one-neural-network-many-uses-build-image-search-image-captioning-similar-words-and-similar-1e22080ce73d


Languages

Language:Jupyter Notebook 100.0%