rahulbprakash / chainer-gqn

Neural scene representation and rendering (GQN)

🚧 Work in Progress 🚧

Neural scene representation and rendering

https://deepmind.com/blog/neural-scene-representation-and-rendering/

Current training progress:

Shepard-Matzler 64x64

https://gfycat.com/ForthrightBrokenCanadagoose

https://gfycat.com/MajorSeriousKittiwake

https://gfycat.com/PartialYellowishFritillarybutterfly

Requirements

• Python 3
• Chainer 4+ pip3 install chainer

Network Architecture

Dataset

deepmind/gqn-datasets

Datasets used to train GQN in the paper are available to download.

https://github.com/deepmind/gqn-datasets

You need to convert .tfrecord files to NumPy .npy format before starting training.

https://github.com/musyoku/gqn-datasets-translator

gqn-dataset-renderer

I am working on a ray tracer for rendering GQN dataset.

https://github.com/musyoku/gqn-dataset-renderer

• Shepard-Matzler

• Rooms

• MNIST Dice