Render episodes

[robjlyons]

Is there a way to render eval episodes for the open ai Atari envs?

[Danijar Hafner]

Yes, they are visualized in TensorBoard and they are also stored to logdir/eval_episodes. You can visualize the stored episodes via:

import imageio
import numpy as np

imageio.mimsave('video.mp4', np.load('episode.npz')['image'])