DQN-Gluon-MxNet Gloun version of DQN DQN.ipynb is the implimentation of DQN. DQN-efficent-ReplayBuffer.ipynb is the same code with 1/8 more efficient cpu memory usage where instead of storing current_states + secessur_state at each times step, we just store the current frame.