CS294-112 Final Project
Bridging Distribution Mismatch: Better Bound on Composable Deep Reinforcement Learning
Dependencies:
- Python 3.5
- Numpy version 1.14.5
- TensorFlow version 1.10.5
- OpenAI Gym version 0.10.5
- seaborn
- Box2D==2.3.2
- OpenCV
- ffmpeg
- Vizdoom
Before doing anything, first replace gym/envs/box2d/lunar_lander.py with the provided lunar_lander.py file.
The only files that you need to look at are dqn.py and train_ac_f18.py, which you will implement.
The starter code was based on an implementation of Q-learning for Atari generously provided by Szymon Sidor from OpenAI.
Instructions for Composable Soft Q Learning
python run_dqn_vizdoom.py --vizdoom --explore e-greedy --subgame shoot_monster
python run_dqn_vizdoom.py --vizdoom --explore soft_q --subgame avoid_shooters
python run_dqn_vizdoom.py --vizdoom --explore soft_q --ex2 --coef 1e-4 --subgame avoid_shooters