AlphaZero MemoryLeak on Gym Environments.
joeryjoery opened this issue · comments
Joery commented
Possibly related to deepcopy of Gym.Env or GymState objects as this issue is absent for the boardgames.
Joery commented
Issue also observed with MuZero agents. Although memory grows much slower than with AlphaZero.