How to achieve parallel simulation with multiple Calvin environments?
StarCycle opened this issue · comments
Because of pybullet
, the easiest method is to run every environment in its own subprocess. For reinforcement learning, Stable Baselines 3 provides a SubprocessVecEnv wrapper for that, read this guide.
When we did our experiments we evaluated multiple checkpoints simultaneously in subprocesses with this script.