How to achieve parallel simulation with multiple Calvin environments?

[Zhuoheng Li]

[Lukas Hermann]

Because of pybullet, the easiest method is to run every environment in its own subprocess. For reinforcement learning, Stable Baselines 3 provides a SubprocessVecEnv wrapper for that, read this guide.
When we did our experiments we evaluated multiple checkpoints simultaneously in subprocesses with this script.