[nanoChatGPT] swap ddp and tensordictmodule?
apbard opened this issue · comments
No longer relevant as we have removed DDP
A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
apbard opened this issue · comments
No longer relevant as we have removed DDP