tcbegley / rl

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

[nanoChatGPT] swap ddp and tensordictmodule?

apbard opened this issue a year ago · comments

Alessandro Pietro Bardelli commented a year ago

should these be swapped?
https://github.com/tcbegley/rl/pull/7/files#diff-bde8d58ba6a757e8a4a7d12c8cb414b6e69362ce6e46c232f623d4e4347365b5R406-R411

Tom Begley commented a year ago

No longer relevant as we have removed DDP