[Minor] update TensorDicts instead of re-creating
fedebotu opened this issue · comments
Note: this is a minor detail since update
can only be done in reset
and not step
(in step
, we need to re-create a TensorDict with the next
key thus rendering update
useless. We will follow up discussions in #72 !