bundle_and_checkpoint bottleneck

Question

bundle_and_checkpoint bottleneck

mattgallivan opened this issue 4 years ago · comments

When subclassing DQNAgent, my code seems to run slowest in the bundle_and_checkpoint and unbundle functions. If I overload these functions to simply do nothing, does this affect the DQN agent significantly other than not saving and loading checkpoints?

Matt Gallivan commented 4 years ago

Thanks!

Pablo Samuel Castro · Answer 1 · Mon Nov 02 2020 22:27:37 GMT+0800 (China Standard Time)

the only thing that changes is that you won't be saving/loading checkpoints. another alternative you may want to consider is to reduce the frequency at which checkpoints are saved.

…

On Sun, Nov 1, 2020 at 5:45 PM Matt Gallivan ***@***.***> wrote: When subclassing DQNAgent, my code seems to run slowest in the bundle_and_checkpoint and unbundle functions. If I overload these functions to simply do nothing, does this affect the DQN agent significantly other than not saving and loading checkpoints? — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#156>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AE3CCMMTPFZTVBSIJMUF75DSNXQJ7ANCNFSM4TGZOOFQ> .