facebookresearch / Pearl

A Production-ready Reinforcement Learning AI Agent Library brought by the Applied Reinforcement Learning team at Meta.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

custom network issue

jyan-R opened this issue · comments

When using SAC, if I set actor net to customize network inherit from DynamicActionActorNetwork, the following code will lead to incorrect network shape for the actor.

https://github.com/facebookresearch/Pearl/blob/f5b09450e9e9f3734742871167597f469dfb7503/pearl/policy_learners/sequential_decision_making/actor_critic_base.py#L113C1-L127C10

It maybe better to replace is with issubclass()

Good catch, thank you. We are following your suggestion. The change should be reflected to GitHub today or tomorrow.