Why sac is off policy?
MohammadAsadolahi opened this issue · comments
MohammadAsadolahi commented
Hi and thank you for such genius algorithm.
I wonder how you consider sac as off-policy algorithm. As far as i checked both in code and paper all moves are taken by current policy which is excactly the definition of on-policy algorithms.