DiscreteMDP and POMDP
MaximeBouton opened this issue · comments
The implementation of DiscreteMDPs and POMDPs should be modernized:
- no iterator
- DiscreteDistribution could be replaced by SparseCat (would introduce a dependency so it is maybe not a good idea)
SparseCat is already used in GridWorld, so there would not be a new dependency.