sail-sg / envpool

C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.

Home Page:https://envpool.readthedocs.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Feature Request] Get RAM State from Atari ALE

SumeetBatra opened this issue · comments

Hi folks,

I'm wondering if there is a way to access the RAM state for Atari environments, or if this can be implemented as a feature if not. The RAM buffer contains additional low-dimensional information such as player position info that is useful for some learning tasks. Gymnasium provides an interface to get the RAM state like so env.ale.getRAM() which returns a 128-length numpy array corresponding to the RAM state. Seems like this would be a pretty straightforward addition? Thanks!

Just curious. How is the performance on atrai ram? I suffered from very poor performance using ppo compared to RGB state.

@alexxchen ALE Ram state is useful for object-centric learning work

@alexxchen ALE Ram state is useful for object-centric learning work

@renos Thanks for your information! I hit a blind spot in my knowledge!