[QUESTION] What's the meaning of action_size?

[Lucien-Evans-123]

Now, I am writing the mask function. I find some question to ask you.
cql = d3rlpy.algos.DiscreteCQLConfig(batch_size=20, encoder_factory=CustomEncoderFactory(feature_size=32)).create(device='cuda:0') register_encoder_factory(CustomEncoderFactory) cql = d3rlpy.load_learnable('d3rlpy_logs/cql_mr.d3')
In my dataset, the action size is 17. However after load the .d3 file, the action_size is 46 in config!(I debug code and find it)
I am looking forward to your reply. Thank you!

[Takuma Seno]

@Lucien-Evans-123 Thanks for the issue. action_size of discrete action-space is going to be automatically computed here:

d3rlpy/d3rlpy/dataset/replay_buffer.py

Line 415 in 94e8345

 action_size = max_action + 1  # index should start from 0 

This means that the max action id in your dataset is 45, I guess.