[QUESTION] Is it possible to change callback to use profit as an evaluation metric instead of rewards?
Olwar opened this issue · comments
The rewards don't seem to be a good metric to evaluate the model. I could have more reward and still have lower profit.
That's true. The reward is more useful for the RL agent., but profit is a valid and precise metric for final evaluation.