The source code of the paper, published on IEEE MSN 2020. Best track paper award of the Algorithm track.
P.S. the simulation code are provided here.
P.S.S. numba.jit could help solve online MDP optimization problem within 0.10s. Contact me for more details!