google-deepmind / reverb

Reverb is an efficient and easy-to-use data storage and transport system designed for machine learning research

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Can I change the rate limiter after I have created the table

ethanluoyc opened this issue · comments

Hi,

I have a use case where I want to use some offline dataset to initialize the replay table while still using the rate limiter to control the rate of inserts/samples. When I insert the offline data I would like to completely turn off rate limiting but restore that after wards. Is there a way to do that in Reverb?

Many thanks.

Hi,

No I'm afraid that there are no way to turn off or modify the rate limiter after the table has been constructed. Setting min_size_to_sample to be equal to the number of items in your offline dataset might do the trick for you though.

Thanks! That was the workaround I had in mind.