Rate Limit Issue 10KTPM-200RPM
kryptobaseddev opened this issue · comments
Looking to make some adjustments to create a wait loop to check based on Rate Limit for the specific models. I have been getting an issue when trying to run and hit the limits.
If we can incorporate a way to put a wait/pause loop type check for this type of error so the notebook can continue without failing when hitting the limit.
I will be testing some options but wanted to start this thread to get others input.
I tried forking and playing around with this. But I had a few options - ratelimit works, also chunking the request certainly helps.