Infinite token generation
yukiarimo opened this issue · comments
Is there any way to make an infinite token generation? Is there an ability to set the maximum new tokens to infinity or any other workaround?
It seems impossible, so I'm going to use the while True loop over it.