Support for max tokens option in AI blocks
baptisteArno opened this issue · comments
I am not sure about how max_token is helpful here because it could greatly impact the user experience. It means the assistant reply could be cut off if max tokens limit is reach.