Spike: tokens calculation
anamariamv opened this issue · comments
Summary
The library currently calculates the tokens based on the message in the Kotlin model but it should calculate based on the request payload instead.
Some references:
ModelType params
tokensForMessages fun
reduceByLimitToken fun