How do I get logprobs
tom-doerr opened this issue · comments
How can I get the logprob values? They are no longer in meta_info.
meta_info: {'prompt_tokens': 3432, 'completion_tokens': 100, 'completion_tokens_wo_jump_forward': 100, 'finish_reason': 'length', 'hit_stop_str': None, 'id': '7574be19a07c4d5e972f3d240355e135'}
Passed the wrong string to state.get_meta_info(variable_name)