mshumer / gpt-prompt-engineer

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Does set logit_bias to 100 lead the model choice between 'A' and 'B' essentially random?

vegetax opened this issue · comments

logit_bias={
'32': 100, # 'A' token
'33': 100, # 'B' token
},
I asked GPT4 this issue, the following is its answer:
image

Not random! It essentially just excludes any other tokens.

Unlike the explanation in the gpt-4 response, I think as @mshumer already said it just limits the output to either 'A' or 'B'.