Does set logit_bias to 100 lead the model choice between 'A' and 'B' essentially random?
vegetax opened this issue · comments
Sophia Williams commented
mshumer commented
Not random! It essentially just excludes any other tokens.
vegetax opened this issue · comments
Not random! It essentially just excludes any other tokens.