OpenNMT / CTranslate2

Fast inference engine for Transformer models

Home Page:https://opennmt.net/CTranslate2

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Support sequence_bias when decoding

mc-marcocheng opened this issue · comments

In huggingface transformers, there is a generate option called sequence_bias to increase/decrease the logits of user-specified sequence of tokens, using the SequenceBiasLogitsProcessor. Would be nice to have such generation option here as well.