Candle Electra Candle port of ELECTRA primarily intended for use with pre-trained models. Note that this is largely identical to the BERT model in candle transformers, so you may be able to use that one instead.