Giters

OpenNMT / CTranslate2

Fast inference engine for Transformer models

Home Page:https://opennmt.net/CTranslate2

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Dynamic LoRA switching

MrigankRaman opened this issue · comments

commented

Hi! This has been an awesome project and helped me a lot. I was wondering can we get dynamic lora switching in ctranslate2? Afaik TensorRTLLM has it

commented

I would also like to have this feature as well 🙂