OpenNMT / CTranslate2

Fast inference engine for Transformer models

Home Page:https://opennmt.net/CTranslate2

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

nning this:

silvacarl2 opened this issue · comments

has anyone been able to get this to work?

ct2-transformers-converter --model NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO --quantization float16 --force --output_dir Nous-Hermes-2-Mixtral-8x7B-DPO-float16

we get this: KeyError: 'mixtral'

Mixtral does not be supported in this moment

ok no problem.