support for sfr embedding mistral & nomic models

[prasannakrish97]

Feature request

support for sfr-embedding-mistral model and huggingface embedding models nomi, needed :
Note : I'm using BetterTransformer via https://github.com/michaelfeil/infinity/

infinity | ERROR 2024-03-21 14:35:59,554 infinity_emb ERROR: acceleration.py:21
infinity | BetterTransformer is not available for model. The
infinity | model type mistral is not yet supported to be used
infinity | with BetterTransformer. Feel free to open an issue
infinity | at https://github.com/huggingface/optimum/issues if
infinity | you would like this model type to be supported.
infinity | Currently supported models are: dict_keys(['albert',
infinity | 'bark', 'bart', 'bert', 'bert-generation',
infinity | 'blenderbot', 'bloom', 'camembert', 'blip-2',
infinity | 'clip', 'codegen', 'data2vec-text', 'deit',
infinity | 'distilbert', 'electra', 'ernie', 'fsmt', 'gpt2',
infinity | 'gptj', 'gpt_neo', 'gpt_neox', 'hubert', 'layoutlm',
infinity | 'm2m_100', 'marian', 'markuplm', 'mbart', 'opt',
infinity | 'pegasus', 'rembert', 'prophetnet', 'roberta',
infinity | 'roc_bert', 'roformer', 'splinter', 'tapas', 't5',
infinity | 'vilt', 'vit', 'vit_mae', 'vit_msn', 'wav2vec2',
infinity | 'xlm-roberta', 'yolos']).. Continue without
infinity | bettertransformer modeling code.
infinity | Traceback (most recent call last):
infinity | File
infinity | "/app/infinity_emb/transformer/acceleration.py",
infinity | line 19, in to_bettertransformer
infinity | model = BetterTransformer.transform(model)
infinity | File "/usr/lib/python3.10/contextlib.py", line 79,
infinity | in inner
infinity | return func(*args, **kwds)
infinity | File
infinity | "/app/.venv/lib/python3.10/site-packages/optimum/bet
infinity | tertransformer/transformation.py", line 234, in
infinity | transform
infinity | raise NotImplementedError(
infinity | NotImplementedError: The model type mistral is not
infinity | yet supported to be used with BetterTransformer.

Motivation

SUPPORT NEEDED TO CHECK QUALITY

Your contribution

none