Would it be possible for Ollama to support re-rank models?
lyfuci opened this issue · comments
Sean Sun commented
I am using Ollama for my projects and it's been great. However, when using some AI app platform, like dify, build RAG app, rerank is nessesary. It's possible for Ollama to support rerank models.
Igor Schlumberger commented
@lyfuci Ollama only support OpenSource models. Before adding a model to Ollama, it is often available on Hunging Face.
Sean Sun commented
@igorschlum sorry, just set a typo, reranker->rerank. reranker model means a model input some sentences and a query, output a list of similarity.
There is some reranker model on Hugging Face, like bge-reranker-v2-m3,jina-reranker-v1-base-en etc.