ollama / ollama

Get up and running with Llama 3, Mistral, Gemma, and other large language models.

Home Page:https://ollama.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Would it be possible for Ollama to support re-rank models?

lyfuci opened this issue · comments

I am using Ollama for my projects and it's been great. However, when using some AI app platform, like dify, build RAG app, rerank is nessesary. It's possible for Ollama to support rerank models.

@lyfuci Ollama only support OpenSource models. Before adding a model to Ollama, it is often available on Hunging Face.

@igorschlum sorry, just set a typo, reranker->rerank. reranker model means a model input some sentences and a query, output a list of similarity.
There is some reranker model on Hugging Face, like bge-reranker-v2-m3,jina-reranker-v1-base-en etc.