Embedding Feature
debasish-mohanty opened this issue · comments
Can you provide options while creating chunks based on Sentences too, which will help on better answer from the knowledge base.
Yes, we will add that in the next release. Currently, the page is using RecursiveCharacterTextSplitter from langchain.js
Seconding this but more so on dynamic context chunking, and maybe chunking with "ensemble" or overlapping chunks (since long context LLMs are here) https://docs.llamaindex.ai/en/stable/examples/retrievers/ensemble_retrieval/
P.S. for reranking ollama/ollama#3749