retrieval

There are 5 repositories under retrieval topic.

apache / lucenenet
Apache Lucene.NET
lucenenet lucene text search information retrieval analysis index query apache hacktoberfest
Language:C# 2183
intel / intel-extension-for-transformers
⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
large-language-model chatbot 4-bits llm-inference llm-cpu chatpdf streamingllm intel-optimized-llamacpp speculative-decoding neural-chat habana neural-chat-7b rag retrieval autoround gaudi3
Language:Python 2072
shervinea / mit-15-003-data-science-tools
Study guides for MIT's 15.003 Data Science Tools
bash data-science git manipulation r retrieval sql study-guide visualization
1761
embeddings-benchmark / mteb
MTEB: Massive Text Embedding Benchmark
benchmark clustering information-retrieval sentence-transformers sts text-embedding retrieval neural-search semantic-search sbert sgpt text-classification bitext-mining reranking multilingual-nlp
Language:Python 1664
beir
beir-cellar / beir
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
nlp information-retrieval bert benchmark sentence-transformers question-generation retrieval passage-retrieval elasticsearch dpr sbert retrieval-models dataset ance colbert zero-shot-retrieval use-qa deep-learning pytorch
Language:Python 1496
qdrant / fastembed
Fast, Accurate, Lightweight Python library to make State of the Art Embedding
embeddings openai rag retrieval retrieval-augmented-generation vector-search
Language:Python 1183
epsilla-cloud / vectordb
Epsilla is a high performance Vector Database Management System. Try out hosted Epsilla at https://cloud.epsilla.com/
ai chatgpt data data-science database embeddings embeddings-similarity infrastructure llms machine-learning neural-network neural-search rag retrieval search-engine vector-database vector-search
Language:C++ 887
lucidrains / RETRO-pytorch
Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
artificial-intelligence attention-mechanism deep-learning retrieval transformers
Language:Python 847
Muennighoff / sgpt
SGPT: GPT Sentence Embeddings for Semantic Search
gpt information-retrieval language-model large-language-models neural-search retrieval semantic-search sentence-embeddings sgpt text-embedding
Language:Jupyter Notebook 827
ArrowLuo / CLIP4Clip
An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"
video-text-retrieval multimodal-learning multimodality multimodal search ranking retrieval-model retrieval msrvtt lsmdc msvd activitynet didemo video-clip-retrieval clip
Language:Python 821
NeumAI
NeumTry / NeumAI
Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.
ai data embeddings etl llm vector-database chatgpt data-engineering database pipeline python retrieval vectors llmops mlops ops rag
Language:Python 808
parthsarthi03 / raptor
The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval
agents clustering framework language-model llm machine-learning rag retrieval retrieval-augmented-generation vector-database
Language:Python 729
tensorlakeai / indexify
A realtime and indexing and structured extraction engine for Unstructured Data to build Generative AI Applications
llm machine-learning retrieval
Language:Rust 699
xhluca / bm25s
Fast lexical search library implementing BM25 in Python using Scipy (on average 2x faster than Elasticsearch in single-threaded setting)
bm25 bm25-l bm25-plus information-retrieval lexical-search okapi-bm25 rag retrieval robertson search
Language:Python 657
shamangary / awesome-local-global-descriptor
My personal note about local and global descriptor
awesome awesome-list cbir cnn descriptor global keypoint local local-descriptors local-descriptors-cnns local-features matching network retrieval sift
640
lucidrains / memorizing-transformers-pytorch
Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch
approximate-nearest-neighbors artificial-intelligence attention-mechanism deep-learning memory retrieval transformers
Language:Python 621
michaelthwan / searchGPT
Grounded search engine (i.e. with source reference) based on LLM / ChatGPT / OpenAI API. It supports web search, file content search etc.
ai chatgpt grounded-api grounded-bot language-model llm machine-learning nlp nlp-machine-learning openai python retrieval retrieval-model
Language:Python 600
redis-developer / ArXivChatGuru
Use ArXiv ChatGuru to talk to research papers. This app uses LangChain, OpenAI, Streamlit, and Redis as a vector database/semantic cache.
ai machine-learning openai python question-answering redis vector-search langchain arxiv rag retrieval retrieval-augmented-generation streamlit vector-database
Language:Python 514
ContextualAI / gritlm
Generative Representational Instruction Tuning
embedding embedding-models embeddings grit information-retrieval instruction-tuning llm llms mteb retrieval sbert sgpt text-embedding
Language:Jupyter Notebook 485
AkariAsai / learning_to_retrieve_reasoning_paths
The official implementation of ICLR 2020, "Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering".
open-domain-qa multi-hop-reasoning hotpotqa squad natural-questions retrieval reading-comprehension
Language:Python 423
aquila
Aquila-Network / aquila
An easy to use Neural Search Engine. Index latent vectors along with JSON metadata and do efficient k-NN search.
feature-vectors similarity-search knn-search information-retrieval neural-information-retrieval vector-database approximate-nearest-neighbor-search search-engine nearest-neighbor-search embedding similarity-searches video-search image-search aquila retrieval faiss neural-search information-retrieval-engine
Language:HTML 377
superlinked / superlinked
A compute framework for turning multimodal data structures into vector embeddings, to improve quality and control when working with LLMs. Generate custom multimodal embeddings with ease and weigh the vector parts separately at query time, removing the need for custom re-ranking models. Deploy straight from notebook to production.
embeddings etl vector-search data-pipeline deep-learning information-retrieval llm ml mlops natural-language-processing nlp python retrieval retrieval-augmented-generation semantic-search vectorization vector-database
Language:Jupyter Notebook 359
KarelDO / xmc.dspy
In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
information-extraction prompt-engineering retrieval retrieval-augmented-generation
Language:Python 337
LongmaoTeamTf / deep_recommenders
Deep Recommenders
deep-learning ranking retrieval recommendation-system multi-task-learning
Language:Python 325
raphaelsty / cherche
Neural Search
neural-search search searching neural-networks bm25 flashtext retrieval reader question-answering nlp information-retrieval natural-language-processing semantic-search vector-search machine-learning
Language:Python 317
arcee-ai / DALM
Domain Adapted Language Modeling Toolkit - E2E RAG
language-model llm retrieval retrieval-augmented-generation
Language:Python 278
Anush008 / fastembed-rs
Library for generating vector embeddings, reranking in Rust
embeddings rag retrieval retrieval-augmented-generation vector-search
Language:Rust 203
chao1224 / MoleculeSTM
Multi-modal Molecule Structure-text Model for Text-based Editing and Retrieval, Nat Mach Intell 2023 (https://www.nature.com/articles/s42256-023-00759-6)
clip computation-chemistry drug-discovery editing pretraining retrieval foundation-model molecule-editing moleculeclip moleculestm
Language:Python 192
meinardmueller / libfmp
libfmp - Python package for teaching and learning Fundamentals of Music Processing (FMP)
music processing mir audio fourier dtw synchronization chord tempo beat onset retrieval nmf f0 hmm python
Language:Python 188
simaiden / Clothing-Detection
clothes-detection retrieval
Language:Python 169
m-bain / CondensedMovies
Story-Based Retrieval with Contextual Embeddings. Largest freely available movie video dataset. [ACCV'20]
source-videos precomputed-features video-text-retrieval dataset retrieval
Language:Python 156
mendableai / rag-arena
Open-source RAG evaluation through users' feedback
ai chatbot langchain langchain-typescript mendable nextjs rag retrieval
Language:TypeScript 145
rom1504 / image_embeddings
Using efficientnet to provide embeddings for retrieval
computer-vision efficientnet embeddings recommendation-system representation-learning retrieval
Language:Jupyter Notebook 144
COIL
luyug / COIL
NAACL2021 - COIL Contextualized Lexical Retriever
retrieval
Language:Python 142
protyposis / AudioAlign
Audio Synchronization and Analysis Tool
video audio synchronization fingerprinting matching audio-analysis retrieval
Language:C# 135
ARM-DOE / ACT
Atmospheric data Community Toolkit - A python based toolkit for exploring and analyzing time series atmospheric datasets
atmospheric-science corrections meteorological-data meteorology retrieval time-series visualization
Language:Python 134