dense-retrieval

There are 4 repositories under dense-retrieval topic.

PaddlePaddle / RocketQA
🚀 RocketQA, dense retrieval for information retrieval and question answering, including both Chinese and English state-of-the-art models.
dense-retrieval information-retrieval nlp question-answering
Language:Python 764
ict-bigdatalab / awesome-pretrained-models-for-information-retrieval
A curated list of awesome papers related to pre-trained models for information retrieval (a.k.a., pretraining for IR).
bert-for-ir dense-retrieval information-retrieval pretrain-for-search pretrained-language-models pretraining-for-ir reranking web-search
638
nomic-ai / contrastors
Train Models Contrastively in Pytorch
contrastive-learning deep-learning dense-retrieval embeddings image-embeddings multimodal multimodal-rag pytorch rag text-embeddings transformers
Language:Python 505
texttron / tevatron
Tevatron - A flexible toolkit for neural retrieval research and development.
dense-retrieval dpr flax information-retrieval jax pytorch question-answering transformer
Language:Python 483
SeanLee97 / AnglE
Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard
dense-retrieval embeddings information-retrieval llama llama2 llm mteb rag retrieval-augmented-generation semantic-similarity semantic-textual-similarity sentence-embedding sentence-embeddings sentence-vector sts stsbenchmark text-embedding text-similarity text-vector text2vec
Language:Python 446
texttron / hyde
HyDE: Precise Zero-Shot Dense Retrieval without Relevance Labels
dense-retrieval large-language-models zeroshot
Language:Jupyter Notebook 425
caiyinqiong / Semantic-Retrieval-Models
A curated list of awesome papers for Semantic Retrieval (TOIS Accepted: Semantic Models for the First-stage Retrieval: A Comprehensive Review).
dense-retrieval information-retrieval nlp paper-list semantic-retrieval
315
Condenser
luyug / Condenser
EMNLP 2021 - Pre-training architectures for dense retrieval
bert dense-retrieval pytorch transformer
Language:Python 244
retriv
AmenRa / retriv
A Python Search Engine for Humans 🥸
bm25 dense-retrieval hybrid-retrieval information-retrieval numba search search-engine search-engine-optimization semantic-search sparse-retrieval tf-idf
Language:Python 176
Alibaba-NLP / Multi-CPR
[SIGIR 2022] Multi-CPR: A Multi Domain Chinese Dataset for Passage Retrieval
dataset dense-retrieval passage-ranking passage-retrieval pytorch question-answering text-ranking
Language:Python 164
GC-DPR
luyug / GC-DPR
Train Dense Passage Retriever (DPR) with a single GPU
deep-learning dense-retrieval dpr memory-efficient pytorch question-answering retrieval single-gpu
Language:Python 128
jingtaozhan / RepCONC
WSDM'22 Best Paper: Learning Discrete Representations via Constrained Clustering for Effective and Efficient Dense Retrieval
dense-retrieval efficiency information-retrieval neural-ranking product-quantization
Language:Python 115
microsoft / SimXNS
SimXNS is a research project for information retrieval. This repo contains official implementations by MSRA NLC team.
decision-time-planning dense-retrieval information-retrieval knowledge-distillation natural-language-processing negative-sampling pretraining-for-ir
Language:Python 105
DevSinghSachan / art
Code and models for the paper "Questions Are All You Need to Train a Dense Passage Retriever (TACL 2023)"
dense-retrieval information-retrieval natural-questions unsupervised-retrieval beir zero-shot
Language:Python 61
ml4bio / Dense-Homolog-Retrieval
Nature Biotechnology: Ultra-fast, sensitive detection of protein remote homologs using deep dense retrieval
alphafold dense-retrieval homology-search msa-construction protein protein-language-model protein-structure-prediction
Language:Python 59
sebastian-hofstaetter / tas-balanced-dense-retrieval
SIGIR 2021: Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Sampling
dense-retrieval knowledge-distillation dpr
Language:Jupyter Notebook 58
jingtaozhan / disentangled-retriever
An easy-to-use python toolkit for flexibly adapting various neural ranking models to any target domain.
dense-retrieval domain-adaption neural-ranking colbert reranker splade unicoil
Language:Python 55
jingtaozhan / JPQ
CIKM'21: JPQ substantially improves the efficiency of Dense Retrieval with 30x compression ratio, 10x CPU speedup and 2x GPU speedup.
information-retrieval web-search dense-retrieval product-quantization compression efficiency deep-learning pytorch
Language:Python 49
OpenMatch / COCO-DR
[EMNLP 2022] This is the code repo for our EMNLP‘22 paper "COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning".
bert dense-retrieval nlp transformer zero-shot zero-shot-retrieval contrastive-learning distributionally information-retrieval pretrained-language-model distributionally-robust
Language:Python 48
McGill-NLP / topiocqa
Code and data for reproducing baselines for TopiOCQA, an open-domain conversational question-answering dataset
conversational-ai deep-learning dense-retrieval natural-language-processing question-answering reading-comprehension
Language:Python 44
TryMoreGroup / TryMore-PaperReading
揣摩研习社关注自然语言和信息检索前沿技术，解读热门科技论文，分享实用科研工具，挖掘人工智能冰山之下的学术和应用价值！
dense-retrieval dialogue-generation language-model multi-modal natural-language-processing
37
voidism / EAR
Code for the ACL 2023 long paper - Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answering
bm25 dense-retrieval open-domain-qa query-expansion question-answering retrieval
Language:Python 34
PrithivirajDamodaran / SPLADERunner
Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by Prithivi Da, For PRs and Collaboration checkout the readme.
dense-retrieval hybrid-search semantic-search sparse-representations sparse-retrieval splade vector-search spladeplusplus
Language:Python 27
FreedomIntelligence / DPTDR
Code for COLING22 paper, DPTDR: Deep Prompt Tuning for Dense Passage Retrieval
dense-retrieval prompt-tuning information-retrieval p-tuning prompt-learning question-answering
Language:Python 25
Albert-Ma / COSTA
SIGIR'2022, Pre-train a Discriminative Text Encoder for Dense Retrieval via Contrastive Span Prediction
contrastive-learning dense-retrieval pretrain-for-search pretraining-for-ir
Language:Python 24
drogozhang / LED
Source code of paper 'LED: Lexicon-Enlightened Dense Retriever for Large-Scale Retrieval' (WWW 2023)
dense-retrieval information-retrieval semantic-retrieval passage-retrieval knowledge-distillation contrastive-learning learning-from-peer
Language:Python 22
LongxingTan / open-retrievals
All-in-One: Text Embedding, Retrieval, Reranking and RAG
retrieval nlp triplet-loss information-retrieval rag contrastive-learning embeddings advanced-rag sentence-similarity sentence-embedding llm-rerankers llm-embeddings llm rag-retrieval rag-rerank finetuning
Language:Python 21
yueyu1030 / ReGen
[ACL'23 Findings] This is the code repo for our ACL'23 Findings paper "ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrieval".
zero-shot-classification zero-shot-learning agnews dataset-generation dense-retrieval imdb language-model nlp retrieval text-classification sst-2 acl2023
Language:Python 19
OpenMatch / ANCE-Tele
Code and data of the EMNLP 2022 Main Conference paper "Reduce Catastrophic Forgetting of Dense Retrieval Training with Teleportation Negatives".
catastrophic-forgetting dense-retrieval hard-negative-mining training-stability information-retrieval
Language:Python 18
maastrichtlawtech / gdsr
🔗 A graph-augmented dense statute retriever. (EACL 2023)
dense-retrieval graph-neural-networks information-retrieval legaltech nlp
Language:Python 17
jordane95 / dual-cross-encoder
Dual Cross Encoder for Dense Retrieval
cross-encoder dense-retrieval dual-encoder query-generation
Language:Python 16
ArslanKAS / Large-Language-Models-with-Semantic-Search
Explore from keyword search to dense retrieval and reranking, which injects the intelligence of LLMs into your search system, making it faster and more effective.
deep-learning dense-retrieval large-language-models llm nlp reranking search semantic
Language:Jupyter Notebook 14
FreedomIntelligence / REMOP
Code for the paper: Modular Retrieval for Generalization and Interpretation.
dense-retrieval information-retrieval modular-learning prompt-tuning
Language:Python 13
cuongqn / recipe-qa
LLM-powered QA for food and recipes
dense-retrieval gpt qa
Language:Python 12
amzn / extremely-efficient-query-encoder
efficient query encoding for dense retrieval
dense-retrieval information-retrieval query-encoding
Language:Python 11
lemuria-wchen / CFC
Code and created datasets for our ACL 2022 paper: "Contextual Fine-to-Coarse Distillation for Coarse-grained Response Selection in Open-Domain Conversations"
dense-retrieval knowledge-distillation retrieval-chatbot bi-encoder
Language:Python 10

dense-retrieval

PaddlePaddle / RocketQA

ict-bigdatalab / awesome-pretrained-models-for-information-retrieval

nomic-ai / contrastors

texttron / tevatron

SeanLee97 / AnglE

texttron / hyde

caiyinqiong / Semantic-Retrieval-Models

luyug / Condenser

AmenRa / retriv

Alibaba-NLP / Multi-CPR

luyug / GC-DPR

jingtaozhan / RepCONC

microsoft / SimXNS

DevSinghSachan / art

ml4bio / Dense-Homolog-Retrieval

sebastian-hofstaetter / tas-balanced-dense-retrieval

jingtaozhan / disentangled-retriever

jingtaozhan / JPQ

OpenMatch / COCO-DR

McGill-NLP / topiocqa

TryMoreGroup / TryMore-PaperReading

voidism / EAR

PrithivirajDamodaran / SPLADERunner

FreedomIntelligence / DPTDR

Albert-Ma / COSTA

drogozhang / LED

LongxingTan / open-retrievals

yueyu1030 / ReGen

OpenMatch / ANCE-Tele

maastrichtlawtech / gdsr

jordane95 / dual-cross-encoder

ArslanKAS / Large-Language-Models-with-Semantic-Search

FreedomIntelligence / REMOP

cuongqn / recipe-qa

amzn / extremely-efficient-query-encoder

lemuria-wchen / CFC