information-retrieval

There are 96 repositories under information-retrieval topic.

JaidedAI / EasyOCR
Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
ocr deep-learning crnn pytorch lstm machine-learning scene-text scene-text-recognition optical-character-recognition cnn data-mining image-processing python easyocr information-retrieval
Language:Python 22185
gensim
piskvorky / gensim
Topic Modelling for Humans
gensim topic-modeling information-retrieval machine-learning natural-language-processing nlp data-science python data-mining word2vec word-embeddings neural-network document-similarity word-similarity fasttext
Language:Python 15289
haystack
deepset-ai / haystack
:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
nlp question-answering bert language-model pytorch semantic-search squad information-retrieval summarization transformers machine-learning ai python chatgpt gpt-3 large-language-models generative-ai
Language:Python 13867
weaviate
weaviate / weaviate
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database.
search-engine semantic-search semantic-search-engine vector-search vector-search-engine vector-database approximate-nearest-neighbor-search image-search hnsw information-retrieval mlops nearest-neighbor-search neural-search recommender-system similarity-search vectors generative-search hybrid-search weaviate grpc
Language:Go 9689
danswer-ai / danswer
Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.
enterprise-search rag ai-chat chatgpt gen-ai nextjs python information-retrieval
Language:Python 9380
infiniflow / ragflow
RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
data-pipelines deep-learning document-parser document-understanding information-retrieval llm llmops machine-learning nlp ocr orchestration pdf-to-text preprocessing rag retrieval-augmented-generation table-structure-recognition
Language:Python 7527
txtai
neuml / txtai
💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
python search machine-learning nlp semantic-search neural-search vector-search txtai llm vector-database language-model transformers sentence-embeddings large-language-models information-retrieval search-engine vector-search-engine embeddings retrieval-augmented-generation rag
Language:Python 7095
Unstructured-IO / unstructured
Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
deep-learning document-parsing machine-learning nlp ocr information-retrieval data-pipelines ml preprocessing pdf-to-text natural-language-processing pdf pdf-to-json document-image-analysis donut document-image-processing document-parser docx langchain llm
Language:HTML 6758
FlagOpen / FlagEmbedding
Retrieval and Retrieval-augmented LLMs
embeddings information-retrieval llm sentence-embeddings text-semantic-similarity retrieval-augmented-generation
Language:Python 5189
apache / lucene-solr
Apache Lucene and Solr open-source search software
lucene solr search nosql java backend search-engine information-retrieval
4365
marqo
marqo-ai / marqo
Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
deep-learning information-retrieval machinelearning vector-search tensor-search clip multi-modal search-engine transformers vision-language machine-learning semantic-search visual-search natural-language-processing hnsw knn hacktoberfest chatgpt gpt large-language-models
Language:Python 4181
llmware-ai / llmware
Providing enterprise-grade LLM-based development framework, tools, and fine-tuned models.
ai bert embedding-vectors embeddings faiss generative-ai information-retrieval large-language-models machine-learning milvus nlp parsing python pytorch question-answering rag retrieval-augmented-generation semantic-search transformers
Language:Python 3810
KittyKatt / screenFetch
Fetches system/theme information in terminal for Linux desktop screenshots.
bash desktop information-retrieval shell
Language:Shell 3765
catalyst-team / catalyst
Accelerated deep learning R&D
deep-learning reinforcement-learning machine-learning computer-vision pytorch python distributed-computing infrastructure research reproducibility image-processing image-classification image-segmentation object-detection natural-language-processing text-classification text-segmentation information-retrieval recommender-system metric-learning
Language:Python 3233
tensorflow / ranking
Learning to Rank in TensorFlow
ranking machine-learning deep-learning information-retrieval learning-to-rank recommender-systems
Language:Python 2715
InvoiceNet
naiveHobo / InvoiceNet
Deep neural network to extract intelligent information from invoice documents.
invoice invoice-management invoices invoice-insight classification deep-learning deep-neural-networks deeplearning keras keras-tensorflow keras-neural-networks invoice-pdf invoice-parser invoice-software information-retrieval information-extraction billing
Language:Python 2397
apache / lucene
Apache Lucene open-source search software
lucene search nosql java backend search-engine information-retrieval
Language:Java 2389
rajkumardusad / IP-Tracer
Track any ip address with IP-Tracer. IP-Tracer is developed for Linux and Termux. you can retrieve any ip address information using IP-Tracer.
information-retrieval information-gathering termux-tool ip-location termux-hacking ip-tracer linux gnuroot-debian termux linux-tools hacking-tool hacking-tools ip-geolocation
Language:PHP 1968
StringZilla
ashvardanian / StringZilla
Up to 10x faster strings for C, C++, Python, Rust, and Swift, leveraging SWAR and SIMD on Arm Neon and x86 AVX2 & AVX-512-capable chips to accelerate search, sort, edit distances, alignment scores, etc 🦖
beautifulsoup common-crawl csv dataset html information-retrieval json laion ndjson parser pattern-recognition simd sorting-algorithms string string-manipulation string-matching string-parsing string-search substring
Language:C++ 1816
xlang-ai / instructor-embedding
[ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings
embeddings information-retrieval language-model text-classification text-clustering text-embedding text-evaluation text-semantic-similarity prompt-retrieval text-reranking
Language:Python 1726
langroid
langroid / langroid
Harness LLMs with Multi-Agent Programming
agents chatgpt gpt gpt-4 gpt4 language-model llm llm-agent multi-agent-systems openai-api ai llm-framework llama local-llm function-calling information-retrieval question-answering rag retrieval-augmented-generation
Language:Python 1660
shaoxiongji / knowledge-graphs
A collection of research on knowledge graphs
knowledge-graph representation-learning relation-extraction reasoning natural-language-processing temporal-knowledge-graph ner commonsense meta-relational-learning cross-modal knowledge-graph-completion question-answering dialogue-systems recommendation-systems information-retrieval survey paper
Language:JavaScript 1617
boudinfl / pke
Python Keyphrase Extraction module
keyphrase-extraction natural-language-processing information-retrieval computational-linguistics keyword-extraction python keyword keyphrase
Language:Python 1531
pyserini
castorini / pyserini
Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
information-retrieval
Language:Python 1482
embeddings-benchmark / mteb
MTEB: Massive Text Embedding Benchmark
benchmark clustering information-retrieval sentence-transformers sts text-embedding retrieval neural-search semantic-search sbert sgpt text-classification bitext-mining reranking multilingual-nlp
Language:Python 1451
beir
beir-cellar / beir
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
ance benchmark bert colbert dataset deep-learning dpr elasticsearch information-retrieval nlp passage-retrieval pytorch question-generation retrieval retrieval-models sbert sentence-transformers use-qa zero-shot-retrieval
Language:Python 1407
th3unkn0n / TeleGram-Scraper
telegram group scraper tool. fetch all information about group members
telegram telegram-scraper telegram-scraper-bot termux termux-tool python3 information-retrieval information-gathering smsbomber linux promotion
Language:Python 1385
Awesome-FL
youngfish42 / Awesome-FL
Comprehensive and timely academic information on federated learning (papers, frameworks, datasets, tutorials, workshops)
awesome deep-learning federated-learning graph-neural-networks machine-learning tabular-data federated-learning-framework computer-vision knowledge-graph paper security natural-language-processing information-retrieval data-mining database system artificial-intelligence efficiency privacy graph
Language:Python 1312
th3unkn0n / osi.ig
Information Gathering Instagram.
python python3 instagram instagram-scraper information-gathering osint information-retrieval scraper termux-tool termux linux
Language:Python 1214
apache / solr
Apache Solr open-source search software
lucene solr search nosql java backend search-engine information-retrieval
Language:Java 1025
anserini
castorini / anserini
Anserini is a Lucene toolkit for reproducible information retrieval research
information-retrieval lucene
Language:Java 982
fastRAG
IntelLabs / fastRAG
Efficient Retrieval Augmentation and Generation Framework
benchmark colbert diffusion generative-ai information-retrieval knowledge-graph llm multi-modal nlp question-answering semantic-search sentence-transformers summarization transformers
Language:Python 935
brylevkirill / notes
Learn about Machine Learning and Artificial Intelligence
artificial-intelligence machine-learning deep-learning reinforcement-learning bayesian-inference probabilistic-programming knowledge-representation reasoning causal-inference knowledge-graph question-answering natural-language-processing information-retrieval recommender-systems
904
tsinghua-fib-lab / GNN-Recommender-Systems
An index of recommendation algorithms that are based on Graph Neural Networks. (TORS)
gcn gnn graph-convolutional-networks graph-neural-networks graph-representation-learning information-retrieval recommendation recommendation-algorithms recommendation-system recommender-system
895
pisa
pisa-engine / pisa
PISA: Performant Indexes and Search for Academia
inverted-index search search-engine information-retrieval
Language:C++ 867
dorianbrown / rank_bm25
A Collection of BM25 Algorithms in Python
bm25 information-retrieval algorithm ranking
Language:Python 855