information-retrieval

There are 116 repositories under information-retrieval topic.

JaidedAI / EasyOCR
Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
ocr deep-learning crnn pytorch lstm machine-learning scene-text scene-text-recognition optical-character-recognition cnn data-mining image-processing python easyocr information-retrieval
Language:Python 27913
haystack
deepset-ai / haystack
AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
nlp question-answering pytorch semantic-search information-retrieval summarization transformers machine-learning ai python large-language-models generative-ai llm rag retrieval-augmented-generation agents agent gemini gpt-4 orchestration
Language:Python 22502
arc53 / DocsGPT
Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.
ai python natural-language-processing react chatgpt docsgpt information-retrieval language-model llm machine-learning pytorch rag semantic-search transformers hacktoberfest agent-builder agents search
Language:TypeScript 17075
gensim
piskvorky / gensim
Topic Modelling for Humans
gensim topic-modeling information-retrieval machine-learning natural-language-processing nlp data-science python data-mining word2vec word-embeddings neural-network document-similarity word-similarity fasttext
Language:Python 16186
weaviate
weaviate / weaviate
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database.
search-engine semantic-search semantic-search-engine vector-search vector-search-engine vector-database approximate-nearest-neighbor-search image-search hnsw information-retrieval mlops nearest-neighbor-search neural-search recommender-system similarity-search vectors generative-search hybrid-search weaviate grpc
Language:Go 14576
onyx
onyx-dot-app / onyx
Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.
enterprise-search rag ai-chat chatgpt gen-ai nextjs python information-retrieval ai llm llm-ui
Language:Python 13486
Unstructured-IO / unstructured
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
deep-learning document-parsing machine-learning nlp ocr information-retrieval data-pipelines ml preprocessing pdf-to-text natural-language-processing pdf pdf-to-json document-image-analysis donut document-image-processing document-parser docx langchain llm
Language:HTML 12660
txtai
neuml / txtai
💡 All-in-one open-source AI framework for semantic search, LLM orchestration and language model workflows
python search machine-learning nlp semantic-search vector-search txtai llm vector-database language-model transformers sentence-embeddings large-language-models information-retrieval search-engine embeddings retrieval-augmented-generation rag ai artificial-intelligence
Language:Python 11571
FlagOpen / FlagEmbedding
Retrieval and Retrieval-augmented LLMs
embeddings information-retrieval llm sentence-embeddings text-semantic-similarity retrieval-augmented-generation
Language:Python 10527
marqo
marqo-ai / marqo
Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
deep-learning information-retrieval machinelearning vector-search tensor-search clip multi-modal search-engine transformers vision-language machine-learning semantic-search visual-search natural-language-processing hnsw knn hacktoberfest chatgpt gpt large-language-models
Language:Python 4939
apache / lucene-solr
Apache Lucene and Solr open-source search software
backend information-retrieval java lucene nosql search search-engine solr
4374
KittyKatt / screenFetch
Fetches system/theme information in terminal for Linux desktop screenshots.
shell bash desktop information-retrieval
Language:Shell 4007
SylphAI-Inc / AdalFlow
AdalFlow: The library to build & auto-optimize LLM applications.
agent framework llm rag generative-ai machine-learning nlp python retriever ai chatbot information-retrieval question-answering summarization bm25 faiss reranker optimizer trainer auto-prompting
Language:Python 3701
langroid
langroid / langroid
Harness LLMs with Multi-Agent Programming
agents chatgpt gpt gpt-4 gpt4 language-model llm llm-agent multi-agent-systems openai-api ai llm-framework llama local-llm function-calling information-retrieval rag retrieval-augmented-generation
Language:Python 3697
catalyst-team / catalyst
Accelerated deep learning R&D
deep-learning reinforcement-learning machine-learning computer-vision pytorch python distributed-computing infrastructure research reproducibility image-processing image-classification image-segmentation object-detection natural-language-processing text-classification text-segmentation information-retrieval recommender-system metric-learning
Language:Python 3360
apache / lucene
Apache Lucene open-source search software
lucene search nosql java backend search-engine information-retrieval
Language:Java 3144
embeddings-benchmark / mteb
MTEB: Massive Text Embedding Benchmark
benchmark clustering information-retrieval sentence-transformers sts text-embedding retrieval neural-search semantic-search sbert sgpt text-classification bitext-mining reranking multilingual-nlp mteb
Language:Python 2837
tensorflow / ranking
Learning to Rank in TensorFlow
ranking machine-learning deep-learning information-retrieval learning-to-rank recommender-systems
Language:Python 2782
StringZilla
ashvardanian / StringZilla
Up to 100x faster strings for C, C++, CUDA, Python, Rust, Swift, JS, & Go, leveraging NEON, AVX2, AVX-512, SVE, GPGPU, & SWAR to accelerate search, hashing, sorting, edit distances, sketches, and memory ops 🦖
simd csv dataset ndjson string string-manipulation string-matching substring information-retrieval sorting-algorithms common-crawl json laion pattern-recognition string-parsing string-search parser beautifulsoup html
Language:C 2681
rajkumardusad / IP-Tracer
Track any ip address with IP-Tracer. IP-Tracer is developed for Linux and Termux. you can retrieve any ip address information using IP-Tracer.
information-retrieval information-gathering termux-tool ip-location termux-hacking ip-tracer linux gnuroot-debian termux linux-tools hacking-tool hacking-tools ip-geolocation
Language:PHP 2606
InvoiceNet
naiveHobo / InvoiceNet
Deep neural network to extract intelligent information from invoice documents.
invoice invoice-management invoices invoice-insight classification deep-learning deep-neural-networks deeplearning keras keras-tensorflow keras-neural-networks invoice-pdf invoice-parser invoice-software information-retrieval information-extraction billing
Language:Python 2585
illuin-tech / colpali
The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.
colpali information-retrieval retrieval-augmented-generation vision-language-model colqwen2 colsmol
Language:Python 2206
xlang-ai / instructor-embedding
[ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings
embeddings information-retrieval language-model text-classification text-clustering text-embedding text-evaluation text-semantic-similarity prompt-retrieval text-reranking
Language:Python 2004
Awesome-FL
youngfish42 / Awesome-FL
Comprehensive and timely academic information on federated learning (papers, frameworks, datasets, tutorials, workshops)
awesome deep-learning federated-learning graph-neural-networks machine-learning tabular-data federated-learning-framework computer-vision knowledge-graph paper security natural-language-processing information-retrieval data-mining database system artificial-intelligence efficiency privacy graph
Language:Python 1818
pyserini
castorini / pyserini
Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
information-retrieval
Language:Python 1796
beir
beir-cellar / beir
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
benchmark bert colbert dataset deep-learning dpr elasticsearch information-retrieval llm nlp passage-retrieval pytorch question-generation rag retrieval retrieval-models sbert sentence-transformers zero-shot-retrieval
Language:Python 1769
shaoxiongji / knowledge-graphs
A collection of research on knowledge graphs
commonsense cross-modal dialogue-systems information-retrieval knowledge-graph knowledge-graph-completion meta-relational-learning natural-language-processing ner paper question-answering reasoning recommendation-systems relation-extraction representation-learning survey temporal-knowledge-graph
Language:JavaScript 1764
fastRAG
IntelLabs / fastRAG
Efficient Retrieval Augmentation and Generation Framework
nlp benchmark colbert information-retrieval semantic-search sentence-transformers summarization transformers diffusion knowledge-graph multi-modal question-answering generative-ai llm
Language:Python 1666
boudinfl / pke
Python Keyphrase Extraction module
computational-linguistics information-retrieval keyphrase keyphrase-extraction keyword keyword-extraction natural-language-processing python
Language:Python 1582
th3unkn0n / TeleGram-Scraper
telegram group scraper tool. fetch all information about group members
information-gathering information-retrieval linux promotion python3 smsbomber telegram telegram-scraper telegram-scraper-bot termux termux-tool
Language:Python 1525
SimSIMD
ashvardanian / SimSIMD
Up to 200x Faster Dot Products & Similarity Metrics — for Python, Rust, C, JS, and Swift, supporting f64, f32, f16 real & complex, i8, and bit vectors using SIMD for both AVX2, AVX-512, NEON, SVE, & SVE2 📐
arm-neon arm-sve assembly avx2 distance-calculation metrics neon simd simd-instructions information-retrieval numpy scipy similarity-measures similarity-search vector-search avx512 blas blas-libraries float16 bfloat16
Language:C 1487
th3unkn0n / osi.ig
Information Gathering Instagram.
python python3 instagram instagram-scraper information-gathering osint information-retrieval scraper termux-tool termux linux
Language:Python 1374
apache / solr
Apache Solr open-source search software
backend information-retrieval java lucene nosql search search-engine solr
Language:Java 1357
dorianbrown / rank_bm25
A Collection of BM25 Algorithms in Python
algorithm bm25 information-retrieval ranking
Language:Python 1239
xhluca / bm25s
Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
bm25 bm25-l bm25-plus lexical-search retrieval robertson search okapi-bm25 rag information-retrieval
Language:Python 1100
anserini
castorini / anserini
Anserini is a Lucene toolkit for reproducible information retrieval research
information-retrieval lucene
Language:Java 1050