similarity-search

There are 47 repositories under similarity-search topic.

qdrant
qdrant / qdrant
Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
ai-search ai-search-engine embeddings-similarity hnsw image-search knn-algorithm machine-learning mlops nearest-neighbor-search neural-network neural-search recommender-system search search-engine search-engines similarity-search vector-database vector-search vector-search-engine
Language:Rust 26972
typesense / typesense
Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuzzy Search Engine for building delightful search experiences
algolia datastore elasticsearch enterprise-search faceting full-text-search fuzzy-search geosearch in-memory instantsearch merchandising pinecone search search-engine semantic-search similarity-search site-search synonyms typo-tolerance vector-search
Language:C++ 24652
weaviate
weaviate / weaviate
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database.
search-engine semantic-search semantic-search-engine vector-search vector-search-engine vector-database approximate-nearest-neighbor-search image-search hnsw information-retrieval mlops nearest-neighbor-search neural-search recommender-system similarity-search vectors generative-search hybrid-search weaviate grpc
Language:Go 14974
paradedb / paradedb
The transactional Elasticsearch alternative built on Postgres
aggregations analytics bm25 database elasticsearch full-text-search htap hybrid-search olap postgresql real-time-analytics similarity-search sparse-vector sql
Language:Rust 7923
lancedb / lancedb
Developer-friendly, embedded retrieval engine for multimodal AI. Search More; Manage Less.
approximate-nearest-neighbor-search image-search nearest-neighbor-search recommender-system search-engine semantic-search similarity-search vector-database
Language:Rust 7915
zilliztech / GPTCache
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
chatbot chatgpt chatgpt-api llm milvus similarity-search vector-search aigc openai memcache gpt langchain autogpt redis babyagi llama-index llama dolly semantic-search
Language:Python 7817
USearch
unum-cloud / USearch
Fast Open-Source Search & Clustering engine × for Vectors & Arbitrary Objects × in C++, C, Python, JavaScript, Rust, Java, Objective-C, Swift, C#, GoLang, and Wolfram 🔍
kann vector-search approximate-nearest-neighbor-search simd search similarity-search database faiss search-engine webassembly clustering nearest-neighbor-search recommender-system semantic-search full-text-search fuzzy-search text-search image-search
Language:C++ 3238
chonkie
chonkie-inc / chonkie
🦛 CHONK docs with Chonkie ✨ — The no-nonsense RAG library
ai chonkie chunker chunking-algorithm llms rag retrieval-systems semantic-chunker similarity-search splitting-algorithms text-splitter
Language:Python 3167
gerev
GerevAI / gerev
🧠 AI-powered enterprise search engine 🔎
ai chatgpt confluence enterprise-search helpdesk helpdesk-tools llama-index machine-learning search-engine semantic-search-engine similarity-search sysadmin tech-support technical-support vector-search workplace-search
Language:Python 2809
hora
hora-search / hora
🚀 efficient approximate nearest neighbor search algorithm collections library written in Rust 🦀 .
search-engine rust approximate-nearest-neighbor-search artificial-intelligence recommender-system image-search vector-search algorithm data-structures simd hnsw similarity-search neural-network high-performance machine-learning k-nearest-neighbors rust-sci numeric
Language:Rust 2649
sherlockchou86 / VideoPipe
A cross-platform video structuring (video analysis) framework. If you find it helpful, please give it a star: ) 跨平台的视频结构化（视频分析）框架，觉得有帮助的请给个星星 : )
cv deep-learning object-detection opencv gstreamer video-analysis ai behaviour-analysis similarity-search deepstream face-recognition feature-extraction image-classification image-segmentation license-plate-recognition reid llm openai ollama multimodal-large-language-models
Language:C++ 1855
vald
vdaas / vald
Vald. A Highly Scalable Distributed Vector Search Engine
vald approximate-nearest-neighbor-search kubernetes distributed-systems nearest-neighbor-search vector-search-engine similarity-search image-search image-search-engine vector anng ngt microservices golang cloud cloud-native high-performance high-dimensional-data hacktoberfest
Language:Go 1656
datastax / jvector
JVector: the most advanced embedded vector search engine
ann java knn machine-learning search-engine similarity-search vector-search
Language:Java 1649
SimSIMD
ashvardanian / SimSIMD
Up to 200x Faster Dot Products & Similarity Metrics — for Python, Rust, C, JS, and Swift, supporting f64, f32, f16 real & complex, i8, and bit vectors using SIMD for both AVX2, AVX-512, NEON, SVE, & SVE2 📐
arm-neon arm-sve assembly avx2 distance-calculation metrics neon simd simd-instructions information-retrieval numpy scipy similarity-measures similarity-search vector-search avx512 blas blas-libraries float16 bfloat16
Language:C 1539
currentslab / awesome-vector-search
Collections of vector search related libraries, service and research papers
awesome-list awesome vector similarity-search vector-search-engine nearest-neighbor-search vector-search knn-search machine-learning search-engine
1530
tensorflow / similarity
TensorFlow Similarity is a python package focused on making similarity learning quick and easy.
similarity-learning metric-learning similarity-search nearest-neighbor-search nearest-neighbors deep-learning tensorflow contrastive-learning machine-learning unsupervised-learning clustering python simclr simclr2 barlow-twins simsiam cosine-similarity knn
Language:Python 1022
tantaraio / voy
🕸️🦀 A WASM vector similarity search written in Rust
k-d-tree nearest-neighbor-search similarity-search vector-search wasm webassembly rust wasm-pack
Language:Rust 1005
myscale / MyScaleDB
A @ClickHouse fork that supports high-performance vector search and full-text search.
embedding search-engine sql vector-search vectordb myscaledb sql-vector big-data llm rag ann similarity-search image-search unstructured-analytics
Language:C++ 994
shibing624 / similarities
Similarities: a toolkit for similarity calculation and semantic search. 相似度计算、匹配搜索工具包，支持亿级数据文搜文、文搜图、图搜图，python3开发，开箱即用。
nlp deep-learning pytorch matching text-matching bm25 similarity similarity-search image-search image-similarity faiss search-engine
Language:Python 879
quaterion
qdrant / quaterion
Blazing fast framework for fine-tuning similarity learning models
contrastive-learning cosine-similarity deep-learning knn machine-learning metric-learning nearest-neighbor-search python pytorch pytorch-lightning similarity-learning similarity-search
Language:Python 661
arcadedb
ArcadeData / arcadedb
ArcadeDB Multi-Model Database, one DBMS that supports SQL, Cypher, Gremlin, HTTP/JSON, MongoDB and Redis. ArcadeDB is a conceptual fork of OrientDB, the first Multi-Model DBMS. ArcadeDB supports Vector Embeddings.
database dbms multi-model graph document time-series key-value embedded docker kubernetes k8s distributed arcadedb orientdb search-engine similarity-search vector-database vector-search
Language:Java 606
ekzhu / SetSimilaritySearch
All-pair set similarity search on millions of sets in Python and on a laptop
all-pairs set-similarity-search similarity-search
Language:Python 600
hhblaze / DBreeze
C# .NET NOSQL ( key value, object store embedded TextSearch SemanticSearch Vector layer ) ACID multi-paradigm database management system.
acid android c-sharp clustering database dotnet embedded key net netcore netstandard nosql search search-engine similarity-search text transaction value vector-database xamarin
Language:C# 565
thulab / DeepHash
An Open-Source Package for Deep Learning to Hash (DeepHash)
deep-learning hashing quantization similarity-search
Language:Python 563
rapidsai / cuvs
cuVS - a library for vector search and clustering on the GPU
anns clustering cuda distance gpu information-retrieval llm machine-learning nearest-neighbors neighborhood-methods similarity-search sparse statistics vector-search vector-similarity vector-store
Language:Cuda 562
ChunelFeng / caiss
一款简单好用的跨平台/多语言的相似向量/相似词/相似句高性能检索引擎。欢迎star & fork。Build together! Power another !
ai ann chatbot deep-learning faiss hnsw mrpt nlp search-engine similarity-search
Language:C++ 547
qdrant / awesome-metric-learning
😎 A curated list of awesome practical Metric Learning and its applications
metric-learning awesome-list tutorials survey recommendation-system anomaly-detection semantic-similarity similarity-search
514
CLUEbenchmark / KgCLUE
KgCLUE: 大规模中文开源知识图谱问答
knowledge-graph kbqa qa ner similarity-search
Language:Python 451
m1guelpf / tinyvector
A tiny embedding database in pure Rust.
embeddings embeddings-similarity machine-learning rust search-engines similarity-search vector-database vector-search
Language:Rust 421
vsag
antgroup / vsag
vsag is a vector indexing library used for similarity search.
similarity-search indexing-library ann vector vectordb
Language:C++ 396
alexklibisz / elastiknn
Elasticsearch plugin for nearest neighbor search. Store vectors and run similarity search using exact and approximate algorithms.
nearest-neighbor-search locality-sensitive-hashing elasticsearch elasticsearch-plugin similarity-search lucene embeddings semantic-search neural-search
Language:Scala 391
aquila
Aquila-Network / aquila
An easy to use Neural Search Engine. Index latent vectors along with JSON metadata and do efficient k-NN search.
feature-vectors similarity-search knn-search information-retrieval neural-information-retrieval vector-database approximate-nearest-neighbor-search search-engine nearest-neighbor-search embedding similarity-searches video-search image-search aquila retrieval faiss neural-search information-retrieval-engine
Language:HTML 380
edwinkys / oasysdb
In-memory vector store with efficient read and write performance for semantic caching and retrieval system. Redis for Semantic Caching.
approximate-nearest-neighbors ivfpq mysql open-source postgresql rust similarity-search sqlite vector-database vector-search vectordb
Language:Rust 371
caoyue10 / DeepHash-Papers
Must-read papers on deep learning to hash (DeepHash)
deep-learning hashing quantization similarity-search
323
dangkhoasdc / awesome-vector-database
A curated list of awesome works related to high dimensional structure/vector search & database
search-engine vector-database vector-search nearest-neighbor-search approximate-nearest-neighbor-search embedding-similarity similarity-search vector-search-engine embeddings-similarity
318
derrickburns / generalized-kmeans-clustering
Spark library for generalized K-Means clustering. Supports general Bregman divergences. Suitable for clustering probabilistic data, time series data, high dimensional data, and very large data.
bregman-divergence clustering cosine-similarity embeddings entropy euclidean-distance itakura-saito-divergence k-means kullback-leibler-divergence similarity-search spark spark-mllib
Language:Scala 304