vdaas / vald

Vald. A Highly Scalable Distributed Vector Search Engine

Home Page:https://vald.vdaas.org

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

License: Apache 2.0 release Go Reference Codacy Badge Go Report Card DepShield Badge FOSSA Status DeepSource DeepSource CLA Artifact Hub Slack Twitter

What is Vald?

Vald is a highly scalable distributed fast approximate nearest neighbor (ANN) dense vector search engine.

Vald is designed and implemented based on Cloud-Native architecture.

Vald has automatic vector indexing and index backup, and horizontal scaling which made for searching from billions of feature vector data.

Vald is easy to use, feature-rich and highly customizable as you needed.

It uses the fastest ANN Algorithm NGT to search neighbors.

(If you are interested in ANN benchmarks, please refer to ann-benchmarks.com.)

For more information, please refer to Official Web Site.

Vald can handle any object data, image, audio processing, video, text, binary, or etc., if converting to the vector, and be used for:

  • Recognition
  • Recommendation
  • Detecting
  • Grammar checker
  • Real-time translator
  • anything you want to do!

Requirements

  • Kubernetes 1.19~
  • AVX2 instructions (required by Vald Agent NGT)

Get Started

Go to Get Started page to try out Vald !

Installation

Using Helm

helm repo add vald https://vald.vdaas.org/charts
helm install vald-cluster vald/vald

If you use the default values.yaml, the nightly images will be installed.

Using Helm-operator

Please refer to vald-helm-operator.

Components

Component Docker image latest image nightly image
Agent NGT
Agent Sidecar
Discoverer
Gateways






Index Manager
Helm Operator

Docker images tagging policy:

  • nightly ... latest build of main branch
  • vX.X.X ... released versions
  • latest ... latest build of release versions
  • stable ... latest long-term supported version

Tools

  • SDK: Official client libraries
  • Demo: Demo repository using sample data

Vald Users

LY jpsearch

Contribution

Please read the contribution guide.

Before your first commit to this repository, it is strongly recommended to run the commands below.

git clone https://github.com/vdaas/vald && cd vald
make init

Contributors

All Contributors

Thanks goes to these wonderful people (emoji key):

Yusuke Kato
Yusuke Kato

πŸ’» 🎨 🚧 πŸ“†
Rintaro Okamura
Rintaro Okamura

πŸ’» πŸ“– 🚧 πŸ“¦
Kosuke Morimoto
Kosuke Morimoto

πŸ’» πŸ’‘ πŸ”§ ⚠️
Kiichiro YUKAWA
Kiichiro YUKAWA

πŸ“– 🚧 ⚠️ βœ…
datelier
datelier

πŸ’» πŸ€”
Kevin Diu
Kevin Diu

πŸ“– πŸ’‘ ⚠️ βœ…
Hiroto Funakoshi
Hiroto Funakoshi

πŸ“– πŸ”§ ⚠️ βœ…
taisho
taisho

🎨 πŸ“– πŸ’‘
Pierre Grimaud
Pierre Grimaud

πŸ“–
Omer Katz
Omer Katz

πŸ“– βœ…
Koichi Shiraishi
Koichi Shiraishi

️️️️♿️
Siyuan Liu
Siyuan Liu

️️️️♿️ πŸ’‘
David Calvert
David Calvert

πŸ“–
takuyaymd
takuyaymd

πŸ› πŸ’» 🚧
junsei-ando
junsei-ando

πŸ“–
Yusuke Kadowaki
Yusuke Kadowaki

πŸ’» ⚠️
aknishid
aknishid

πŸ’» 🚧
Hrichik Mazumder
Hrichik Mazumder

πŸ“–

LICENSE

Vald released under Apache 2.0 license, refer LICENSE file.

FOSSA Status

About

Vald. A Highly Scalable Distributed Vector Search Engine

https://vald.vdaas.org

License:Apache License 2.0


Languages

Language:Go 93.7%Language:Rust 3.8%Language:Makefile 1.2%Language:Mustache 0.6%Language:Dockerfile 0.6%Language:C++ 0.1%Language:C 0.0%Language:Shell 0.0%Language:Smarty 0.0%