Try Vectors from Project Panama for vector similarity computations
alexklibisz opened this issue · comments
Background
JEP 338 aka "Project Panama" introduces new SIMD-friendly vector types to the JVM. Maybe we can use them to speed up Elastiknn?
Some resources:
- https://richardstartin.github.io/posts/vector-api-dot-product
- https://openjdk.org/jeps/338
- https://twitter.com/denis_makogon/status/1574833677368020992
Deliverables
- Re-implement all dense vector similarity and distance computations using jdk.incubator.vector.
- Make the new implementation optional, off by default.
Related Issues
Anything with the performance label.
The first pass of this was finished in #496