AI search on the edge
- Seeing if I can use rustformers/llm for target="wasm32-unknown-unknown", rustformers/llm#193
- Problem with embeddings from rustformers/llm, rustformers/llm#288
- Select basic rust ANN library and/or server: Using Qdrant for now
- Bundle and run locally
- Check if we need to Webassembly run on Cloudflare workers
- Get Cloudflare account
- Possible storage compression
- Possible edge storage for large fields
- Best way to run model on edge
- How to make model smaller
- Transformer size
- Sparsity reduction
- Ideal beta customers
- Auth