huggingface / ratchet

A cross-platform browser ML framework.

Home Page:https://ratchet.sh

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Demo Site | Discord | Roadmap

A web-first, cross-platform ML developer toolkit


Getting Started

Check out our HuggingFace space for a live demo!

Javascript

// Asynchronous loading & caching with IndexedDB
let model = await Model.load(AvailableModels.WHISPER_TINY, Quantization.Q8, (p: number) => setProgress(p))
let result = await model.run({ input });

Rust

Rust crate & CLI coming soon...

Philosophy

We want a toolkit for developers to make integrating performant AI functionality into existing production applications easy. The following principles will help us accomplish this:

  1. Inference only
  2. WebGPU/CPU only
  3. First class quantization support
  4. Lazy computation
  5. Inplace by default

Supported Models

  • Whisper
  • Coming soon...

About

A cross-platform browser ML framework.

https://ratchet.sh

License:MIT License


Languages

Language:Rust 99.5%Language:Python 0.4%Language:Just 0.1%