FL33TW00D

whisper-turbo

Cross-Platform, GPU Accelerated Whisper 🏎️

laserbeak

Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU

embd

GPU accelerated client-side embeddings for vector search, RAG etc.

wgpu-mm

wgpu-bench

wgpu-tensor

wgpu

Safe and portable GPU abstraction in Rust, implementing WebGPU API.

candle

Minimalist ML framework for Rust

FL33TW00D

modcomp

Can you compress ML models with traditional compression? Answer: No

ogs_repro

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

tfjs-mm

voy

🕸️🦀 A WASM vector similarity search written in Rust

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

whisper.cpp

Port of OpenAI's Whisper model in C/C++

burn

Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

cargo-instruments

A cargo plugin to generate Xcode Instruments trace files

embed-bench

ffmpeg.wasm

FFmpeg for browser, powered by WebAssembly

hf-hub

Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package

mel-spec

Rust library for whisper.cpp compatible Mel spectrograms

metal-flash-attention

Faster alternative to Metal Performance Shaders

naga

Universal shader translation in Rust

onnx

Open standard for machine learning interoperability

rodio

Rust audio playback library

setup-ffmpeg

Set up your GitHub Actions workflow with ffmpeg

tract

Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

wasm-bindgen

Facilitating high-level interactions between Wasm modules and JavaScript