flaneur2020

ollama

Get up and running with Llama 3, Mistral, Gemma, and other large language models.

k9s

🐶 Kubernetes CLI To Manage Your Clusters In Style!

llamafile

Distribute and run LLMs with a single file.

mlx

MLX: An array framework for Apple silicon

text-generation-inference

Large Language Model Text Generation Inference

transformers.js

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

litgpt

Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.

tiny-rdm

A Modern Redis GUI Client

vulkano

Safe and rich Rust wrapper around the Vulkan API

aichat

All-in-one AI-Powered CLI Chat & Copilot that integrates 20+ AI platforms, including OpenAI, Azure-OpenAI, Gemini, Claude, Mistral, Cohere, VertexAI, Bedrock, Ollama, Ernie, Qianwen, Deepseek...

xsimd

C++ wrappers for SIMD intrinsics and parallelized, optimized mathematical functions (SSE, AVX, AVX512, NEON, SVE))

ash

Vulkan bindings for Rust

mistral.rs

Blazingly fast LLM inference.

auto-commit

A CLI tool that automatically writes commit messages for you.

how-to-optim-algorithm-in-cuda

how to optimize some algorithm in cuda.

llama2.rs

A fast llama2 decoder in pure Rust.

rknn-toolkit

libriscv

C++20 RISC-V RV32/64/128 userspace emulator library

clip.cpp

CLIP inference in plain C/C++ with no extra dependencies

ratchet

A cross-platform browser ML framework.

wgsl-analyzer

a language server implementation for the WGSL shading language

calm

CUDA/Metal accelerated language model inference

ruapu

Detect CPU features with single-file

rvscript

Fast RISC-V-based scripting backend for game engines

fast-llm.rs

FastGEMV

High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.

hugo-shopping-product-catalogue-simple

Hugo theme for shopping product catalogue

ggblas

mkdocs-obsidian-bridge

An MkDocs plugin that helps exporting your Obsidian vault as an MkDocs site.

golasticdump

tool for moving elasticsearch data written in golang