kebe7jun

UTM

Virtual machines for iOS and macOS

MInference

To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.

s3fs-fuse

FUSE-based file system backed by Amazon S3

memtierd

glasskube

🧊 The next generation Package Manager for Kubernetes 📦 Featuring a GUI and a CLI. Glasskube packages are dependency aware, GitOps ready and can get automatic updates via a central public package repository.

gradio

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

gpu-optimization-workshop

Slides, notes, and materials for the workshop

AIOS

AIOS: LLM Agent Operating System

gogo

面向红队的, 高度可控可拓展的自动化引擎

llama-fs

A self-organizing file system with llama 3

LlamaEdge

The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

amber

💎 Amber the programming language compiled to bash

ydb

YDB is an open source Distributed SQL Database that combines high availability and scalability with strong consistency and ACID transactions

stable-diffusion-webui-distributed

Chains stable-diffusion-webui instances together to facilitate faster image generation.

textbee

textbee.dev is an opensource and free sms-gatway for sending SMS messages through API or dashboard web interface.

triton

Development repository for the Triton language and compiler

llama3-from-scratch

llama3 implementation one matrix multiplication at a time

LLMBook-zh.github.io

《大语言模型》作者：赵鑫，李军毅，周昆，唐天一，文继荣

continue

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

unsloth

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

HunyuanDiT

Hunyuan-DiT : A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understanding

nut.js

Native UI testing / controlling with node

inpaint-web

A free and open-source inpainting & image-upscaling tool powered by webgpu and wasm on the browser。| 基于 Webgpu 技术和 wasm 技术的免费开源 inpainting & image-upscaling 工具, 纯浏览器端实现。

it-tools

Collection of handy online tools for developers, with great UX.

hai-platform

一种任务级GPU算力分时调度的高性能深度学习训练平台

torchtune

A Native-PyTorch Library for LLM Fine-tuning

zed

Code at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.

lkl-js

Run Linux kernel in your web browser directly

Webpilot

pyelftools

Parsing ELF and DWARF in Python