SiyangShao

ollama

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

frp

A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.

open-webui

User-friendly WebUI for AI (Formerly Ollama WebUI)

ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

typst

A new markup-based typesetting system that is powerful and easy to learn.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

comprehensive-rust

This is the Rust course used by the Android team at Google. It provides you the material to quickly teach Rust.

llama3

The official Meta Llama 3 GitHub site

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

LunarVim

🌙 LunarVim is an IDE layer for Neovim. Completely free and community driven.

yapf

A formatter for Python files

kitex

Go RPC framework with high-performance and strong-extensibility for building micro-services.

streaming-llm

[ICLR 2024] Efficient Streaming Language Models with Attention Sinks

ccf-deadlines

⏰ Collaboratively track deadlines of conferences recommended by CCF (Website, Python Cli, Wechat Applet) / If you find it useful, please star this project, thanks~

sglang

SGLang is a fast serving framework for large language models and vision language models.

hertz

Go HTTP framework with high-performance and strong-extensibility for building micro-services.

crab

A community fork of a language named after a plant fungus. All of the memory-safe features you love, now with 100% less bureaucracy!

arco-design

A comprehensive React UI components library based on Arco Design

transformer-debugger

dbg-macro

A dbg(…) macro for C++

kactl

KTH Algorithm Competition Template Library (... eller KTHs AC-tillverkande lapp)

fluid

Fluid, elastic data abstraction and acceleration for BigData/AI applications in cloud. (Project under CNCF)

rCore-Tutorial-v3

Let's write an OS which can run on RISC-V in Rust from scratch!

an-anime-game-launcher

An Anime Game launcher for Linux with telemetry disabling

latex-action

:octocat: GitHub Action to compile LaTeX documents

Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

the-honkers-railway-launcher

The Honkers Railway launcher for Linux with automatic patching and telemetry disabling

write-you-a-vector-db

A Vector Database Tutorial (over CMU-DB's BusTub system)

ServerlessLLM

Scalable and Efficient Serverless Deployment for Large AI Models.

sleepy-launcher

Sleepy game launcher for Linux with telemetry disabling