Lei Chen (grok-phantom)

grok-phantom

Geek Repo

Company:Sensetime

Location:Shanghai

Github PK Tool:Github PK Tool

Lei Chen's starred repositories

excalidraw

Virtual whiteboard for sketching hand-drawn like diagrams

Language:TypeScriptLicense:MITStargazers:81437Issues:400Issues:3514

llama.cpp

LLM inference in C/C++

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Language:PythonLicense:Apache-2.0Stargazers:34814Issues:343Issues:2729

gpt-pilot

The first real AI developer

Language:PythonLicense:NOASSERTIONStargazers:29910Issues:264Issues:514

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Language:PythonLicense:Apache-2.0Stargazers:27076Issues:227Issues:4517

python-fire

Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.

Language:PythonLicense:NOASSERTIONStargazers:26903Issues:369Issues:318

ml-stable-diffusion

Stable Diffusion with Core ML on Apple Silicon

Language:PythonLicense:MITStargazers:16682Issues:137Issues:246

candle

Minimalist ML framework for Rust

Language:RustLicense:Apache-2.0Stargazers:15179Issues:150Issues:671

horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Language:PythonLicense:NOASSERTIONStargazers:14170Issues:334Issues:2241

rust-by-practice

Learning Rust By Practice, narrowing the gap between beginner and skilled-dev through challenging examples, exercises and projects.

Language:RustLicense:CC-BY-4.0Stargazers:12025Issues:73Issues:183

triton

Development repository for the Triton language and compiler

single_file_libs

List of single-file C/C++ libraries.

nicegui

Create web-based user interfaces with Python. The nice way.

Language:PythonLicense:MITStargazers:8878Issues:68Issues:991

text-generation-inference

Large Language Model Text Generation Inference

Language:PythonLicense:Apache-2.0Stargazers:8791Issues:98Issues:1300

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

Language:C++License:Apache-2.0Stargazers:8230Issues:87Issues:1801

orjson

Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy

Language:PythonLicense:Apache-2.0Stargazers:6071Issues:36Issues:415

GPU-Puzzles

Solve puzzles. Learn CUDA.

Language:Jupyter NotebookLicense:MITStargazers:5746Issues:29Issues:30

cutlass

CUDA Templates for Linear Algebra Subroutines

Language:C++License:NOASSERTIONStargazers:5383Issues:103Issues:1068

putting-the-you-in-cpu

A technical explainer by @kognise of how your computer runs programs, from start to finish.

Language:MDXLicense:MITStargazers:4913Issues:31Issues:34

torchtune

A Native-PyTorch Library for LLM Fine-tuning

Language:PythonLicense:BSD-3-ClauseStargazers:3978Issues:45Issues:528

pyinfra

pyinfra turns Python code into shell commands and runs them on your servers. Execute ad-hoc commands and write declarative operations. Target SSH servers, local machine and Docker containers. Fast and scales from one server to thousands.

Language:PythonLicense:MITStargazers:3849Issues:37Issues:766

fairscale

PyTorch extensions for high performance and large scale training.

Language:PythonLicense:NOASSERTIONStargazers:3151Issues:46Issues:359

safetensors

Simple, safe way to store and distribute tensors

Language:PythonLicense:Apache-2.0Stargazers:2765Issues:39Issues:177

iree

A retargetable MLIR-based machine learning compiler and runtime toolkit.

Language:C++License:Apache-2.0Stargazers:2377Issues:84Issues:3522

lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

Language:PythonLicense:Apache-2.0Stargazers:2304Issues:22Issues:178

queueing-theory

Queueing theory: an introduction for software development

awesome-llm-json

Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.

learn_gnuawk

Example based guide to mastering GNU awk

Language:ShellLicense:MITStargazers:1076Issues:15Issues:12

std-training

Embedded Rust on Espressif training material.

Language:RustLicense:Apache-2.0Stargazers:590Issues:15Issues:85

klib

Easy to use Python library of customized functions for cleaning and analyzing data.

Language:PythonLicense:MITStargazers:494Issues:5Issues:24