lucky521

followers

following

stars

Beijing

https://lucky521.github.io

Organizations

ludolph

Lu.dev's starred repositories

Qwen

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

Language:PythonApache-2.01311000

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Language:PythonApache-2.0399000

onnx-tensorrt

ONNX-TensorRT: TensorRT backend for ONNX

Language:C++Apache-2.0289400

text-generation-inference

Large Language Model Text Generation Inference

Language:PythonApache-2.0865400

iree

A retargetable MLIR-based machine learning compiler and runtime toolkit.

Language:C++Apache-2.0254700

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

Language:C++Apache-2.0802300

langchain

🦜🔗 Build context-aware reasoning applications

Language:Jupyter NotebookMIT9134300

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

Language:PythonMIT6669400

flash-attention

Fast and memory-efficient exact attention

Language:PythonBSD-3-Clause1313200

ChatGLM-6B

ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

Language:PythonApache-2.04031000

chatglm.cpp

C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)

Language:C++MIT289300

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Language:PythonApache-2.02554900

fastllm

纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行

Language:C++Apache-2.0327100

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Language:PythonApache-2.03626900

whisper.cpp

Port of OpenAI's Whisper model in C/C++

Language:CMIT3405800

llama.cpp

LLM inference in C/C++

Language:C++MIT6417300

the-algorithm-ml

Source code for Twitter's Recommendation Algorithm

Language:PythonAGPL-3.01002100

the-algorithm

Source code for Twitter's Recommendation Algorithm

Language:ScalaAGPL-3.06196600

icinga2

The core of our monitoring platform with a powerful configuration language and REST API.

Language:C++GPL-2.0199000

canal

阿里巴巴 MySQL binlog 增量订阅&消费组件

Language:JavaApache-2.02828500

netty

Netty project - an event-driven asynchronous network application framework

Language:JavaApache-2.03321400

paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

Language:JavaApache-2.0225200

jna

Java Native Access

Language:JavaNOASSERTION844700

feathr

Feathr – A scalable, unified data and AI engineering platform for enterprise

Language:ScalaApache-2.0196400

OpenMLDB

OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.

Language:C++Apache-2.0158000

tispark

TiSpark is built for running Apache Spark on top of TiDB/TiKV

Language:ScalaApache-2.087900

hive

Apache Hive

Language:JavaApache-2.0547500

fold

Deep learning with dynamic computation graphs in TensorFlow

Language:PythonApache-2.0182400

TensorLayer

Deep Learning and Reinforcement Learning Library for Scientists and Engineers

Language:PythonNOASSERTION731500

openmlsys-zh

《Machine Learning Systems: Design and Implementation》- Chinese Version

Language:TeX393000