chenjian's repositories
FastDeploy
⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit
attention-is-all-you-need-pytorch
A PyTorch implementation of the Transformer model in "Attention is All You Need".
awesome-chatgpt-prompts
This repo includes ChatGPT prompt curation to use ChatGPT better.
awesome-chatgpt-prompts-zh
ChatGPT 中文调教指南。各种场景使用指南。学习怎么让它听你的话。
ChatGLM-6B
ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型
ChatGLM-Tuning
一种平价的chatgpt实现方案, 基于ChatGLM-6B + LoRA
cocoapi
COCO API - Dataset @ http://cocodataset.org/
cutlass
CUDA Templates for Linear Algebra Subroutines
fastdeploy-api
API docs for FastDeploy
FasterTransformer
Transformer related optimization, including BERT, GPT
flash-attention
Fast and memory-efficient exact attention
GLM
GLM (General Language Model)
grpc
The C based gRPC (C++, Python, Ruby, Objective-C, PHP, C#)
gunicorn
gunicorn 'Green Unicorn' is a WSGI HTTP Server for UNIX, fast clients and sleepy applications.
ItChat
A complete and graceful API for Wechat. 微信个人号接口、微信机器人及命令行微信，三十行即可自定义个人号机器人。
Medusa
Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
openwechat
golang微信SDK
Paddle2ONNX
ONNX Model Exporter for PaddlePaddle
PaddleClas
A treasure chest for visual recognition powered by PaddlePaddle
python_backend
Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.
react-promise-tracker
Simple promise tracker React Hook and Hoc. https://lemoncode.github.io/react-promise-tracker/
TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
text-generation-inference
Large Language Model Text Generation Inference
VisualDL
Deep Learning Visualization Toolkit（『飞桨』深度学习可视化工具 ）
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs