unix1986's repositories
Awesome-ChatGPT
ChatGPT资料汇总学习，持续更新......
backend
Common source, scripts and utilities for creating Triton backends.
BMCook
Model Compression for Big Models
BMInf
Efficient Inference for Big Models
BMTrain
Efficient Training (including pre-training and fine-tuning) for Big Models
ChatGLM-6B
ChatGLM-6B：开源双语对话语言模型 | An Open Bilingual Dialogue Language Model
CPM-Live
Live Training for Open-source Big Models
dataease
人人可用的开源数据可视化分析工具。
EasyRec
A framework for large scale recommendation algorithms.
FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
flash-attention
Fast and memory-efficient exact attention
gpt4free
decentralising the Ai Industry, just some language model api's...
gptq
Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".
incubator-brpc
brpc is an Industrial-grade RPC framework using C++ Language, which is often used in high performance system such as Search, Storage, Machine learning, Advertisement, Recommendation etc. "brpc" means "better RPC".
learn-cuda
A complete CUDA tutorial ranging from first GPU programs to advanced asynchronous methods
lightllm
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
llama.cpp
LLM inference in C/C++
LLMSpeculativeSampling
Fast inference from large lauguage models via speculative decoding
MatrixSlow
A simple deep learning framework in pure python for purpose of learning in DL
MOSS
An open-source tool-augmented conversational language model from Fudan University
openai-python
The official Python library for the OpenAI API
OpenDelta
A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
ossinsight
Open Source Software Insights - Analysis, Comparison, Trends, Rankings of Open Source Software. Follow us on Twitter: https://twitter.com/ossinsight
Paddle
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）
PaddleHub
Awesome pre-trained models toolkit based on PaddlePaddle. (400+ models including Image, Text, Audio, Video and Cross-Modal with Easy Inference & Serving)
Qwen-7B
The official repo of Qwen-7B (通义千问-7B) chat & pretrained large language model proposed by Alibaba Cloud.
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
uvicorn
An ASGI web server, for Python. 🦄
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs