Trangle Heshvp's repositories
minerva
Minerva: a fast and flexible tool for deep learning. It provides ndarray programming interface, just like Numpy. Python bindings and C++ bindings are both available. The resulting code can be run on CPU or GPU. Multi-GPU support is very easy. Please refer to the examples to see how multi-GPU setting is used.
alpaca_eval
An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
awesome-pretrained-chinese-nlp-models
Awesome Pretrained Chinese NLP Models,高质量中文预训练模型&大模型&多模态模型&大语言模型集合
DeepLearning
深度学习入门教程, 优秀文章, Deep Learning Tutorial
EQ-Bench
A benchmark for emotional intelligence in large language models
FastGPT
FastGPT is a knowledge-based question answering system based on the LLM language model, providing out-of-the-box capabilities for data processing, model invocation, and more. It also allows for complex question answering scenarios through visual workflow orchestration using Flow!
flashinfer
FlashInfer: Kernel Library for LLM Serving
kubernetes
Container Cluster Manager
LLM-Blender
[ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the diverse strengths of multiple open-source LLMs. LLM-Blender cut the weaknesses through ranking and integrate the strengths through fusing generation to enhance the capability of LLMs.
lmdeploy-dev
lmdeploy-dev
peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
PiPPy
Pipeline Parallelism for PyTorch
pubmed-mapper
PubMed Mapper: A Python library that map PubMed XML to Python object
qmk_firmware
Open-source keyboard firmware for Atmel AVR and Arm USB families
sglang
SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with LLMs faster and more controllable.
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.