nzjin's starred repositories
DeepSeek-MoE
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
Switch-NeRF
Codes for Switch-NeRF (ICLR 2023)
awesome_moe
The collections of MOE (Mixture Of Expert) papers, code and tools, etc.
Chinese-Mixtral-8x7B
中文Mixtral-8x7B(Chinese-Mixtral-8x7B)
mixture-of-experts
A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models
flash-attention
Fast and memory-efficient exact attention
LLaMA-Factory
A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
Awesome-Chinese-LLM
整理开源的中文大语言模型,以规模较小、可私有化部署、训练成本较低的模型为主,包括底座模型,垂直领域微调及应用,数据集与教程等。
LLM-Agent-Paper-List
The paper list of the 86-page paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.
Open_WikiTable
Open-WikiTable :Dataset for Open Domain Question Answering with Complex Reasoning over Table
TestSuiteEval
"Semantic Evaluation for Text-to-SQL with Distilled Test Suite", EMNLP2020