StyxXuan

InfiAgent

lagent

A lightweight framework for building LLM-based agents

fusion_bench

FusionBench: A Comprehensive Benchmark of Deep Model Fusion

lm-evaluation-harness

A framework for few-shot evaluation of language models.

evalplus

Rigourous evaluation of LLM-synthesized code - NeurIPS 2023

OpenFedLLM

LoRAMoE

LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment

Multi-LoRA-Composition

Repository for the Paper "Multi-LoRA Composition for Image Generation"

stylus

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

dreambooth

MoLE

magicoder

Magicoder: Source Code Is All You Need

Qwen

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

url-nlp

manim

A community-maintained Python framework for creating mathematical animations.

phatgoose

Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"

BLoRA

batched loras

MOELoRA-peft

[SIGIR'24] The official implementation code of MOELoRA.

open-interpreter

A natural language interface for computers

mixture-of-experts

PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538

OpenMoE

A family of open-sourced Mixture-of-Experts (MoE) Large Language Models

xlora

X-LoRA: Mixture of LoRA Experts

FederatedGPT-Shepherd

Shepherd: A foundational framework enabling federated instruction tuning for large language models

plot_demo

论文里可以用到的实验图示例

TuPaTE

Code for EMNLP 2022 paper "Efficiently Tuned Parameters are Task Embeddings"

mLoRA

An Efficient "Factory" to Build Multiple LoRA Adapters

OpenNE

An Open-Source Package for Network Embedding (NE)

awesome-mixture-of-experts

A collection of AWESOME things about mixture-of-experts

lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs