yuriak

AutoAgents

[IJCAI 2024] Generate different roles for GPTs to form a collaborative entity for complex tasks.

LLaSM

第一个支持中英文双语语音-文本多模态对话的开源可商用对话模型。便捷的语音输入将大幅改善以文本为输入的大模型的使用体验，同时避免了基于 ASR 解决方案的繁琐流程以及可能引入的错误。

LLMsPracticalGuide

A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

promptsource

Toolkit for creating, sharing and using natural language prompts.

large-qa-datasets

A collection of large question answering datasets

Firefly

Firefly: 大模型训练工具，支持训练Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

Large-Audio-Models

Keep track of big models in audio domain, including speech, singing, music etc.

awesome-instruction-datasets

A collection of awesome-prompt-datasets, awesome-instruction-dataset, to train ChatLLM such as chatgpt 收录各种各样的指令数据集, 用于训练 ChatLLM 模型。

zeno-build

Build, evaluate, understand, and fix LLM-based apps

Awesome-instruction-tuning

A curated list of awesome instruction tuning datasets, models, papers and repositories.

Reading_groups

A paper & resource list of large language models, including course, paper, demo, figures

Awesome-LLM

This project collects awesome resources (e.g., papers, open-source models) for large language model (LLM)

Awesome-LLM

Awesome-LLM: a curated list of Large Language Model

helm

Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in Holistic Evaluation of Text-to-Image Models (HEIM) (https://arxiv.org/abs/2311.04287).

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Chinese-Llama-2

improve Llama-2's proficiency in comprehension, generation, and translation of Chinese.

audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

asr-evaluation

Python module for evaluating ASR hypotheses (e.g. word error rate, word recognition rate).

speech-to-speech

Code for the INTERSPEECH 2023 paper "Learning When to Speak: Latency and Quality Trade-offs for Simultaneous Speech-to-Speech Translation with Offline Models"

MoE-Waitk

Code for EMNLP 2021 oral paper "Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy"

Wait-info

Source code for our EMNLP 2022 paper "Wait-info Policy: Balancing Source and Target at Information Level for Simultaneous Machine Translation"

Dual-Path

Code for ACL 2022 main conference paper "Modeling Dual Read/Write Paths for Simultaneous Machine Translation"

simulst

PyTorch toolkit for streaming speech recognition, speech translation and simultaneous translation based on fairseq.

awesome-speech-translation

Stream-level_Latency_Evaluation_for_Simultaneous_Machine_Translation

This repository contains the code of the paper "Stream-level Latency Evaluation for Simultaneous Machine Translation".

Awesome-Simultaneous-Translation

Paper list of simultaneous translation / streaming translation, including text-to-text machine translation and speech-to-text translation.

AlignLLMHumanSurvey

Aligning Large Language Models with Human: A Survey

CMMLU

CMMLU: Measuring massive multitask language understanding in Chinese

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

annotated_deep_learning_paper_implementations

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠