yuzc19

yuzc19.github.io

Personal homepage for Zichun Yu

BioLAMA-1

EMNLP'2021: Can Language Models be Biomedical Knowledge Bases?

dataset-recommendation-pub

FiD

Fusion-in-Decoder

LM-BFF

ACL'2021: LM-BFF: Better Few-shot Fine-tuning of Language Models

OOP_QA

OOP QAList

pet

This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference"

Ray-tracing-engine

SimCSE

EMNLP'2021: SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821

unifiedqa

UnifiedQA: Crossing Format Boundaries With a Single QA System

WA-AC

This repository is used to save algorithm learning materials.

zcore-tests

Test scripts for zCore OS

dclm

DataComp for Language Models

doremi

Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets

galactic

data cleaning and curation for unstructured text

lit-gpt

Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

lm-evaluation-harness

A framework for few-shot evaluation of language models.

Megatron-LM

Ongoing research training transformer models at scale

NeMo-Curator

Scalable data pre processing and curation toolkit for LLMs

Pai-Megatron-Patch

The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.

SemDeDup

Code for "SemDeDup", a simple method for identifying and removing semantic duplicates from a dataset (data pairs which are semantically similar, but not exactly identical).