MrBananaHuman

CounselGPT

한국어 심리 상담 데이터셋

KorGPT2Tutorial

Tutorial for pretraining Korean GPT-2 model

PangyoCorpora

open-korean-instructions

언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.

UnethicalQuestionsKor

Voice2Facemesh

Awesome-LLM-Tabular

Awesome-LLM-Tabular: a curated list of Large Language Model applied to Tabular Data

Ko-En_dictionary

KoChatGPT

ChatGPT의 RLHF를 학습을 위한 3가지 step별 한국어 데이터셋

NengoProject

Spiking Neural Network Model using Nengo

ru-dalle

Generate images from texts. In Russian

S2APLER

S2APLER: S2 Agglomeration of Papers with Low Error Rate (it's for academic paper clustering)

2021_NLP_Project

es-gpt

evolve-instruct

evolve llm training instruction, from english instruction to any language.

GPEN

ko-flan

한국어 FLAN 데이터 구축과 모델 학습을 위한 프로젝트

korean_smile_style_dataset

language-model

한국어 언어 모델 학습을 위한 프로젝트(Flax, Pytorch with Huggingface Accelerate)

lassl

Easy Language Model Pretraining leveraging Huggingface's Transformers and Datasets

LLM-Pruner

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support LLaMA, Llama-2, BLOOM, Vicuna, Baichuan, etc.

multilingual-transfer

Multi-lingual transfer experiments

odqa_baseline_code

Baseline code for Korean open domain question answering(ODQA)

Parsr

Transforms PDF, Documents and Images into Enriched Structured Data

StyleGAN-nada

textlesslib

Library for Textless Spoken Language Processing

tppys

Text processing by pyspark (just sample project)

unsloth

5X faster 60% less memory QLoRA finetuning

vision-transformer-tf

Reproduction of Vision Transformer in Tensorflow2. Train from scratch and Finetune.

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.