jongwooko

Jongwoo Ko's repositories

distillm

Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)

Language:Python198 7 11

Pytorch-MiniLM

Unofficial Pytorch implementation of MiniLM and MiniLMv2

Language:Python2103

NASH-Pruning-Official

About Code for the paper "NASH: A Simple Unified Framework of Structured Pruning for Accelerating Encoder-Decoder Language Models" (EMNLP 2023 Findings)

Language:PythonMIT15 20

ALASCA

Code for the paper "A Gift from Label Smoothing: Robust Training with Adaptive Label Smoothing via Auxiliary Classifier under Label Noise" (AAAI 2023)

Language:Python9 20

IMDGP

Ko, Jongwoo, and Heeyoung Kim. "Deep Gaussian Process Models for Integrating Multifidelity Experiments with Non-stationary Relationships." IISE Transactions just-accepted (2021): 1-28.

Language:Python4 10

MUSC

Code for the paper "Synergy with Translation Artifacts for Training and Inference in Multilingual Tasks" (EMNLP 2022)

Language:Python2 10

CR-ILD

About Code for the paper "Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective" (EACL 2023 Findings)

Language:Python1 10