friendshipkim

neuron-merging

Neuron Merging: Compensating for Pruned Neurons (NeurIPS 2020)

transformer-from-scratch

transformer-from-scratch

my-first-blog

academic-budget-bert

Repository containing code for "How to Train BERT with an Academic Budget" paper

bandit-transformer-pruning

deep-belief-network

A Python implementation of Deep Belief Networks built upon NumPy and TensorFlow with scikit-learn compatibility

DeepNLP-project

friendshipkim.github.io

Hello,

hmm-particle-filtering

Module-0

Module 0 - Fundamentals

Module-1

Module 1 - Autodifferentiation

Module-2

prefix-kd

Prefix-Tuning: Optimizing Continuous Prompts for Generation

reading-list

reading list related to KD, Pruning, etc.

replication-project

bert from scratch

staged-training

Staged Training for Transformer Language Models

stitching

stitching language models

summer-coding-bootcamp

web_study

writeups

xsum_analysis