yashmanne / intra-distillation

Repository aiming to reproduce EMNLP 2022 paper "The Importance of Being Parameters: An Intra-Distillation Method for Serious Gains".

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

About

Repository aiming to reproduce EMNLP 2022 paper "The Importance of Being Parameters: An Intra-Distillation Method for Serious Gains".

License:MIT License


Languages

Language:Python 94.4%Language:Shell 3.2%Language:Cuda 0.8%Language:Jupyter Notebook 0.7%Language:C++ 0.5%Language:Cython 0.2%Language:Lua 0.1%Language:Perl 0.0%Language:C 0.0%Language:Batchfile 0.0%Language:Makefile 0.0%