kernelmachine / demix

DEMix Layers for Modular Language Modeling

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Unavailable link for tutorial

ZihaoLin0123 opened this issue · comments

The link for tutorial is unavailable. Could you please update the link?

Thanks!

Hi Zihao, Sorry about that. Basically to replicate the demix layers results, replace all the commands using tutorial/train.sh with demix/train.sh (and equivalent for the other commands). Follow the rest of the README for the tutorial using example set of mini domains.