clean up model_configs directory
kernelmachine opened this issue · comments
@sagadre has done a big grid search of HPs, lets update the names (ie potato_neox -> open_lm_410m) and add jsons with optimal HPs
A repository for research on medium sized language models.
kernelmachine opened this issue · comments
@sagadre has done a big grid search of HPs, lets update the names (ie potato_neox -> open_lm_410m) and add jsons with optimal HPs