mlfoundations / open_lm

A repository for research on medium sized language models.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Support `pretrained` arg for create_model (and train.py) like in open_clip

iejMac opened this issue · comments

Shouldn't be too hard (probably can just copy from open_clip) and enables somewhat easier fine-tuning. Nice to have

This is supported now via the --pretrained flag, feel free to re-open if it's not what you want!