Support for Mosaic Models
rajveer43 opened this issue · comments
Support for Mosaic Models
Mosaic models use our tokenizer, so the main to-do items are:
- Are there any configs or features they use that we don't yet support?
- Converting the checkpoints to the GPT-NeoX format