Larger Context Windows

[Griffin Adams]

Hi -

Do you, or (can you!), offer support for context windows > 2048?

I'd love to be able to fine-tune one of the longer range models (e.g., Mosaic).

I have long inputs and need around 4k tokens.

Thanks!