bob80333 / investigating_extrapolation

investigating sequence length extrapolation in transformer language models across different positional embeddings

This repository is not active

investigating sequence length extrapolation in transformer language models across different positional embeddings

MIT License

Language:Jupyter Notebook 95.9%Language:Python 4.1%