ZhuiyiTechnology / roformer

Rotary Transformer

ZhuiyiTechnology/roformer Issues

Changing bases and sampling rate
Updated a year ago
Some typos on your paper
Updated a year ago
max_position_embeddings have restrict？
Updated 2 years ago
download中的这几个模型都有什么差别啊
Updated 2 years ago
请问字级别的roformer可以自己预训练吗？
Updated 3 years ago
Reference to prior work
Updated 3 years ago1
bert4keras 现在好像没有0.10.4这个版本
Closed 3 years ago
期待线性attention加unilm式的预训练模型
Closed 3 years ago2