WangRongsheng/Aurora Issues
与Flash Attention 2结合
Closed 4请教是否可以在两块4090ti上进行微调？
Closed 4有没有多gpu推理的脚本?一张3090刚好放不下
Closed 1对论文中提到的训练数据的疑惑
Closed 4推理速度好慢，有好的解决办法吗？
Closed 10中文lora降低了逻辑判断能力
Closed 6多机器微调
Closed 1是否考虑上传模型到modelscope.cn
Closed 2
🐳 Aurora is a [Chinese Version] MoE model. Aurora is a further work based on Mixtral-8x7B, which activates the chat capability of the model's Chinese open domain.