XuezheMax / megalodon

Reference implementation of Megalodon 7B model

XuezheMax/megalodon Issues

The project is very interesting, thanks for publishing it, now I have a few questions
Updated a month ago1
any opensource weights?
Updated 2 months ago2
Cuda 11.8/12.1
Closed 2 months ago4
Question about the number of attention chunks in the paper
Closed 3 months ago3
Flash Attention V2 vs Megalodon Swift Attention
Closed 3 months ago2
How to save model and evaluate on downstream LLM
Updated 3 months ago
Failed to install megalodon on V100.
Closed 3 months ago4