OpenNLPLab / lightning-attention

Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models

OpenNLPLab/lightning-attention Issues

TypeError("unhashable type: 'tensor'")
Closed a month ago7
No module named 'lightning_attn'
Closed a month ago11
Cannot run the triton kernels
Closed a month ago1
No-decay unusable
Closed a month ago2
question about benchmark
Closed a month ago2
Does using lightning-attention need retraining?
Closed a month ago4
The code stuck when running example_lightning_attn.py
Closed 3 months ago2
The methods for saving the Lightning-Attention model
Closed 3 months ago1
Tests fail
Closed 4 months ago2
Can the lightning_attn support V100?
Updated 4 months ago11
assert d in supports_dim and e in supports_dim ?
Updated 4 months ago4
When running lightning_attn_func two or more times, an error occurred.
Closed 4 months ago10