deepspeed-ulysses

There are 0 repository under deepspeed-ulysses topic.

feifeibear / long-context-attention
Sequence Parallel Attention for Long Context LLM Model Training and Inference
attention-is-all-you-need llm-inference llm-training pytorch ring-attention deepspeed-ulysses
Language:Python 173