When I enable sequence parallelism, it throws a bug.

[qy-NJU]

Open-Sora/opensora/models/layers/blocks.py

Line 313 in a5afed2

 kv = self.kv_linear(cond).view(B, -1, 2, self.num_heads, self.head_dim) 

I think you need to change it to 'view(1, -1, 2, self.num_heads, self.head_dim)'

[Jiatong (Julius) Han]

What was the error? Would you please try changing it while also passing the tests at ~/tests folder?

[github-actions]

This issue is stale because it has been open for 7 days with no activity.