MSA attention gated problem

[He Cao]

Hi Phil:

Compare the 'gating' unit with the original algorithm:

alphafold2/alphafold2_pytorch/alphafold2.py

Line 147 in 586792d

 gates = self.gating(x) 

I thought gating here just missed a 'sigmoid()', please have a check.

Best,

[Phil Wang]

@CiaoHe done https://github.com/lucidrains/alphafold2/releases/tag/0.4.13! 🙏