Position Encoding

[InitialBug]

In the original paper 《attention is all you need》, it seems the position encoding is direct computed rather than trained. But in your code, the final parameter is wrapped with torch.nn.Parameter, is that OK?

[Hengruo Z.]

@InitialBug You are right. I should set requires_grad=False. Thanks!