[Bug] Wrong head_position index in rc_position_embedding.py
King-Hell opened this issue · comments
In rc_position_embedding.py line 69:
head_position_vector = paddle.to_tensor(rc_vector[:, :, -1], dtype='int64')
But in rc_init_vector.py line 208, the head_position_idx
is -2 in rc_embedding
.
So I think it should be:
head_position_vector = paddle.to_tensor(rc_vector[:, :, -2], dtype='int64')
Thanks!
You are right. We now fix it.