Whole word masking for RoBERTa
eugene-yang opened this issue · comments
Can you elaborate on why the first token is appended as an integer instead of [i] in line 65?
If the first word is being separated by BPE, this seems to be resulting in an uncaught exception for the following token.
Line 61 in de9c257
What exception are you seeing?
It is complaining about an integer doesn't have method .append.
Right, that probably needs to be fixed.
Fixed at TOT.