translationCore does not correctly split words in language `my` in wA tool
PhotoNomad0 opened this issue · comments
Story Explanation
User Story
translationCore does not correctly split words in language my in wA tool. See in this example USFM file: 57-TIT_myanmar_judson_1835_utf8.usfm.txt. It looks like the first word in 2:1 is split into two words and a letter is dropped. Notice the two words in the word list compared to one word in the source text:
Notes:
- This appears to be a tokenizer error.
- the bug is also present in a two year old issue: #6788
Features / Specifications
- [ ]
- [ ]
- [ ]
Definition of Done
- [ ]
- [ ]
- [ ]