Parser.py chokes on non-ascii encodings
Fxhnd opened this issue · comments
If a file is not encoded with charset us-ascii the tokenization portion of the parser doesn't recognize anything. Easiest workaround is to just convert the file, have tried adding the lex.lex(reflags=re.UNICODE) to no avail.
Relevant Links:
Check encoding
Change encoding