Output file encoding should be set to UTF-8

Question

Output file encoding should be set to UTF-8

rxzhangGH opened this issue 2 years ago · comments

Hi,

When using the bifixer command line tool, I noticed an issue with line 53 of bifixer.py:

parser.add_argument('output', type=argparse.FileType('w'), default=sys.stdout, help="Fixed corpus")

Since no encoding is specified in the type, a platform-specific encoding will be used and that caused problems for me. I suggest changing the above to:

parser.add_argument('output', type=argparse.FileType('w', encoding='UTF-8'), default=sys.stdout, help="Fixed corpus")

Jaume Zaragoza · Answer 1 · Tue Dec 20 2022 05:12:03 GMT+0800 (China Standard Time)

Could you please post the error? The OS and Python would be helpful, also.

Jaume Zaragoza · Answer 2 · Thu Jan 05 2023 21:25:04 GMT+0800 (China Standard Time)

It's fixed anyway now.