Support for unicode characters in exports
onejgordon opened this issue · comments
Exports of user data currently fail when they include unicode characters, e.g.:
/reports.py", line 130, in writeData
2022-07-14 12:17:00.243 PDT
csv.writer(self.gcs_file).writerow(ed)
2022-07-14 12:17:00.243 PDT
UnicodeEncodeError: 'ascii' codec can't encode characters in position 0-3: ordinal not in range(128)
This may be a limitation of the cloudstorage library in python 2.7 (see https://cloud.google.com/appengine/docs/standard/python/googlecloudstorageclient/read-write-to-cloud-storage), but this is not confirmed.
We currently strip non-ascii characters to avoid problems with writing report data.