scrapinghub / portia

We have an error for web pages that are not utf-8. Here is a code line (L325) which is affected:

Lines 322 to 328 in d079667

    
           def open(self, *args, **kwargs): 
        
               """Open files from filesystem.""" 
        
               raw = kwargs.pop('raw', False) 
        
               with open(self._path(*args), encoding = 'utf-8') as f: 
        
                   return decode(f.read()) if raw else json.load(f)

Can this encoding be dynamic based on the web page or an option set for a web page in some configs?

	def open(self, args, *kwargs):
	"""Open files from filesystem."""
	raw = kwargs.pop('raw', False)
	with open(self._path(*args), encoding = 'utf-8') as f:
	return decode(f.read()) if raw else json.load(f)

Dynamic encoding possible for open and reading file or contents?