Giters

stanford-crfm / helm

Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in Holistic Evaluation of Text-to-Image Models (HEIM) (https://arxiv.org/abs/2311.04287).

Home Page:https://crfm.stanford.edu/helm

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Missing Dependency chardet

danielz02 opened this issue · comments

commented

It seems that chardet is missing from the dependency list in the main branch when I tried to execute helm-run.

Traceback (most recent call last):
  File "/data/chenhui_zhang/anaconda3/envs/crfm-helm/bin/helm-run", line 5, in <module>
    from helm.benchmark.run import main
  File "/data/chenhui_zhang/helm/src/helm/benchmark/run.py", line 13, in <module>
    from helm.proxy.services.remote_service import create_authentication, add_service_args
  File "/data/chenhui_zhang/helm/src/helm/proxy/services/remote_service.py", line 3, in <module>
    import requests
  File "/data/chenhui_zhang/anaconda3/envs/crfm-helm/lib/python3.8/site-packages/requests/__init__.py", line 45, in <module>
    from .exceptions import RequestsDependencyWarning
  File "/data/chenhui_zhang/anaconda3/envs/crfm-helm/lib/python3.8/site-packages/requests/exceptions.py", line 9, in <module>
    from .compat import JSONDecodeError as CompatJSONDecodeError
  File "/data/chenhui_zhang/anaconda3/envs/crfm-helm/lib/python3.8/site-packages/requests/compat.py", line 13, in <module>
    import charset_normalizer as chardet
  File "/data/chenhui_zhang/anaconda3/envs/crfm-helm/lib/python3.8/site-packages/charset_normalizer/__init__.py", line 24, in <module>
    from .api import from_bytes, from_fp, from_path, is_binary
  File "/data/chenhui_zhang/anaconda3/envs/crfm-helm/lib/python3.8/site-packages/charset_normalizer/api.py", line 5, in <module>
    from .cd import (
  File "/data/chenhui_zhang/anaconda3/envs/crfm-helm/lib/python3.8/site-packages/charset_normalizer/cd.py", line 14, in <module>
    from .md import is_suspiciously_successive_range
  File "charset_normalizer/md.py", line 10, in <module>
ImportError: cannot import name 'is_ascii' from 'charset_normalizer.utils' (/data/chenhui_zhang/anaconda3/envs/crfm-helm/lib/python3.8/site-packages/charset_normalizer/utils.py)
commented

Similar issue for cchardet

commented

requests does not use charset- instead it uses charset-normalizer (notes), which is included in crfm-helm's requirements.txt.

This is probably a issue with your pip environment and can be resolved by reinstalling requests and/or charset-normalizer.