AIPHES / emnlp19-moverscore

MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Error with max_len property in moverscore_v2

winklerjustine opened this issue · comments

Hi everyone,

Using the code from moverscore_v2.py, I'm getting the following error:
AttributeError: 'DistilBertTokenizer' object has no attribute 'max_len'
It looks like the attribute has been renamed.

Thanks so much for this work!

Hello @winklerjustine,

Yes, the attribute max_len was renamed to model_max_length from the transformers version 3.0.0 onwards. The code runs properly on my side (Transformers==3.1.0).

you can get the updated version of this library by doing this:

pip install git+https://github.com/AIPHES/emnlp19-moverscore.git

This issue is likely caused by the pypi version being outdated.