salesforce / ctrl

Conditional Transformer Language Model for Controllable Generation

Home Page:https://arxiv.org/abs/1909.05858

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

repeats the last word on AWS

dataSci-rigo opened this issue · comments

When trying to run CTRL on EC2,

python2 generation.py --model seqlen512_v1.ckpt/model.ckpt-740000.data-00000-of-00001 --temperature 0.2 --topk 5

I get results that look like this "Wikipedia Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry Jerry"
When I run this in colab I don't have any issues.
I also don't get the following warnings. Has anyone see problems like this before?

WARNING:tensorflow:Entity <bound method MultiHeadAttention.call of <transformer.MultiHeadAttention object at 0x7f6d8007d390>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, export AUTOGRAPH_VERBOSITY=10) and attach the full output. Cause: converting <bound method MultiHeadAttention.call of <transformer.MultiHeadAttention object at 0x7f6d8007d390>>: AttributeError: 'module' object has no attribute 'Num'
WARNING:tensorflow:Entity <bound method EncoderLayer.call of <transformer.EncoderLayer object at 0x7f6d80011050>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, export AUTOGRAPH_VERBOSITY=10) and attach the full output. Cause: converting <bound method EncoderLayer.call of <transformer.EncoderLayer object at 0x7f6d80011050>>: AssertionError: Bad argument number for Name: 3, expecting 4

commented

Im having the same issue, have you succeeded to find a solution?