'cocon_block' has no attribute 'cocon_attn'

[wying8349]

We meet a problem like this:
Traceback (most recent call last):
File "traininfer_cocon.py", line 2980, in
main()
File "traininfer_cocon.py", line 2783, in main
global_step, tr_loss = train_cocon(args, train_dataset, model, tokenizer, cocon_block=cocon_block, disc_model=disc_model, model_config=config, transform_h_after_layernorm=args.transform_h_after_layernorm)
File "traininfer_cocon.py", line 573, in train_cocon
self_cocon_lm_loss_grad = torch.autograd.grad(self_cocon_lm_loss, cocon_block.cocon_attn.c_attn.weight, retain_graph=True)[0]
File "/home/yingwenjing/anaconda3/envs/cocon/lib/python3.7/site-packages/torch/nn/modules/module.py", line 576, in getattr
type(self).name, name))
AttributeError: 'DataParallel' object has no attribute 'cocon_attn'

We sincerely look forward to your reply.

[GGG-c]

I have same question

[janleemark]

I have the same question when running "traininfer_cocon.py"