Giters

salesforce / ctrl

Conditional Transformer Language Model for Controllable Generation

Home Page:https://arxiv.org/abs/1909.05858

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Cuda out of memory issue.

jamalabdul1 opened this issue · comments

commented

I am trying to fine-tune the model but as the model is too large so it gets out of memory error. Any idea how to get over it?

tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[246534,1280] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal]