Giters

taesungp / contrastive-unpaired-translation

Contrastive unpaired image-to-image translation, faster and lighter training than cyclegan (ECCV 2020, in PyTorch)

Home Page:https://taesung.me/ContrastiveUnpairedTranslation/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

CPU memory leak + cuDNN error when using the GPU with preprocess None

connorlee77 opened this issue · comments

commented

Two issues I've been running into when attempting to perform inference with the test.py script:

  1. When running with GPU, with no preprocessing (i.e. input shape is size of input image), I run into a CUDNN_STATUS_INTERNAL_ERROR. Note that the code runs fine on the CPU except for the below:
  2. When running on CPU, the memory leaks tremendously to the point where the process gets killed on a machine with 128GB ram.

Any ideas how to fix either issues?

commented

I am having the same issue with CUDNN_STATUS_INTERNAL_ERROR. Did you manage to find a solution?

commented

No, I was not able to. That said, I didn't spend that much time trying to debug this. Still interested in why the memory leak is occuring though as to avoid it in future code.

commented

btw, i did this stuff again and worked around this by just letting it do its default resizing to a square crop and then resizing back to the original dimensions after inference.