It always told me out of memory even when I set the batch_size to 2.

[AhBumm]

2022-05-05 09:19:01.585125: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1406] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10453 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2060, pci bus id: 0000:07:00.0, compute capability: 7.5)
2022-05-05 09:19:01.590493: I tensorflow/compiler/jit/xla_gpu_device.cc:99] Not creating XLA devices, tf_xla_enable_xla_devices not set
Initializing classifier...
Successfully create training list!
Successfully create testing list!
2022-05-05 09:19:06.271483: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cudnn64_8.dll
2022-05-05 09:19:07.089071: I tensorflow/core/platform/windows/subprocess.cc:308] SubProcess ended with return code: 0

2022-05-05 09:19:07.133603: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublas64_11.dll
2022-05-05 09:19:07.462221: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library cublasLt64_11.dll
2022-05-05 09:19:07.811304: I tensorflow/stream_executor/cuda/cuda_driver.cc:789] failed to allocate 2.00G (2147483648 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory
2022-05-05 09:19:07.839808: I tensorflow/stream_executor/cuda/cuda_driver.cc:789] failed to allocate 1.80G (1932735232 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory
2022-05-05 09:19:08.017596: I tensorflow/stream_executor/cuda/cuda_driver.cc:789] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory
2022-05-05 09:19:08.020333: W tensorflow/core/common_runtime/bfc_allocator.cc:248] Allocator (GPU_0_bfc) ran out of memory trying to allocate 219.88MiB with freed_by_count=0. The caller indicates that
this is not a failure, but may mean that there could be performance gains if more memory were available.
2022-05-05 09:19:08.025788: I tensorflow/stream_executor/cuda/cuda_driver.cc:789] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory
2022-05-05 09:19:08.028325: W tensorflow/core/common_runtime/bfc_allocator.cc:248] Allocator (GPU_0_bfc) ran out of memory trying to allocate 219.88MiB with freed_by_count=0. The caller indicates that
this is not a failure, but may mean that there could be performance gains if more memory were available.
2022-05-05 09:19:08.044037: I tensorflow/stream_executor/cuda/cuda_driver.cc:789] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory
2022-05-05 09:19:08.047021: I tensorflow/stream_executor/cuda/cuda_driver.cc:789] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory

My anaconda env list

Name Version Build Channel

absl-py 0.15.0 pypi_0 pypi
astunparse 1.6.3 pypi_0 pypi
ca-certificates 2022.4.26 haa95532_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
cachetools 5.0.0 pypi_0 pypi
certifi 2021.10.8 py38haa95532_2 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
charset-normalizer 2.0.12 pypi_0 pypi
flatbuffers 1.12 pypi_0 pypi
gast 0.3.3 pypi_0 pypi
google-auth 2.6.6 pypi_0 pypi
google-auth-oauthlib 0.4.6 pypi_0 pypi
google-pasta 0.2.0 pypi_0 pypi
grpcio 1.32.0 pypi_0 pypi
h5py 2.10.0 pypi_0 pypi
idna 3.3 pypi_0 pypi
importlib-metadata 4.11.3 pypi_0 pypi
keras-preprocessing 1.1.2 pypi_0 pypi
markdown 3.3.6 pypi_0 pypi
mido 1.2.10 pypi_0 pypi
numpy 1.19.5 pypi_0 pypi
oauthlib 3.2.0 pypi_0 pypi
openssl 1.1.1n h2bbff1b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
opt-einsum 3.3.0 pypi_0 pypi
pip 21.2.2 py38haa95532_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
pretty-midi 0.2.9 pypi_0 pypi
protobuf 3.20.1 pypi_0 pypi
pyasn1 0.4.8 pypi_0 pypi
pyasn1-modules 0.2.8 pypi_0 pypi
python 3.8.13 h6244533_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
requests 2.27.1 pypi_0 pypi
requests-oauthlib 1.3.1 pypi_0 pypi
rsa 4.8 pypi_0 pypi
setuptools 61.2.0 py38haa95532_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
six 1.15.0 pypi_0 pypi
sqlite 3.38.2 h2bbff1b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
tensorboard 2.9.0 pypi_0 pypi
tensorboard-data-server 0.6.1 pypi_0 pypi
tensorboard-plugin-wit 1.8.1 pypi_0 pypi
tensorflow 2.4.1 pypi_0 pypi
tensorflow-estimator 2.4.0 pypi_0 pypi
termcolor 1.1.0 pypi_0 pypi
typing-extensions 3.7.4.3 pypi_0 pypi
urllib3 1.26.9 pypi_0 pypi
vc 14.2 h21ff451_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
vs2015_runtime 14.27.29016 h5e58377_2 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
werkzeug 2.1.2 pypi_0 pypi
wheel 0.37.1 pyhd3eb1b0_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
wincertstore 0.2 py38haa95532_2 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
wrapt 1.12.1 pypi_0 pypi
zipp 3.8.0 pypi_0 pypi

cudatoolkit 11.1/cuDNN 8.0.4/