RuntimeWarning: invalid value encountered in intersection
talhayaseen57 opened this issue · comments
I am training the model using commad python train_net.py --num-gpus 1 --config-file configs/diffinst.coco.res50.yaml and got following warnings. Also the value of total loss seems bizarre. Can someone help me to fix it?
[04/03 15:11:06 d2.utils.events]: eta: 1 day, 20:24:21 iter: 19 total_loss: 65.75 loss_ce: 2.293 loss_bbox: 2.555 loss_giou: 2.363 loss_masks: 4.714 loss_ce_0: 2.435 loss_bbox_0: 1.788 loss_giou_0: 1.63 loss_masks_0: 4.604 loss_ce_1: 2.278 loss_bbox_1: 2.009 loss_giou_1: 1.902 loss_masks_1: 4.431 loss_ce_2: 2.357 loss_bbox_2: 1.882 loss_giou_2: 1.984 loss_masks_2: 4.607 loss_ce_3: 2.541 loss_bbox_3: 1.927 loss_giou_3: 2.135 loss_masks_3: 4.574 loss_ce_4: 2.427 loss_bbox_4: 2.114 loss_giou_4: 2.305 loss_masks_4: 4.593 time: 0.3600 data_time: 0.0353 lr: 7.2025e-05 max_mem: 6532M
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
[04/03 15:11:14 d2.utils.events]: eta: 1 day, 21:02:44 iter: 39 total_loss: 61.7 loss_ce: 2.142 loss_bbox: 2.099 loss_giou: 2.09 loss_masks: 4.454 loss_ce_0: 2.057 loss_bbox_0: 1.471 loss_giou_0: 1.772 loss_masks_0: 4.427 loss_ce_1: 2.109 loss_bbox_1: 1.639 loss_giou_1: 1.684 loss_masks_1: 4.436 loss_ce_2: 2.134 loss_bbox_2: 1.766 loss_giou_2: 1.693 loss_masks_2: 4.353 loss_ce_3: 2.105 loss_bbox_3: 2.039 loss_giou_3: 1.866 loss_masks_3: 4.526 loss_ce_4: 2.193 loss_bbox_4: 2.34 loss_giou_4: 2.04 loss_masks_4: 4.451 time: 0.3628 data_time: 0.0046 lr: 0.00012152 max_mem: 6822M
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
/cta/users/skoles/.local/lib/python3.10/site-packages/shapely/set_operations.py:133: RuntimeWarning: invalid value encountered in intersection
return lib.intersection(a, b, **kwargs)
[04/03 15:11:21 d2.utils.events]: eta: 1 day, 20:23:54 iter: 59 total_loss: 63.78 loss_ce: 1.991 loss_bbox: 2.183 loss_giou: 2.108 loss_masks: 4.508 loss_ce_0: 2.028 loss_bbox_0: 1.836 loss_giou_0: 1.454 loss_masks_0: 4.359 loss_ce_1: 2.061 loss_bbox_1: 1.798 loss_giou_1: 1.82 loss_masks_1: 4.427 loss_ce_2: 2.037 loss_bbox_2: 1.879 loss_giou_2: 1.816 loss_masks_2: 4.345 loss_ce_3: 1.948 loss_bbox_3: 2.047 loss_giou_3: 1.932 loss_masks_3: 4.36 loss_ce_4: 2.161 loss_bbox_4: 2.239 loss_giou_4: 2.066 loss_masks_4: 4.265 time: 0.3622 data_time: 0.0065 lr: 0.00017102 max_mem: 6822M
I had same issue and I solved it by downgrading the shapely to v1.8.5.