`useCacheP=True` & `usePerm=False` runs slower than BanditPAM with no caching when the dataset is large
lukeleeai opened this issue · comments
Dataset: 30k MNIST
---Cache: True Perm: True---
1 / 3 : 89.09640216827393 seconds
2 / 3 : 111.98075819015503 seconds
3 / 3 : 99.45851635932922 seconds
mean: 100.17855890591939 std: 9.356362668819777
---Cache: True Perm: False---
1 / 3 : 165.01068472862244 seconds
2 / 3 : 200.78851699829102 seconds
3 / 3 : 178.79811787605286 seconds
mean: 181.53243986765543 std: 14.73365100813906
---Cache: False Perm: False---
592.7162899971008 seconds
Dataset: 70k MNIST
---Cache: True Perm: True--- (CACHE: 5000)
1 / 3 : 428.34665966033936 seconds
2 / 3 : 384.3007571697235 seconds
3 / 3 : 445.8992736339569 seconds seconds
mean: 419.5155634880066 std: 25.911200954443764
---Cache: True Perm: False--- (CACHE: 5000)
3346.914297580719 seconds
---Cache: False Perm: False---
1 / 3 : 1375.8598430156708 seconds
2 / 3 : 1595.562647819519 seconds
1 / 3 : 1595.562647819519 seconds
2 / 3 : 1530.3325538635254 seconds
3 / 3 : 1296.2060058116913 seconds
mean: 1474.0337358315785 std: 128.53214244537276