motiwari / BanditPAM

BanditPAM C++ implementation and Python package

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

`useCacheP=True` & `usePerm=False` runs slower than BanditPAM with no caching when the dataset is large

lukeleeai opened this issue · comments

Dataset: 30k MNIST

---Cache: True Perm: True---
1 / 3 : 89.09640216827393 seconds
2 / 3 : 111.98075819015503 seconds
3 / 3 : 99.45851635932922 seconds
mean: 100.17855890591939 std: 9.356362668819777

---Cache: True Perm: False---
1 / 3 : 165.01068472862244 seconds
2 / 3 : 200.78851699829102 seconds
3 / 3 : 178.79811787605286 seconds
mean: 181.53243986765543 std: 14.73365100813906

---Cache: False Perm: False---
592.7162899971008 seconds

Dataset: 70k MNIST

---Cache: True Perm: True--- (CACHE: 5000)
1 / 3 : 428.34665966033936 seconds
2 / 3 : 384.3007571697235 seconds
3 / 3 : 445.8992736339569 seconds seconds
mean: 419.5155634880066 std: 25.911200954443764

---Cache: True Perm: False--- (CACHE: 5000)
3346.914297580719 seconds

---Cache: False Perm: False---
1 / 3 : 1375.8598430156708 seconds
2 / 3 : 1595.562647819519 seconds
1 / 3 : 1595.562647819519 seconds
2 / 3 : 1530.3325538635254 seconds
3 / 3 : 1296.2060058116913 seconds
mean: 1474.0337358315785 std: 128.53214244537276