Micronet-challenge starting from cutout.
Open Tasks:
- Add SAL
- Add Distillation
- Add Layerwise distillation
- Massive ensemble distillation
Closed tasks:
- Calc flops
- Calc params
- Achieve 80%
Scores: Baseline (WideResnet 28-10): 10.55 Testing: WideResnet 28-10 with 4 blocks of 3 instead of 3 blocks of 4. Block sizes are 16, 16, 160, 320, 640 instead of 16, 160,320,640: 4.92 (Codename starting_small)