Giters

kumarkrishna / fastssl

Fast SSL

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Debug alpha tracking experiments/results

arnaghosh opened this issue · comments

commented
  • Inspect track_alpha branch to understand if code has any bugs
  • Ensure that model save/load operation doesn't affect computed eigenspectrum/alpha
  • alpha at end of training should be equal to alpha during eval
commented

Experiments for Barlowtwins-Cifar10 confirm that alpha after SSL training and just before running linear eval are roughly similar!

  • Fix the dataloader issue in STL10
  • Run (design) hyperparam sweep for Barlowtwins-STL10
  • Run (design) hyperparam sweep for SimCLR-Cifar10
  • Run (design) hyperparam sweep for SimCLR-STL10
commented
  • Fix plotting to work with different hparam settings (simclr and barlowtwins)