khanrc / swad

Official Implementation of SWAD (NeurIPS 2021)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

about the result

chenruolin2019 opened this issue · comments

Could I ask a question?
What's the difference between the result "env0_in" and "env0_out"?

image
(image adopted from the DomainBed paper)

"env0_in" indicates big split of domain 0, and "env0_out" indicates small split of domain 0.

OK thank you very much!And, what's the meaning of the result "oracle, iid, and last" and the difference among them?

See #1.

Ok, thank you! I have an another question:
python train_all.py PACS0 --dataset PACS --deterministic --trial_seed 0 --checkpoint_freq 100 --data_dir /my/datasets/path
When I run this, the oracle and iid are the same reslut. Why?

The best iid checkpoint and the oracle checkpoint can be same (but usually not). Are they always same, even with different HPs or trial_seed?

Some results are the same, some are different.

If so, it is normal.