Sinkhorn motivation

Question

Sinkhorn motivation

vasudev13 opened this issue 3 years ago · comments

Vasudev Awatramani commented 3 years ago

Hi, thanks for the awesome implementation!

I had a question with sinkhorn objective used in CustomWrapper. Is it motivated from here? Would be great if you could mention bit more about it.

Cheers!

Cade Gordon · Answer 1 · Mon Nov 29 2021 07:41:50 GMT+0800 (China Standard Time)

Funny enough it's actually from a students masters thesis titled: Data-Efficient Language-Supervised Zero-Shot Learning with Self-Distillation.

Hope this helps give some background!

Vasudev Awatramani · Answer 2 · Mon Nov 29 2021 23:16:30 GMT+0800 (China Standard Time)

I see, thanks for the direction.

Any chance if you could point me to the the official implementation of the thesis/paper? (if released publicly). I think the CVPR paper does not talk about Optimal Transport but the thesis does.

Thanks again for the clarification.

Cade Gordon · Answer 3 · Mon Jan 03 2022 13:28:53 GMT+0800 (China Standard Time)

I was in contact with the author but they were not at liberty to provide their official code. I believe the CVPR version does in fact have some better pseudo-code though!