Question for latent encoder of attentive neural processes script

Question

Question for latent encoder of attentive neural processes script

jsikyoon opened this issue 5 years ago · comments

Hi,

First of all, thank you for opening your great script!

I have a question about latent encoder.

In your code, posterior and prior use same latent encoder. Exactly using same (x,y) pair encoder is no problem, but the linear layers to sample the latent variable would be different functions for prior and posterior I think.

If my understanding about the code is wrong, then could I know which point I missed?

Thanks.

Best Regards,
Jaesik Yoon.

Hyunjik Kim · Answer 1 · Sun May 12 2019 01:39:22 GMT+0800 (China Standard Time)

Hi Jaesik, I'm not quite sure what you mean when you say

linear layers to sample the latent variable would be different functions for prior and posterior

The code uses the same linear function for both; using the notation of Equation (3) in the Attentive Neural Processes paper, the prior corresponds to q(z|s_C) and the posterior corresponds to q(z|s_T), and the same encoder parameters are used to compute samples from each (as well as the KL between them).

Jaesik Yoon · Answer 2 · Sun May 12 2019 08:35:22 GMT+0800 (China Standard Time)

Ah, I missed the equation. Okay, thank you for quick reply :) 2019년 5월 12일 (일) 오전 2:39, hyunjik11 <notifications@github.com>님이 작성:

…

Hi Jaesik, I'm not quite sure what you mean when you say linear layers to sample the latent variable would be different functions for prior and posterior The code uses the same linear function for both; using the notation of Equation (3) in the Attentive Neural Processes paper, the prior corresponds to q(z|s_C) and the posterior corresponds to q(z|s_T), and the same encoder parameters are used to compute samples from each (as well as the KL between them). — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#6 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AFLDXIYA5KVTB6HZFHDL3PDPU4AEZANCNFSM4HMIPXAQ> .