google-deepmind / deepmind-research

This repository contains implementations and illustrative code to accompany DeepMind publications

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Layer normalization

goonm opened this issue · comments

Thank you for sharing your good research findings.
I have a question about layer normalization in your network.
Unlike conventional cnn or transformer, one layer normalization is applied after going through several gcn.
Is there a special reason for applying it at the end of the encoder instead of applying it after each gcn layer?