Keras Non-Local Neural Networks
Keras implementation of Non-local blocks from the paper "Non-local Neural Networks"
- Support for
"Gaussian","Embedded Gaussian"and"Dot"instantiations of the Non-Local block. - Support for variable shielded computation mode (reduces computation by N**2 x, where N is default to 2)
- Support for
"Concatenation"instantiation will be supported when authors release their code.
Usage
The script non_local.py contains a single function : non_local_block which takes in an input tensor and wraps a non-local block around it.
from non_local import non_local_block
ip = Input(shape=(##)) # this can be a rank 3, 4 or 5 tensor shape
x = ConvND(...) # as againm can be Conv1D, Conv2D or Conv3D
x = non_local_block(x, computation_compression=2, mode='embedded')
...Basic block
From the paper, a basic Non-Local block looks like below (with the Embedded Gaussian instantiation)
