This repository contains an implementation of the adaptive initilization method that can be used to mitigate the effects of using saturable activation functions, such as many photonic activation functions.
If you find this work interesting, please cite the following paper
@article{dain,
title={ADAPTIVE INITIALIZATION FOR RECURRENT PHOTONIC NETWORKS USING SIGMOIDAL ACTIVATIONS},
author={Passalis, Nikolaos and Mourgias-Alexandris, George and Pleros, Nikos and Tefas, Anastastios},
journal={IEEE International Symposium on Circuits and Systems},
year={2020}
}
This work was supported by the European Union's Horizon 2020 Research and Innovation Program (PlasmoniAC ) under Grant 871391. This publication reflects the authors' views only. The European Commission is not responsible for any use that may be made of the information it contains.
