nairouz / DynAE

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Deep Clustering with a Dynamic Autoencoder: From Reconstruction towards Centroids Construction

Abstract

In unsupervised learning, there is no apparent straightforward cost function that can capture the significant factors of variations and similarities. Since natural systems have smooth dynamics, an opportunity is lost if an unsupervised objective function remains static. The absence of concrete supervision suggests that smooth dynamics should be integrated during the training process. Compared to classical static cost functions, dynamic objective functions allow to better make use of the gradual and uncertain knowledge acquired through pseudo-supervision. In this paper, we propose Dynamic Autoencoder (DynAE), a novel model for deep clustering that overcomes a clustering-reconstruction trade-off, by gradually and smoothly eliminating the reconstruction objective function in favor of a construction one. Experimental evaluations on benchmark datasets show that our approach achieves state-of-the-art results compared to the most relevant deep clustering methods.

Usage

You can run the code of DynAE on google Colaboratory plateform without installing any package.

  1. Create a folder entitled "Colab" in your google drive.
  2. Download the two folders "DynAE" and "data" and drop them in the Colab folder.
  3. Run the notebook "dynAE.ipynb" using Colab.

Citation

@article{mrabah2020deep,
title={Deep clustering with a dynamic autoencoder: From reconstruction towards centroids construction},
author={Mrabah, Nairouz and Khan, Naimul Mefraz and Ksantini, Riadh and Lachiri, Zied},
journal={Neural Networks},
volume={130},
pages={206--228},
year={2020},
publisher={Elsevier}
} 

About

License:GNU General Public License v3.0


Languages

Language:Python 92.9%Language:Jupyter Notebook 7.1%