Niangmohamed / Virtual-Adversarial-Training

Implementation of the original VAT (Virtual Adversarial Training) paper in Keras.

Home Page:https://github.com/Niangmohamed/Virtual-Adversarial-Training

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Deep Learning: Virtual Adversarial Training

A Regularization Method for Supervised and Semi-Supervised Learning

The main goal of this project is to implement the VAT paper with Keras library.

In this project, we are faced with a semi-supervised learning problem with MNIST data. The goal here is to make a prediction on MNIST data using only 100 labels. To do so, we use a regularization method based on the virtual loss of opponents: a new measure of the local uniformity of the conditional distribution of the input label. The virtual adversarial loss is defined as the robustness of the conditional distribution of the label around each input data point with respect to local perturbations. In contrast to contradictory training, this method defines the contradictory orientation without label information and is therefore applicable to semi-supervised learning.

About

Implementation of the original VAT (Virtual Adversarial Training) paper in Keras.

https://github.com/Niangmohamed/Virtual-Adversarial-Training

License:MIT License


Languages

Language:Jupyter Notebook 100.0%