viewv / CS282ML

CS282 ML Project: AdaBelief Optimizer

CS282 ML Project: AdaBelief Optimizer

CS282 ML Project: AdaBelief Optimizer.

MNIST

Test AdaBelief Optimizer on a simple mnist task. Directly use jupyter notebook to run the main.ipynb under mnist folder.

Dependency

TensorFlow

TensorFlow addons (we use the AdaBelief Optimizer provided by TensorFlow addons)

BERT

Test AdaBelief Optimizer on a simple BERT task. Clone this repository then directly use jupyter notebook to run the main.ipynb under BERT folder.

Dependency

PyTorch

Thanks

NLP-tutorial

AdaBelief-Optimizer