haoranD / keras_lookahead

lookahead optimizer for keras

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

lookahead优化器的Keras实现

论文《Lookahead Optimizer: k steps forward, 1 step back》的Keras实现。

用法:

model.compile(optimizer=Adam(1e-3), loss='mse') # 用你想用的优化器
lookahead = Lookahead(k=5, alpha=0.5) # 初始化Lookahead
lookahead.inject(model) # 插入到模型中

中文介绍:https://mp.weixin.qq.com/s/3J-28xd0pyToSy8zzKs1RA

lookahead optimizer for keras

Keras implement of Lookahead Optimizer: k steps forward, 1 step back

Usage:

model.compile(optimizer=Adam(1e-3), loss='mse') # Any optimizer
lookahead = Lookahead(k=5, alpha=0.5) # Initialize Lookahead
lookahead.inject(model) # add into model

About

lookahead optimizer for keras


Languages

Language:Python 100.0%