kyegomez / DecoupledLionW

A PyTorch implementation of the Decoupled LionW optimizer, an adaptive optimization algorithm with customizable learning rates and weight decay. This optimizer combines gradient updates and momentum while providing metrics such as cosine similarity and l2 norm for analysis

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

kyegomez/DecoupledLionW Issues

No issues in this repository yet.