pixeli99 / OwLore

Official Pytorch Implementation of "OwLore: Outlier-weighed Layerwise Sampled Low-Rank Projection for Memory-Efficient LLM Fine-tuning" by Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei Liu

Home Page:https://arxiv.org/abs/2405.18380

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

pixeli99/OwLore Stargazers