ICLR Poster "optimizer design" Papers
3 papers found
LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
Jui-Nan Yen, Si Si, Zhao Meng et al.
ICLR 2025posterarXiv:2410.20625
15
citations
On the Performance Analysis of Momentum Method: A Frequency Domain Perspective
Xianliang Li, Jun Luo, Zhiwei Zheng et al.
ICLR 2025posterarXiv:2411.19671
4
citations
The AdEMAMix Optimizer: Better, Faster, Older
Matteo Pagliardini, Pierre Ablin, David Grangier
ICLR 2025posterarXiv:2409.03137
23
citations