"adam optimizer" Papers
3 papers found
DP-AdamBC: Your DP-Adam Is Actually DP-SGD (Unless You Apply Bias Correction)
Qiaoyue Tang, Frederick Shpilevskiy, Mathias Lécuyer
AAAI 2024paperarXiv:2312.14334
Studying K-FAC Heuristics by Viewing Adam through a Second-Order Lens
Ross Clarke, Jose Miguel Hernandez-Lobato
ICML 2024poster
Understanding Adam Optimizer via Online Learning of Updates: Adam is FTRL in Disguise
Kwangjun Ahn, Zhiyu Zhang, Yunbum Kook et al.
ICML 2024poster