2024 "non-convex optimization" Papers
26 papers found
A Universal Class of Sharpness-Aware Minimization Algorithms
Behrooz Tahmasebi, Ashkan Soleymani, Dara Bahri et al.
Barrier Algorithms for Constrained Non-Convex Optimization
Pavel Dvurechenskii, Mathias Staudigl
Byzantine-Robust Federated Learning: Impact of Client Subsampling and Local Updates
Youssef Allouah, Sadegh Farhadkhani, Rachid Guerraoui et al.
Constrained Exploration via Reflected Replica Exchange Stochastic Gradient Langevin Dynamics
Haoyang Zheng, Hengrong Du, Qi Feng et al.
Convex Relaxations of ReLU Neural Networks Approximate Global Optima in Polynomial Time
Sungyoon Kim, Mert Pilanci
Fair Federated Learning via the Proportional Veto Core
Bhaskar Ray Chaudhury, Aniket Murhekar, Zhuowen Yuan et al.
Generalization Analysis of Stochastic Weight Averaging with General Sampling
Wang Peng, Li Shen, Zerui Tao et al.
High-Probability Bound for Non-Smooth Non-Convex Stochastic Optimization with Heavy Tails
Langqi Liu, Yibo Wang, Lijun Zhang
How Free is Parameter-Free Stochastic Optimization?
Amit Attia, Tomer Koren
How to Make the Gradients Small Privately: Improved Rates for Differentially Private Non-Convex Optimization
Andrew Lowy, Jonathan Ullman, Stephen Wright
Improved Stability and Generalization Guarantees of the Decentralized SGD Algorithm
Batiste Le Bars, Aurélien Bellet, Marc Tommasi et al.
Improving Computational Complexity in Statistical Models with Local Curvature Information
Pedram Akbarian, Tongzheng Ren, Jiacheng Zhuo et al.
Large-Scale Non-convex Stochastic Constrained Distributionally Robust Optimization
Qi Zhang, Yi Zhou, Ashley Prater-Bennette et al.
Monotone, Bi-Lipschitz, and Polyak-Łojasiewicz Networks
Ruigang Wang, Krishnamurthy Dvijotham, Ian Manchester
Non-convex Stochastic Composite Optimization with Polyak Momentum
Yuan Gao, Anton Rodomanov, Sebastian Stich
On a Neural Implementation of Brenier's Polar Factorization
Nina Vesseron, Marco Cuturi
On Convergence of Incremental Gradient for Non-convex Smooth Functions
Anastasiia Koloskova, Nikita Doikov, Sebastian Stich et al.
Random Scaling and Momentum for Non-smooth Non-convex Optimization
Qinzi Zhang, Ashok Cutkosky
Sample-and-Bound for Non-convex Optimization
Yaoguang Zhai, Zhizhen Qin, Sicun Gao
Sarah Frank-Wolfe: Methods for Constrained Optimization with Best Rates and Practical Features
Aleksandr Beznosikov, David Dobre, Gauthier Gidel
SILVER: Single-loop variance reduction and application to federated learning
Kazusato Oko, Shunta Akiyama, Denny Wu et al.
Spectral Preconditioning for Gradient Methods on Graded Non-convex Functions
Nikita Doikov, Sebastian Stich, Martin Jaggi
Stochastic Optimization with Arbitrary Recurrent Data Sampling
William Powell, Hanbaek Lyu
Supervised Matrix Factorization: Local Landscape Analysis and Applications
Joowon Lee, Hanbaek Lyu, Weixin Yao
Two-timescale Derivative Free Optimization for Performative Prediction with Markovian Data
Haitong LIU, Qiang Li, Hoi To Wai
What is the Long-Run Distribution of Stochastic Gradient Descent? A Large Deviations Analysis
Waïss Azizian, Franck Iutzeler, Jérôme Malick et al.