2025 "distributed optimization" Papers
13 papers found
Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo
Zachary Charles, Gabriel Teston, Lucio Dery et al.
NeurIPS 2025spotlightarXiv:2503.09799
12
citations
Computation and Memory-Efficient Model Compression with Gradient Reweighting
Zhiwei Li, Yuesen Liao, Binrui Wu et al.
NeurIPS 2025poster
Connecting Federated ADMM to Bayes
Siddharth Swaroop, Mohammad Emtiyaz Khan, Finale Doshi-Velez
ICLR 2025posterarXiv:2501.17325
4
citations
Deep Distributed Optimization for Large-Scale Quadratic Programming
Augustinos Saravanos, Hunter Kuperman, Alex Oshin et al.
ICLR 2025posterarXiv:2412.12156
14
citations
FedQS: Optimizing Gradient and Model Aggregation for Semi-Asynchronous Federated Learning
Yunbo Li, Jiaping Gui, Zhihang Deng et al.
NeurIPS 2025posterarXiv:2510.07664
FedWSQ: Efficient Federated Learning with Weight Standardization and Distribution-Aware Non-Uniform Quantization
Seung-Wook Kim, Seongyeol Kim, Jiah Kim et al.
ICCV 2025posterarXiv:2506.23516
Graph Neural Networks Gone Hogwild
Olga Solodova, Nick Richardson, Deniz Oktay et al.
ICLR 2025posterarXiv:2407.00494
1
citations
Layer-wise Update Aggregation with Recycling for Communication-Efficient Federated Learning
Jisoo Kim, Sungmin Kang, Sunwoo Lee
NeurIPS 2025posterarXiv:2503.11146
1
citations
Local Steps Speed Up Local GD for Heterogeneous Distributed Logistic Regression
Michael Crawshaw, Blake Woodworth, Mingrui Liu
ICLR 2025posterarXiv:2501.13790
1
citations
Newton Meets Marchenko-Pastur: Massively Parallel Second-Order Optimization with Hessian Sketching and Debiasing
Elad Romanov, Fangzhao Zhang, Mert Pilanci
ICLR 2025posterarXiv:2410.01374
2
citations
Revisiting Consensus Error: A Fine-grained Analysis of Local SGD under Second-order Data Heterogeneity
Kumar Kshitij Patel, Ali Zindari, Sebastian Stich et al.
NeurIPS 2025poster
Tight Bounds for Maximum Weight Matroid Independent Set and Matching in the Zero Communication Model
Ilan Doron-Arad
NeurIPS 2025poster
Understanding outer learning rates in Local SGD
Ahmed Khaled, Satyen Kale, Arthur Douillard et al.
NeurIPS 2025poster