🧬Efficiency

Distributed Training

Training across multiple devices

11 papers

Compare with other topics

Mar '24 — Feb '268 papers

Top Conferences

AAAI: 4 ICLR: 3 NeurIPS: 1 CVPR: 1 ICCV: 1 ICML: 1

Top Papers

#1

Poplar: Efficient Scaling of Distributed DNN Training on Heterogeneous GPU Clusters

WenZheng Zhang, Yang Hu, Jing Shi et al.

AAAI 2025arXiv:2408.12596

5

citations

#2

EDiT: A Local-SGD-Based Efficient Distributed Training Method for Large Language Models

Jialiang Cheng, Ning Gao, Yun Yue et al.

ICLR 2025arXiv:2412.07210

1

citations

#3

FedEL: Federated Elastic Learning for Heterogeneous Devices

Letian Zhang, Bo Chen, Jieming Bian et al.

NeurIPS 2025arXiv:2509.16902

federated learningheterogeneous hardware capabilitiesclient selectionasynchronous federated learning+4

—

not collected

#4

From Promise to Practice: Realizing High-performance Decentralized Training

Zesen Wang, Jiaojiao Zhang, Xuyang Wu et al.

ICLR 2025arXiv:2410.11998

decentralized trainingcommunication topologiesoptimization algorithmstransformer-based models+3

—

not collected

#5

Rethinking the Starting Point: Collaborative Pre-Training for Federated Downstream Tasks

Yun-Wei Chu, Dong-Jun Han, Seyyedali Hosseinalipour et al.

AAAI 2025arXiv:2402.02225

—

not collected

#6

Multitarget Device-Free Localization via Cross-Domain Wi-Fi RSS Training Data and Attentional Prior Fusion

Na FAN, Zeyue Tian, Amartansh DUBEY et al.

Harnessing Manycore Processors with Distributed Memory for Accelerated Training of Sparse and Recurrent Models

Jan Finkbeiner, Thomas Gmeinder, Mark Pupilli et al.

DistRL: An Asynchronous Distributed Reinforcement Learning Framework for On-Device Control Agent

Taiyi Wang, Zhihao Wu, Jianheng Liu et al.

APT: Adaptive Personalized Training for Diffusion Models with Limited Data

JungWoo Chae, Jiyoon Kim, Jaewoong Choi et al.

Synchronizing Task Behavior: Aligning Multiple Tasks during Test-Time Training

Wooseong Jeong, Jegyeong Cho, Youngho Yoon et al.

ICCV 2025arXiv:2507.07778

—

not collected

#11

TinyTrain: Resource-Aware Task-Adaptive Sparse Training of DNNs at the Data-Scarce Edge

Young Kwon, Rui Li, Stylianos Venieris et al.

ICML 2024

on-device trainingsparse trainingresource-aware optimizationmicrocontroller unit deployment+4

—

not collected

Distributed Training

Top Conferences

Related Topics (Efficiency)

Top Papers

Poplar: Efficient Scaling of Distributed DNN Training on Heterogeneous GPU Clusters

EDiT: A Local-SGD-Based Efficient Distributed Training Method for Large Language Models

FedEL: Federated Elastic Learning for Heterogeneous Devices

From Promise to Practice: Realizing High-performance Decentralized Training

Rethinking the Starting Point: Collaborative Pre-Training for Federated Downstream Tasks

Multitarget Device-Free Localization via Cross-Domain Wi-Fi RSS Training Data and Attentional Prior Fusion

Harnessing Manycore Processors with Distributed Memory for Accelerated Training of Sparse and Recurrent Models

DistRL: An Asynchronous Distributed Reinforcement Learning Framework for On-Device Control Agent

APT: Adaptive Personalized Training for Diffusion Models with Limited Data

Synchronizing Task Behavior: Aligning Multiple Tasks during Test-Time Training

TinyTrain: Resource-Aware Task-Adaptive Sparse Training of DNNs at the Data-Scarce Edge

Top Conferences

Related Topics (Efficiency)

Poplar: Efficient Scaling of Distributed DNN Training on Heterogeneous GPU Clusters

EDiT: A Local-SGD-Based Efficient Distributed Training Method for Large Language Models

FedEL: Federated Elastic Learning for Heterogeneous Devices

From Promise to Practice: Realizing High-performance Decentralized Training

Rethinking the Starting Point: Collaborative Pre-Training for Federated Downstream Tasks

Multitarget Device-Free Localization via Cross-Domain Wi-Fi RSS Training Data and Attentional Prior Fusion

Harnessing Manycore Processors with Distributed Memory for Accelerated Training of Sparse and Recurrent Models

DistRL: An Asynchronous Distributed Reinforcement Learning Framework for On-Device Control Agent

APT: Adaptive Personalized Training for Diffusion Models with Limited Data

Synchronizing Task Behavior: Aligning Multiple Tasks during Test-Time Training

TinyTrain: Resource-Aware Task-Adaptive Sparse Training of DNNs at the Data-Scarce Edge