Strategy-Switch: From All-Reduce to Parameter Server for Faster Efficient Training

Deep learning plays a pivotal role in numerous big data applications by enhancing the accuracy of models. However, the abundance of available data presents a challenge when training neural networks on a single node. Consequently, various distributed training methods have emerged. Among these, two pr...

Full description

Saved in:
Bibliographic Details
Main Authors: Nikodimos Provatas, Iasonas Chalas, Ioannis Konstantinou, Nectarios Koziris
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10836684/
Tags: Add Tag
No Tags, Be the first to tag this record!