Your Location:
Home >
Browse articles >
Automatic parallelism strategy generation with minimal memory redundancy
Regular Papers | Updated:2025-03-13
    • Automatic parallelism strategy generation with minimal memory redundancy

      Enhanced Publication
    • 最小化内存冗余的自动并行策略生成方法
    • In the field of large-scale deep learning, a novel algorithm has been proposed to generate optimal parallelism strategies with minimal memory redundancy. Expert xx established the redundant memory cost model, which provides solutions to solve memory overhead problems in distributed training.
    • Frontiers of Information Technology & Electronic Engineering   Vol. 26, Issue 1, Pages: 109-118(2025)
    • DOI:10.1631/FITEE.2300684    

      CLC: TP181
    • Received:10 October 2023

      Revised:17 October 2023

      Published Online:27 December 2024

      Published:2025-01

    Scan QR Code

  • Yanqi SHI, Peng LIANG, Hao ZHENG, et al. Automatic parallelism strategy generation with minimal memory redundancy[J]. Frontiers of information technology & electronic engineering, 2025, 26(1): 109-118. DOI: 10.1631/FITEE.2300684.

  •  
  •  

0

Views

110

Downloads

0

CSCD

>
Alert me when the article has been cited
Submit
Tools
Download
Export Citation
Share
Add to favorites
Add to my album

Related Articles

Visual knowledge in the big model era: retrospect and prospect
Quant 4.0: engineering quantitative investment with automated, explainable, and knowledge-driven artificial intelligence
Improved deep learning aided key recovery framework: applications to large-state block ciphers
Accurate estimation of 6-DoF tooth pose in 3D intraoral scans for dental applications using deep learning
Deep unfolding based channel estimation for wideband terahertz near-field massive MIMO systems

Related Author

Wenguan WANG
Yi YANG
Yunhe PAN
Jian GUO
Saizhuo WANG
Lionel M. NI
Heung-Yeung SHUM
Xiaowei LI

Related Institution

College of Computer Science and Technology, Zhejiang University
The Hong Kong University of Science and Technology
IDEA Research, International Digital Economy Academy
School of Cyber Science and Technology, Information Engineering University
Zhejiang University–University of Illinois at Urbana-Champaign Institute, Zhejiang University
0