Moving from exascale to zettascale computing: challenges and techniques

Xiang-ke LIAO; Kai LU; Can-qun YANG; Jin-wen LI; Yuan YUAN; Ming-che LAI; Li-bo HUANG; Ping-jing LU; Jian-bin FANG; Jing REN; Jie SHEN

doi:10.1631/FITEE.1800494

Your Location：

Home >

Browse articles >

Moving from exascale to zettascale computing: challenges and techniques

Special Issue on Post-exascale Supercomputing | Updated：2022-05-19

- Moving from exascale to zettascale computing: challenges and techniques
- 从E级计算到Z级计算的新挑战与新技术
- Frontiers of Information Technology & Electronic Engineering Vol. 19, Issue 10, Pages: 1236-1244(2018)
- Affiliations：
  
  College of Computer, National University of Defense Technology, Changsha 410073, China
- Author bio：
  
  Kai LU, E-mail: kailu@nudt.edu.cn
- Funds：
- DOI：10.1631/FITEE.1800494
  CLC： TP311
- Received：16 August 2018，
  
  Revised：2018-10-15，
  
  Published：2018-10
- Accepted：
Scan QR Code
Xiang-ke LIAO, Kai LU, Can-qun YANG, et al. Moving from exascale to zettascale computing: challenges and techniques[J]. Frontiers of Information Technology & Electronic Engineering, 2018, 19(10): 1236-1244.
DOI：

Xiang-ke LIAO, Kai LU, Can-qun YANG, et al. Moving from exascale to zettascale computing: challenges and techniques[J]. Frontiers of Information Technology & Electronic Engineering, 2018, 19(10): 1236-1244. DOI： 10.1631/FITEE.1800494.

摘要

高性能计算已成为促进传统与新兴领域科技创新取得进展的基础设施。随着高性能计算的发展，E级系统（每秒10

次浮点运算）预计2020年前后投入使用。实现E级计算后的10年（2020-2030）将成为E级计算向Z级计算（每秒10

次浮点运算）过渡的关键时期，计算能力提升将面临前所未有的挑战。从硬件和软件方面分析未来高性能计算的挑战，展望后E级计算时代的技术发展与革新，并提出未来实现E级计算向Z级计算过渡的可行性建议。

Abstract

High-performance computing (HPC) is essential for both traditional and emerging scientific fields

enabling scientific activities to make progress. With the development of high-performance computing

it is foreseeable that exascale computing will be put into practice around 2020. As Moore's law approaches its limit

high-performance computing will face severe challenges when moving from exascale to zettascale

making the next 10 years after 2020 a vital period to develop key HPC techniques. In this study

we discuss the challenges of enabling zettascale computing with respect to both hardware and software. We then present a perspective of future HPC technology evolution and revolution

leading to our main recommendations in support of zettascale computing in the coming future.

关键词

Keywords

references

E brahm , , , C Bekas , , , I Brandic , , , 等 . . Preparing HPC applications for exascale: challenges and recommendations . . 18 th Int Conf on Network-Based Information Systems , , 2015 . . p.401 - - 406 . . . .

M Asch , , , T Moore , , , R Badia , , , 等 . . Big data and extreme-scale computing: pathways to convergence- toward a shaping strategy for a future software and data ecosystem for scientific inquiry . . Int J High Perform Comput Appl , , 2018 . . 32 ( ( 4 ): ): 435 - - 479 . . DOI: 10.1177/1094342018778123 http://doi.org/10.1177/1094342018778123 . .

RK Cavin , , , P Lugli , , , VV Zhirnov . . Science and engineering beyond Moore's law . . Proc IEEE , , 2012 . . 100 1720 - - 1749 . . DOI: 10.1109/JPROC.2012.2190155 http://doi.org/10.1109/JPROC.2012.2190155 . .

FT Chong , , , D Franklin , , , M Martonosi . . Programming languages and compiler design for realistic quantum hardware . . Nature , , 2017 . . 549 ( ( 7671 ): ): 180 - - 187 . . DOI: 10.1038/nature23459 http://doi.org/10.1038/nature23459 . .

J Diaz , , , C Muoz-Caro , , , A Nio . . A survey of parallel programming models and tools in the multi and manycore era . . IEEE Trans Parall Distrib Syst , , 2012 . . 23 ( ( 8 ): ): 1369 - - 1386 . . DOI: 10.1109/TPDS.2011.308 http://doi.org/10.1109/TPDS.2011.308 . .

J Fang , , , AL Varbanescu , , , HJ Sips . . A comprehensive performance comparison of CUDA and OpenCL . . Int Conf on Parallel Processing , , 2011 . . p.216 - - 225 . . DOI: 10.1109/ICPP.2011.45 http://doi.org/10.1109/ICPP.2011.45 . .

JN Glosli , , , DF Richards , , , KJ Caspersen , , , 等 . . Extending stability beyond CPU millennium: a micronscale atomistic simulation of Kelvin-Helmholtz instability . . ACM/IEEE Conf on Supercomputing , , 2007 . . p.1 - - 11 . . DOI: 10.1145/1362622.1362700 http://doi.org/10.1145/1362622.1362700 . .

P Jacob , , , A Zia , , , O Erdogan , , , 等 . . Mitigating memory wall effects in high-clock-rate and multicore CMOS 3D processor memory stacks . . Proc IEEE , , 2009 . . 97 ( ( 1 ): ): 108 - - 122 . . DOI: 10.1109/JPROC.2008.2007472 http://doi.org/10.1109/JPROC.2008.2007472 . .

J Jeddeloh , , , B Keeth . . Hybrid memory cube new DRAM architecture increases density and performance . . Int Symp on VLSI Technology , , 2012 . . p.87 - - 88 . . DOI: 10.1109/VLSIT.2012.6242474 http://doi.org/10.1109/VLSIT.2012.6242474 . .

K Keeton . . The machine: an architecture for memorycentric computing . . 5 th Int Workshop on Runtime and Operating Systems for Supercomputers , , 2015 . . p.1 DOI: 10.1145/2768405.2768406 http://doi.org/10.1145/2768405.2768406 . .

NS Kim , , , D Chen , , , J Xiong , , , 等 . . Heterogeneous computing meets near-memory acceleration and high-level synthesis in the post-Moore era . . IEEE Micro , , 2017 . . 37 ( ( 4 ): ): 10 - - 18 . . DOI: 10.1109/MM.2017.3211105 http://doi.org/10.1109/MM.2017.3211105 . .

A Kolli , , , J Rosen , , , S Diestelhorst , , , 等 . . Delegated persist ordering . . 49 th Annual IEEE/ACM Int Symp on Microarchitecture , , 2016 . . p.1 - - 13 . . DOI: 10.1109/MICRO.2016.7783761 http://doi.org/10.1109/MICRO.2016.7783761 . .

R Lucas , , , J Ang , , , K Bergman , , , 等 . . Top10 exascale research challenges . . Department of Energy Office of Science , , 2014 . . https://science.energy.gov/~/media/ascr/ascac/pdf/meetings/20140210/Top10reportFEB14.pdf https://science.energy.gov/~/media/ascr/ascac/pdf/meetings/20140210/Top10reportFEB14.pdf , , . .

S Mishra , , , NK Chaudhary , , , K Singh . . Overview of optical interconnect technology . . Int J Sci Eng Res , , 2013 . . 3 ( ( 4 ): ): 364 - - 374 . . . .

S Rumley , , , D Nikolova , , , R Hendry , , , 等 . . Silicon photonics for exascale systems . . J Lightw Technol , , 2015 . . 33 ( ( 3 ): ): 547 - - 562 . . DOI: 10.1109/JLT.2014.2363947 http://doi.org/10.1109/JLT.2014.2363947 . .

B Schroeder , , , GA Gibson . . Understanding failures in petascale computers . . J Phys , , 2007 . . 78 ( ( 1 ): ): 012022 DOI: 10.1088/1742-6596/78/1/012022 http://doi.org/10.1088/1742-6596/78/1/012022 . .

J Shen , , , J Fang , , , HJ Sips , , , 等 . . An application-centric evaluation of OpenCL on multi-core CPUs . . Parall Comput , , 2013 . . 39 ( ( 12 ): ): 834 - - 850 . . DOI: 10.1016/j.parco.2013.08.009 http://doi.org/10.1016/j.parco.2013.08.009 . .

B Vinaik , , , R Puri . . Oracle's Sonoma processor: advanced low-cost SPARC processor for enterprise workloads . . IEEE Hot Chips 27 Symp , , 2015 . . p.1 - - 23 . . DOI: 10.1109/HOTCHIPS.2015.7477455 http://doi.org/10.1109/HOTCHIPS.2015.7477455 . .

MM Waldrop . . The chips are down for Moore's law . . Nature , , 2016 . . 530 ( ( 7589 ): ): 144 - - 147 . . DOI: 10.1038/530144a http://doi.org/10.1038/530144a . .

MV Wilkes . . The memory wall and the CMOS endpoint . . SIGARCH Comput Archit News , , 1995 . . 23 ( ( 4 ): ): 4 - - 6 . . DOI: 10.1145/218864.218865 http://doi.org/10.1145/218864.218865 . .

WA Wulf , , , SA McKee . . Hitting the memory wall: implications of the obvious . . SIGARCH Comput Archit News , , 1995 . . 23 ( ( 1 ): ): 20 - - 24 . . DOI: 10.1145/216585.216588 http://doi.org/10.1145/216585.216588 . .

W Xu , , , Y Lu , , , Q Li , , , 等 . . Hybrid hierarchy storage system in Milkyway-2 supercomputer . . Front Comput Sci , , 2014 . . 8 ( ( 3 ): ): 367 - - 377 . . DOI: 10.1007/s11704-014-3499-6 http://doi.org/10.1007/s11704-014-3499-6 . .

Z Xu , , , X Chi , , , N Xiao . . High-performance computing environment: a review of twenty years of experiments in China . . Nat Sci Rev , , 2016 . . 3 ( ( 1 ): ): 36 - - 48 . . DOI: 10.1093/nsr/nww001 http://doi.org/10.1093/nsr/nww001 . .

P Zhang , , , JB Fang , , , T Tang , , , 等 . . Auto-tuning streamed applications on Intel Xeon Phi . . IEEE Int Parallel and Distributed Processing Symp , , 2018 . . p.515 - - 525 . . DOI: 10.1109/IPDPS.2018.00061 http://doi.org/10.1109/IPDPS.2018.00061 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

SoftSSD: enabling rapid flash firmware prototyping for solid-state drives^&

OHTMA: an optimized heuristic topology-aware mapping algorithm on the Tianhe-3 exascale supercomputer prototype

FTRP: a new fault tolerance framework using process replication and prefetching for high-performance computing

Exploring high-performance processor architecture beyond the exascale

A novel non-volatile memory storage system for I/O-intensive applications

Related Author

Zili SHAO

Tianyu WANG

Renhai CHEN

Jin XUE

Xin-hai CHEN

Han XU

Xin-biao GAN

Yi-shui LI

Related Institution

Department of Computer Science and Engineering, The Chinese University of Hong Kong

College of Intelligence and Computing, Tianjin University

Science and Technology on Parallel and Distributed Processing Laboratory, National University of Defense Technology

National Supercomputer Center in Tianjin

State Key Laboratory of Mathematical Engineering and Advanced Computing

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰