The rise of high-throughput computing

Ning-hui SUN; Yun-gang BAO; Dong-rui FAN

doi:10.1631/FITEE.1800501

Your Location：

Home >

Browse articles >

The rise of high-throughput computing

Special Issue on Post-exascale Supercomputing | Updated：2022-05-19

- The rise of high-throughput computing
- 高通量计算的兴起
- Frontiers of Information Technology & Electronic Engineering Vol. 19, Issue 10, Pages: 1245-1250(2018)
- Affiliations：
  
  State Key Laboratory of Computer Architecture, Institute of Computing Technology, Chinese Academy of Sciences, University of Chinese Academy of Sciences, Beijing 100080, China
- Author bio：
  
  Ning-hui SUN, E-mail: snh@ict.ac.cn
  [ "Yun-gang BAO, E-mail: baoyg@ict.ac.cn" ]
  [ "Dong-rui FAN, E-mail: fandr@ict.ac.cn" ]
- Funds：
- DOI：10.1631/FITEE.1800501
  CLC： TP303
- Received：22 August 2018，
  
  Revised：2018-10-10，
  
  Published：2018-10
- Accepted：
Scan QR Code
Ning-hui SUN, Yun-gang BAO, Dong-rui FAN. The rise of high-throughput computing[J]. Frontiers of Information Technology & Electronic Engineering, 2018, 19(10): 1245-1250.
DOI：

Ning-hui SUN, Yun-gang BAO, Dong-rui FAN. The rise of high-throughput computing[J]. Frontiers of Information Technology & Electronic Engineering, 2018, 19(10): 1245-1250. DOI： 10.1631/FITEE.1800501.

摘要

近年来，云计算、人工智能和物联网等新兴计算应用的出现，对计算机系统设计提出3个共同要求：高利用率、高吞吐量和低延迟。在这里，这些被称为"高通量计算"的要求。我们进一步提出一种新指标，称为"系统熵"，用于测量计算机系统的混乱程度和不确定性。我们认为，与追求高性能和低功耗的传统计算系统的设计不同，高通量计算应致力于实现低并发性。然而，从计算机体系结构角度看，高通量计算面临两大挑战：（1）如何充分利用应用程序数据的并行和并发执行来实现高吞吐量；（2）如何获得低延迟，即便在具有高利用率的数据路径中发生严重争用的情况下。为应对这两个挑战，引入两种技术：片上数据流体系结构和标签化冯诺依曼体系结构。构建了两个可以实现高吞吐量和低延迟的原型，显著降低了系统熵。

Abstract

In recent years

the advent of emerging computing applications

such as cloud computing

artificial intelligence

and the Internet of Things

has led to three common requirements in computer system design: high utilization

high throughput

and low latency. Herein

these are referred to as the requirements of `high-throughput computing (HTC)'. We further propose a new indicator called 'sysentropy' for measuring the degree of chaos and uncertainty within a computer system. We argue that unlike the designs of traditional computing systems that pursue high performance and low power consumption

HTC should aim at achieving low sysentropy. However

from the perspective of computer architecture

HTC faces two major challenges that relate to (1) the full exploitation of the application's data parallelism and execution concurrency to achieve high throughput

and (2) the achievement of low latency

even in the cases at which severe contention occurs in data paths with high utilization. To overcome these two challenges

we introduce two techniques: on-chip data flow architecture and labeled von Neumann architecture. We build two prototypes that can achieve high throughput and low latency

thereby significantly reducing sysentropy.

关键词

Keywords

references

YG Bao , , , S Wang . . Labeled von Neumann architecture for software-defined cloud . . J Comput Sci Technol , , 2017 . . 32 ( ( 2 ): ): 219 - - 223 . . DOI: 10.1007/s11390-017-1716-0 http://doi.org/10.1007/s11390-017-1716-0 . .

LA Barroso , , , J Clidaras , , , U Hlzle . . The Datacenter as a Computer: an Introduction to the Design of Warehouse-Scale Machines , , 2 nd Ed. : : USA Morgan & Claypool Publishers , , 2013 . . DOI: 10.2200/S00516ED2V01Y201306CAC024 http://doi.org/10.2200/S00516ED2V01Y201306CAC024 . .

JB Dennis , , , JB Fosseen , , , JP Linderman . . Data flow schemas . . Int Symp on Theoretical Programming , , 1974 . . p.187 - - 216 . . DOI: 10.1007/3-540-06720-5_15 http://doi.org/10.1007/3-540-06720-5_15 . .

DR Fan , , , WM Li , , , XC Ye , , , 等 . . SmarCo: an efficient many-core processor for high-throughput applications in datacenters . . IEEE Int Symp on High Performance Computer Architecture , , 2018 . . p.596 - - 607 . . DOI: 10.1109/HPCA.2018.00057 http://doi.org/10.1109/HPCA.2018.00057 . .

A Greenberg . . SDN for the cloud . . Keynote of SIGCOMM , , 2015 . . .

R Kapoor , , , G Porter , , , M Tewari , , , 等 . . Chronos: predictable low latency for data center applications . . Proc 3 rd ACM Symp on Cloud Computing , , 2012 . . p.9 DOI: 10.1145/2391229.2391238 http://doi.org/10.1145/2391229.2391238 . .

H Kasture , , , D Sanchez . . Tailbench: a benchmark suite and evaluation methodology for latency-critical applications . . IEEE Int Symp on Workload Characterization , , 2016 . . p.1 - - 10 . . DOI: 10.1109/IISWC.2016.7581261 http://doi.org/10.1109/IISWC.2016.7581261 . .

M Livny . . From Principles to Capabilities-the Birth and Evolution of High Throughput Computing , , : : USA Wisconsin Institutes for Discovery, University of MadisonWisconsin , , 2013 . . .

JY Ma , , , HB Wang , , , LX Zhang , , , 等 . . Supporting differentiated services in computers via programmable architecture for resourcing-on-demand (PARD) . . ACM SIGPLAN Not , , 2015 . . 50 ( ( 4 ): ): 131 - - 143 . . DOI: 10.1145/2775054.2694382 http://doi.org/10.1145/2775054.2694382 . .

Y Xie . . Technology-driven architecture innovation: challenges and opportunities . . Proc 43 rd ACM/IEEE Int Symp on Computer Architecture, Architecture 2030 Workshop , , 2016 . . .

ZW Xu . . How much power is needed for a billion-thread high-throughput server? . . Front Comput Sci , , 2012 . . 6 ( ( 4 ): ): 339 - - 346 . . DOI: 10.1007/s11704-012-2071-5 http://doi.org/10.1007/s11704-012-2071-5 . .

ZW Xu , , , CD Li . . Low-entropy cloud computing systems . . Sci Sin Inform , , 2017 . . 47 ( ( 9 ): ): 1149 - - 1163 . . DOI: 10.1360/N112017-00069 http://doi.org/10.1360/N112017-00069 . .

ZW Xu , , , XB Chi , , , N Xiao . . High-performance computing environment: a review of twenty years of experiments in China . . Nat Sci Rev , , 2016 . . 3 ( ( 1 ): ): 36 - - 48 . . DOI: 10.1093/nsr/nww001 http://doi.org/10.1093/nsr/nww001 . .

Z Yu . . Labeled RISC-V: a new perspective on softwaredefined architecture . . Proc 6 th RISC-V Workshop , , 2017 . . p.7 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰