Cross-layer efforts for energy-efficient computing: towards peta operations per second per watt

Xiaobo Sharon HU; Michael NIEMIER

doi:10.1631/FITEE.1800466

Your Location：

Home >

Browse articles >

Cross-layer efforts for energy-efficient computing: towards peta operations per second per watt

Special Issue on Post-exascale Supercomputing | Updated：2022-05-19

- Cross-layer efforts for energy-efficient computing: towards peta operations per second per watt
- 高效节能计算的跨层设计：为实现每瓦特电力每秒千万亿次运算
- Frontiers of Information Technology & Electronic Engineering Vol. 19, Issue 10, Pages: 1209-1223(2018)
- Affiliations：
  
  Department of Computer Science and Engineering, University of Notre Dame, Notre Dame, IN 46556, USA
- Author bio：
  
  Xiaobo Sharon HU, E-mail: shu@nd.edu
  [ "Michael NIEMIER, E-mail: mniemier@nd.edu" ]
- Funds：
- DOI：10.1631/FITEE.1800466
  CLC： TP183;TP302
- Received：05 August 2018，
  
  Revised：2018-10-10，
  
  Published：2018-10
- Accepted：
Scan QR Code
Xiaobo Sharon HU, Michael NIEMIER. Cross-layer efforts for energy-efficient computing: towards peta operations per second per watt[J]. Frontiers of Information Technology & Electronic Engineering, 2018, 19(10): 1209-1223.
DOI：

Xiaobo Sharon HU, Michael NIEMIER. Cross-layer efforts for energy-efficient computing: towards peta operations per second per watt[J]. Frontiers of Information Technology & Electronic Engineering, 2018, 19(10): 1209-1223. DOI： 10.1631/FITEE.1800466.

摘要

由于基于摩尔定律的器件缩小及其性能增长趋势正在放缓，实现快速和高效节能信息处理的新技术和计算模型越来越被关注。与此同时，越来越多证据表明，对于传统布尔电路和冯诺依曼处理器，超CMOS器件很难与CMOS技术竞争。开发利用新兴器件的独特性能，特别是在非传统电路和架构背景下，具有提供在功率、性能和能力方面数十或百、千倍的改进潜力。为充分发挥超CMOS器件的优势，从器件到电路到体系结架再到算法的跨层设计工作不可或缺。在此背景下，本文研究了嵌入式应用中的高性能神经网络加速器，重点阐述了基于非传统器件技术、电路样式到架构的跨层工作的几种深度神经网络加速器的设计，介绍了应用级基准验证研究工作。讨论表明，跨层设计工作的确可以在实现极大规模高效节能处理方面带来数量级的改进。

Abstract

As Moore's law based device scaling and accompanying performance scaling trends are slowing down

there is increasing interest in new technologies and computational models for fast and more energy-efficient information processing. Meanwhile

there is growing evidence that

with respect to traditional Boolean circuits and von Neumann processors

it will be challenging for beyond-CMOS devices to compete with the CMOS technology. Exploiting unique characteristics of emerging devices

especially in the context of alternative circuit and architectural paradigms

has the potential to offer orders of magnitude improvement in terms of power

performance

and capability. To take full advantage of beyond-CMOS devices

cross-layer efforts spanning from devices to circuits to architectures to algorithms are indispensable. This study examines energy-efficient neural network accelerators for embedded applications in this context. Several deep neural network accelerator designs based on cross-layer efforts spanning from alternative device technologies

circuit styles

to architectures are highlighted. Application-level benchmarking studies are presented. The discussions demonstrate that cross-layer efforts indeed can lead to orders of magnitude gain towards achieving extreme-scale energy-efficient processing.

关键词

Keywords

references

UE Avci , , , R Rios , , , K Kuhn , , , 等 . . Comparison of performance, switching energy and process variations for the TFET and MOSFET in logic . . Symp. on VLSI Technology, Digest of Technical Papers , , 2011 . . p.124 - - 125 . . . .

A Aziz , , , ET Breyer , , , A Chen , , , 等 . . Computing with ferroelectric FETs: devices, models, systems, and applications . . Proc Design, Automation & Test in Europe Conf Exhibition , , 2018 . . p.1289 - - 1298 . . DOI: 10.23919/DATE.2018.8342213 http://doi.org/10.23919/DATE.2018.8342213 . .

L Bottou . . Large-scale machine learning with stochastic gradient descent . . Proc 19 th Int Conf on Computational Statistics , , 2010 . . p.177 - - 186 . . DOI: 10.1007/978-3-7908-2604-3_16 http://doi.org/10.1007/978-3-7908-2604-3_16 . .

XM Chen , , , XZ Yin , , , M Niemier , , , 等 . . Design and optimization of FeFET-based crossbars for binary convolution neural networks . . Proc Design, Automation & Test in Europe Conf Exhibition , , 2018 . . p.1205 - - 1210 . . DOI: 10.23919/DATE.2018.8342199 http://doi.org/10.23919/DATE.2018.8342199 . .

YH Chen , , , T Krishna , , , JS Emer , , , 等 . . Eyeriss: an energy-efficient reconfigurable accelerator for deep convolutional neural networks . . IEEE J Sol-State Circ , , 2017 . . 52 ( ( 1 ): ): 127 - - 138 . . DOI: 10.1109/JSSC.2016.2616357 http://doi.org/10.1109/JSSC.2016.2616357 . .

LO Chua , , , T Roska . . Cellular Neural Networks and Visual Computing: Foundations and Applications , , : : New York, NY, USA Cambridge University Press , , 2002 . . .

LO Chua , , , L Yang . . Cellular neural networks: theory . . IEEE Trans Circ Syst , , 1988 . . 35 ( ( 10 ): ): 1257 - - 1272 . . DOI: 10.1109/31.7600 http://doi.org/10.1109/31.7600 . .

GE Dahl , , , TN Sainath , , , GE Hinton . . Improving deep neural networks for LVCSR using rectified linear units and dropout . . Proc IEEE Int Conf on Acoustics, Speech and Signal Processing , , 2013 . . p.8609 - - 8613 . . DOI: 10.1109/ICASSP.2013.6639346 http://doi.org/10.1109/ICASSP.2013.6639346 . .

H Esmaeilzadeh , , , E Blem , , , Amant R St. , , , 等 . . Dark silicon and the end of multicore scaling . . Proc 38 th Annual Int Symp on Computer Architecture , , 2011 . . p.365 - - 376 . . DOI: 10.1145/2024723.2000108 http://doi.org/10.1145/2024723.2000108 . .

H Esmaeilzadeh , , , E Blem , , , R St. Amant , , , 等 . . Power challenges may end the multicore era . . Commun ACM , , 2013 . . 56 ( ( 2 ): ): 93 - - 102 . . DOI: 10.1145/2408776.2408797 http://doi.org/10.1145/2408776.2408797 . .

S George , , , A Aziz , , , XQ Li , , , 等 . . Device circuit co design of FeFET based logic for low voltage processors . . Proc IEEE Computer Society Annual Symp on VLSI , , 2016a . . p.649 - - 654 . . DOI: 10.1109/ISVLSI.2016.116 http://doi.org/10.1109/ISVLSI.2016.116 . .

S George , , , KS Ma , , , A Aziz , , , 等 . . Nonvolatile memory design based on ferroelectric FETs . . Proc 53 rd Annual Design Automation Conf, Article 118 , , 2016b . . DOI: 10.1145/2897937.2898050 http://doi.org/10.1145/2897937.2898050 . .

A Horvth , , , M Hillmer , , , QW Lou , , , 等 . . Cellular neural network friendly convolutional neural networks—CNNs with CNNs . . Proc Design, Automation & Test in Europe Conf & Exhibition , , 2017 . . p.145 - - 150 . . DOI: 10.23919/DATE.2017.7926973 http://doi.org/10.23919/DATE.2017.7926973 . .

AM Ionescu , , , H Riel . . Tunnel field-effect transistors as energy-efficient electronic switches . . Nature , , 2011 . . 479 ( ( 7373 ): ): 329 - - 337 . . DOI: 10.1038/nature10679 http://doi.org/10.1038/nature10679 . .

H Kam , , , TJK Liu , , , E Alon . . Design requirements for steeply switching logic devices . . IEEE Trans Electron Dev , , 2012 . . 59 ( ( 2 ): ): 326 - - 334 . . DOI: 10.1109/TED.2011.2175484 http://doi.org/10.1109/TED.2011.2175484 . .

Y Khatami , , , K Banerjee . . Steep subthreshold slope n- and p-type tunnel-FET devices for low-power and energy-efficient digital circuits . . IEEE Trans Electron Dev , , 2009 . . 56 ( ( 11 ): ): 2752 - - 2761 . . DOI: 10.1109/TED.2009.2030831 http://doi.org/10.1109/TED.2009.2030831 . .

K Kim , , , S Lee , , , JY Kim , , , 等 . . A 125 GOPS 583 mW network-on-chip based parallel processor with bio-inspired visual attention engine . . IEEE J Sol-State Circ , , 2008 . . 44 ( ( 1 ): ): 136 - - 147 . . DOI: 10.1109/JSSC.2008.2007157 http://doi.org/10.1109/JSSC.2008.2007157 . .

Y LeCun , , , L Bottou , , , Y Bengio , , , 等 . . Gradient-based learning applied to document recognition . . Proc IEEE , , 1998 . . 86 ( ( 11 ): ): 2278 - - 2324 . . DOI: 10.1109/5.726791 http://doi.org/10.1109/5.726791 . .

MO Li , , , RS Yan , , , D Jena , , , 等 . . Two-dimensional heterojunction interlayer tunnel FET (Thin-TFET): from theory to applications . . Proc IEEE Int Electron Devices Meeting , , 2016 . . p.504 - - 507 . . DOI: 10.1109/IEDM.2016.7838451 http://doi.org/10.1109/IEDM.2016.7838451 . .

HC Liu , , , S Datta , , , M Shoaran , , , 等 . . Tunnel FET-based ultra-low power, low-noise amplifier design for bio-signal acquisition . . Proc IEEE/ACM Int Symp on Low Power Electronics and Design , , 2014 . . p.57 - - 62 . . DOI: 10.1145/2627369.2627631 http://doi.org/10.1145/2627369.2627631 . .

QW Lou , , , I Palit , , , A Horvth , , , 等 . . TFET-based operational transconductance amplifier design for CNN systems . . Proc 25 th Edition on Great Lakes Symp on VLSI , , 2015 . . p.277 - - 282 . . DOI: 10.1145/2742060.2742089 http://doi.org/10.1145/2742060.2742089 . .

QW Lou , , , CY Pan , , , J McGuinness , , , 等 . . A mixed signal architecture for convolutional neural networks . . To appear in arXiv , , 2018 . . .

JE Molinar-Solis , , , F Gomez-Castaneda , , , JA Moreno-Cadenas , , , 等 . . Programmable CMOS CNN cell based on floating-gate inverter unit . . J VLSI Signal Process Syst Signal Image Video Technol , , 2007 . . 49 ( ( 1 ): ): 207 - - 216 . . DOI: 10.1007/s11265-007-0056-7 http://doi.org/10.1007/s11265-007-0056-7 . .

B Moons , , , M Verhelst . . A 0.3-2.6 TOPS/W precision-scalable processor for real-time large-scale ConvNets . . Proc IEEE Symp on VLSI Circuits , , 2016 . . p.1 - - 2 . . DOI: 10.1109/VLSIC.2016.7573525 http://doi.org/10.1109/VLSIC.2016.7573525 . .

DE Nikonov , , , IA Young . . Overview of beyond-CMOS devices and a uniform methodology for their benchmarking . . Proc IEEE , , 2013 . . 101 ( ( 12 ): ): 2498 - - 2533 . . DOI: 10.1109/JPROC.2013.2252317 http://doi.org/10.1109/JPROC.2013.2252317 . .

DE Nikonov , , , IA Young . . Benchmarking of beyond-CMOS exploratory devices for logic integrated circuits . . IEEE J Explor Sol-State Comput Dev Circ , , 2015 . . 1 3 - - 11 . . DOI: 10.1109/JXCDC.2015.2418033 http://doi.org/10.1109/JXCDC.2015.2418033 . .

CY Pan , , , A Naeemi . . Beyond-CMOS device benchmarking for Boolean and non-Boolean logic applications . . 2017a . . http://cn.arxiv.org/abs/1711.04295 http://cn.arxiv.org/abs/1711.04295 , , . .

CY Pan , , , A Naeemi . . Beyond-CMOS non-Boolean logic benchmarking: insights and future directions . . Proc Design, Automation & Test in Europe Conf & Exhibition , , 2017b . . p.133 - - 138 . . DOI: 10.23919/DATE.2017.7926971 http://doi.org/10.23919/DATE.2017.7926971 . .

R Perricone , , , XS Hu , , , J Nahas , , , 等 . . Can beyond-CMOS devices illuminate dark silicon . . Design, Automation Test in Europe Conf Exhibition , , 2016 . . p.13 - - 18 . . . .

B Reagen , , , P Whatmough , , , R Adolf , , , 等 . . Minerva: enabling low-power, highly-accurate deep neural network accelerators . . Proc ACM/IEEE 43 rd Annual Int Symp on Computer Architecture , , 2016 . . p.267 - - 278 . . DOI: 10.1109/ISCA.2016.32 http://doi.org/10.1109/ISCA.2016.32 . .

D Reis , , , M Niemier , , , X Hu . . Computing in memory with FeFETs . . Proc IEEE/ACM Int Symp on Low Power Electronics and Design , , 2018 . . p.1 - - 6 . . . .

A Rodriguez-Vzquez , , , G Lin-Cembrano , , , L Carranza , , , 等 . . Ace16k: the third generation of mixed-signal SIMD-CNN ACE chips toward VSoCs . . IEEE Trans Circ Syst I , , 2004 . . 51 ( ( 5 ): ): 851 - - 863 . . DOI: 10.1109/TCSI.2004.827621 http://doi.org/10.1109/TCSI.2004.827621 . .

S Salahuddin , , , S Datta . . Use of negative capacitance to provide voltage amplification for low power nanoscale devices . . Nano Lett , , 2008 . . 8 ( ( 2 ): ): 405 - - 410 . . DOI: 10.1021/nl071804g http://doi.org/10.1021/nl071804g . .

L Salmon . . A DARPA Perspective . . 2017 . . https://www.src.org/calendar/e006128/agenda/salmon-darpa.pdf https://www.src.org/calendar/e006128/agenda/salmon-darpa.pdf , , . .

M Scheutz , , , J McRaven , , , G Cserey . . Fast, reliable, adaptive, bimodal people tracking for indoor environments . . Proc IEEE/RSJ Int Conf on Intelligent Robots and Systems , , 2004 . . p.1347 - - 1352 . . DOI: 10.1109/IROS.2004.1389583 http://doi.org/10.1109/IROS.2004.1389583 . .

AC Seabaugh , , , Q Zhang . . Low-voltage tunnel transistors for beyond CMOS logic . . Proc IEEE , , 2010 . . 98 ( ( 12 ): ): 2095 - - 2110 . . DOI: 10.1109/JPROC.2010.2070470 http://doi.org/10.1109/JPROC.2010.2070470 . .

B Sedighi , , , XS Hu , , , HC Liu , , , 等 . . Analog circuit design using tunnel-FETs . . IEEE Trans Circ Syst I , , 2015 . . 62 ( ( 1 ): ): 39 - - 48 . . DOI: 10.1109/TCSI.2014.2342371 http://doi.org/10.1109/TCSI.2014.2342371 . .

C Szegedy , , , V Vanhoucke , , , S Ioffe , , , 等 . . Rethinking the inception architecture for computer vision . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2016 . . p.2818 - - 2826 . . DOI: 10.1109/CVPR.2016.308 http://doi.org/10.1109/CVPR.2016.308 . .

P Szolgay , , , I Szatmari , , , K Laszlo . . A fast fixed point learning method to implement associative memory on CNNs . . IEEE Trans Circ Syst I , , 1997 . . 44 ( ( 4 ): ): 362 - - 366 . . DOI: 10.1109/81.563627 http://doi.org/10.1109/81.563627 . .

TQ Tang , , , LX Xia , , , BX Li , , , 等 . . Binary convolutional neural network on RRAM . . Proc 22 nd Asia and South Pacific Design Automation Conf , , 2017 . . p.782 - - 787 . . DOI: 10.1109/ASPDAC.2017.7858419 http://doi.org/10.1109/ASPDAC.2017.7858419 . .

L Wan , , , M Zeiler , , , S Zhang , , , 等 . . Regularization of neural networks using dropconnect . . Proc 30 th Int Conf on Machine Learning , , 2013 . . p.1058 - - 1066 . . . .

L Wang , , , JP de Gyvez , , , E Sanchez-Sinencio . . Time multiplexed color image processing based on a CNN with cell-state outputs . . IEEE Trans VLSI Syst , , 1998 . . 6 ( ( 2 ): ): 314 - - 322 . . DOI: 10.1109/92.678895 http://doi.org/10.1109/92.678895 . .

PN Whatmough , , , SK Lee , , , H Lee , , , 等 . . 14.3 A 28nm SoC with a 1.2GHz 568nJ/prediction sparse deep-neural-network engine with >0.1 timing error rate tolerance for IoT applications . . Proc IEEE Int Solid-State Circuits Conf , , 2017 . . p.242 - - 243 . . DOI: 10.1109/ISSCC.2017.7870351 http://doi.org/10.1109/ISSCC.2017.7870351 . .

XW Xu , , , Q Lu , , , TC Wang , , , 等 . . Edge segmentation: empowering mobile telemedicine with compressed cellular neural networks . . Proc 36 th Int Conf on Computer-Aided Design , , 2017 . . p.880 - - 887 . . DOI: 10.1109/ICCAD.2017.8203873 http://doi.org/10.1109/ICCAD.2017.8203873 . .

XZ Yin , , , A Aziz , , , J Nahas , , , 等 . . Exploiting ferroelectric FETs for low-power non-volatile logic-in-memory circuits . . Proc IEEE/ACM Int Conf on Computer-Aided Design , , 2016a . . p.1 - - 8 . . DOI: 10.1145/2966986.2967037 http://doi.org/10.1145/2966986.2967037 . .

XZ Yin , , , B Sedighi , , , M Niemier , , , 等 . . Design of latches and flip-flops using emerging tunneling devices . . Proc Design, Automation & Test in Europe Conf & Exhibition , , 2016b . . p.1150 - - 1155 . . DOI: 10.3850/9783981537079_0669 http://doi.org/10.3850/9783981537079_0669 . .

XZ Yin , , , M Niemier , , , XS Hu . . Design and benchmarking of ferroelectric FET based TCAM . . Proc Design, Automation & Test in Europe Conf & Exhibition , , 2017 . . p.1448 - - 1453 . . DOI: 10.23919/DATE.2017.7927219 http://doi.org/10.23919/DATE.2017.7927219 . .

W Zhao , , , Y Cao . . New generation of predictive technology model for sub-45 nm early design exploration . . IEEE Trans Electron Dev , , 2006 . . 53 ( ( 11 ): ): 2816 - - 2823 . . DOI: 10.1109/TED.2006.884077 http://doi.org/10.1109/TED.2006.884077 . .

G Zhou , , , R Li , , , T Vasen , , , 等 . . Novel gate-recessed vertical InAs/GaSb TFETs with record high ION of 180 μA/μm at V DS =0.5 V . . Proc Int Electron Devices Meeting , , 2012 . . p.777 - - 780 . . DOI: 10.1109/IEDM.2012.6479154 http://doi.org/10.1109/IEDM.2012.6479154 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰