针对I/O密集型应用的新型非易失存储系统

韩文炳; 陈小刚; 李顺芬; 李鸽子; 宋志棠; 李大刚; 陈诗雁

doi:10.1631/FITEE.1700061

Your Location：

Home >

Browse articles >

针对I/O密集型应用的新型非易失存储系统

后E级超算专辑 | Updated：2022-05-19

- 针对I/O密集型应用的新型非易失存储系统
- A novel non-volatile memory storage system for I/O-intensive applications
- 信息与电子工程前沿（英文） 2018年19卷第10期页码：1291-1302
- Affiliations：
  
  Shanghai Institute of Micro-system and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China
  University of Chinese Academy of Sciences, Beijing 100080, China
  School of Electronics and Computer Engineering, Peking University, Shenzhen 518055, China
- Author bio：
  
  [ "Wen-bing HAN, E-mail: hwbx@mail.sim.ac.cn" ]
  Xiao-gang CHEN, E-mail: chenxg@mail.sim.ac.cn
- Funds：
  
  Project supported by the National Basic Research Program of China (No. 2017YFA0206101), the National Defense Innovation Fund of Chinese Academy of Sciences (No. CXJJ-16M106), the "Strategic Priority Research Program" of the Chinese Academy of Sciences (No. XDA09020402), and the Science and Technology Council of Shanghai, China (Nos. 14DZ2294900, 13ZR1447200, and 14ZR1447500)
- DOI：10.1631/FITEE.1700061
  中图分类号： TP333
- 收稿：2017-01-20，
  
  修回：2018-10-15，
  
  纸质出版：2018-10
- Accepted：
Scan QR Code
韩文炳, 陈小刚, 李顺芬, 等. 针对I/O密集型应用的新型非易失存储系统[J]. 信息与电子工程前沿（英文）, 2018,19(10):1291-1302.

Wen-bing HAN, Xiao-gang CHEN, Shun-fen LI, et al. A novel non-volatile memory storage system for I/O-intensive applications[J]. Frontiers of Information Technology & Electronic Engineering, 2018, 19(10): 1291-1302.
韩文炳, 陈小刚, 李顺芬, 等. 针对I/O密集型应用的新型非易失存储系统[J]. 信息与电子工程前沿（英文）, 2018,19(10):1291-1302. DOI： 10.1631/FITEE.1700061.

Wen-bing HAN, Xiao-gang CHEN, Shun-fen LI, et al. A novel non-volatile memory storage system for I/O-intensive applications[J]. Frontiers of Information Technology & Electronic Engineering, 2018, 19(10): 1291-1302. DOI： 10.1631/FITEE.1700061.

摘要

新型存储技术—如相变存储器（phase change memory

PCM）的兴起，为I/O密集型应用的高性能存储提供了新机遇。然而传统软件栈和硬件架构需要重构优化以提升I/O访问效率。此外，存储内计算技术已经成为当前研究热点，能有效减少I/O请求数量。提出一种基于相变存储器的新型存储系统，包括支持存储内计算的文件系统（in-storage processing enabled filesy stem

ISPFS）和可配置并行计算的存储内计算引擎。一方面，ISPFS充分利用新型非易失存储器（non-volatile memory

NVM）的特性，减少软件冗余和数据拷贝，提供低延迟、高性能的随机访问。另一方面，ISPFS通过命令文件将ISP指令发送给存储内计算引擎来处理I/O密集型任务。实验证明，ISPFS的吞吐量是EXT4文件系统的2–10倍。对于I/O密集型应用，该存储内计算方案比传统软件方案减少97%的I/O请求，效率提升19倍。

Abstract

The emerging memory technologies

such as phase change memory (PCM)

provide chances for highperformance storage of I/O-intensive applications. However

traditional software stack and hardware architecture need to be optimized to enhance I/O efficiency. In addition

narrowing the distance between computation and storage reduces the number of I/O requests and has become a popular research direction. This paper presents a novel PCMbased storage system. It consists of the in-storage processing enabled file system (ISPFS) and the configurable parallel computation fabric in storage

which is called an in-storage processing (ISP) engine. On one hand

ISPFS takes full advantage of non-volatile memory (NVM)'s characteristics

and reduces software overhead and data copies to provide low-latency high-performance random access. On the other hand

ISPFS passes ISP instructions through a command file and invokes the ISP engine to deal with I/O-intensive tasks. Extensive experiments are performed on the prototype system. The results indicate that ISPFS achieves 2 to 10 times throughput compared to EXT4. Our ISP solution also reduces the number of I/O requests by 97% and is 19 times more efficient than software implementation for I/O-intensive applications.

关键词

Keywords

references

J Axboe , , , AD Brunelle , , , N Scott . . blktrace(8) - Linux man page , , 2006 . . https://linux.die.net/man/8/blktrace https://linux.die.net/man/8/blktrace , , [Accessed on Jan. 19, 2016] . .

Q Cao . . SCMFS Performance Enhancement and Implementation on Mobile Platform . . MS Thesis, Texas A & M University, College Station, Texas , , 2012 . . .

AM Caulfield , , , S Swanson . . QuickSAN: a storage area network for fast, distributed, solid state disks . . Proc 40th Annual Int Symp on Computer Architecture , , 2013 . . p.464 - - 474 . . DOI: 10.1145/2485922.2485962 http://doi.org/10.1145/2485922.2485962 . .

CLP Chen , , , CY Zhang . . Data-intensive applications, challenges, techniques and technologies: a survey on big data . . Inform Sci , , 2014 . . 275 314 - - 347 . . DOI: 10.1016/j.ins.2014.01.015 http://doi.org/10.1016/j.ins.2014.01.015 . .

J Condit , , , EB Nightingale , , , C Frost , , , 等 . . Better I/O through byte-addressable, persistent memory . . Proc ACM SIGOPS 22nd Symp on Operating Systems Principles , , 2009 . . p.133 - - 146 . . DOI: 10.1145/1629575.1629589 http://doi.org/10.1145/1629575.1629589 . .

J Do , , , YS Kee , , , JM Patel , , , 等 . . Query processing on smart SSDs: opportunities and challenges . . ACM SIGMOD Int Conf on Management of Data , , 2013 . . p.1221 - - 1230 . . DOI: 10.1145/2463676.2465295 http://doi.org/10.1145/2463676.2465295 . .

E Doller , , , A Akel , , , J Wang , , , 等 . . DataCenter 2020: near-memory acceleration for data-oriented applications . . Symp on VLSI Circuits Digest of Technical Papers , , 2014 . . p.1 - - 4 . . DOI: 10.1109/VLSIC.2014.6858357 http://doi.org/10.1109/VLSIC.2014.6858357 . .

WB Han , , , XG Chen , , , M Zhou , , , 等 . . The storage system of PCM based on random access file system . . Proc SPIE , , 2016 . . 9818 98180G DOI: 10.1117/12.2245028 http://doi.org/10.1117/12.2245028 . .

SW Jun , , , M Liu , , , KE Fleming , , , 等 . . Scalable multi-access flash store for big data analytics . . Proc ACM/SIGDA Int Symp on Field-Programmable Gate Arrays , , 2014 . . p.55 - - 64 . . DOI: 10.1145/2554688.2554789 http://doi.org/10.1145/2554688.2554789 . .

SW Jun , , , M Liu , , , S Lee , , , 等 . . BlueDBM: an appliance for big data analytics . . Proc ACM/IEEE 42nd Annual Int Symp on Computer Architecture , , 2015 . . p.1 - - 13 . . DOI: 10.1145/2749469.2750412 http://doi.org/10.1145/2749469.2750412 . .

Y Kang , , , YS Kee , , , EL Miller , , , 等 . . Enabling costeffective data processing with smart SSD . . Proc IEEE 29th Symp on Mass Storage Systems and Technologies , , 2013 . . p.1 - - 12 . . DOI: 10.1109/MSST.2013.6558444 http://doi.org/10.1109/MSST.2013.6558444 . .

E Lee , , , H Bahn , , , S Yoo , , , 等 . . Empirical study of NVM storage: an operating system's perspective and implications . . Proc IEEE 22nd Int Symp on Modelling, Analysis & Simulation of Computer and Telecommunication Systems , , 2014 . . p.405 - - 410 . . DOI: 10.1109/MASCOTS.2014.56 http://doi.org/10.1109/MASCOTS.2014.56 . .

GZ Li , , , XG Chen , , , B Chen , , , 等 . . An FPGA enhanced extensible and parallel query storage system for emerging NVRAM . . IEICE Electron Expr , , 2016 . . 13 ( ( 4 ): ): 20151109 DOI: 10.1587/elex.13.20151109 http://doi.org/10.1587/elex.13.20151109 . .

Z Li , , , F Wang , , , JN Liu , , , 等 . . A user-visible solid-state storage system with software-defined fusion methods for PCM and NAND flash . . J Syst Archit , , 2016 . . 71 44 - - 61 . . DOI: 10.1016/j.sysarc.2016.08.005 http://doi.org/10.1016/j.sysarc.2016.08.005 . .

W Norcott , , , D Capps . . IOZONE filesystem benchmark , , 2016 . . http://www.iozone.org/ http://www.iozone.org/ , , [Accessed on Jan. 23, 2016] . .

S Qiu , , , ALN Reddy . . NVMFS: a hybrid file system for improving random write in NAND-flash SSD . . Proc IEEE 29th Symp on Mass Storage Systems and Technologies , , 2013 . . p.1 - - 5 . . DOI: 10.1109/MSST.2013.6558434 http://doi.org/10.1109/MSST.2013.6558434 . .

SAMSUNG . . In-storage compute: an ultimate solution for accelerating I/O-intensive applications , , 2015 . . http://www.flashmemorysummit.com/English/Collaterals/Proceedings/2015/20150813_S301D_Ki.pdf http://www.flashmemorysummit.com/English/Collaterals/Proceedings/2015/20150813_S301D_Ki.pdf , , [Accessed on Dec. 11, 2016] . .

EHM Sha , , , XZ Chen , , , Q Zhuge , , , 等 . . Designing an efficient persistent in-memory file system . . IEEE Nonvolatile Memory System and Applications Symp , , 2015 . . p.1 - - 6 . . DOI: 10.1109/NVMSA.2015.7304365 http://doi.org/10.1109/NVMSA.2015.7304365 . .

EHM Sha , , , XZ Chen , , , Q Zhuge , , , 等 . . A new design of in-memory file system based on file virtual address framework . . IEEE Trans Comput , , 2016 . . 65 ( ( 10 ): ): 2959 - - 2972 . . DOI: 10.1109/TC.2016.2516019 http://doi.org/10.1109/TC.2016.2516019 . .

A Szalay , , , J Gray . . 2020 computing: science in an exponential world . . Nature , , 2006 . . 440 ( ( 7083 ): ): 413 - - 414 . . DOI: 10.1038/440413a http://doi.org/10.1038/440413a . .

XJ Wu , , , ALN Reddy . . SCMFS: a file system for storage class memory . . Int Conf for High Performance Computing, Networking, Storage and Analysis , , 2011 . . p.1 - - 11 . . DOI: 10.1145/2063384.2063436 http://doi.org/10.1145/2063384.2063436 . .

XILINX . . Zynq-7000 all programmable SoC technical reference manual , , 2014 . . https://www.xilinx.com/support/documentation/user_guides/ug585-Zynq-7000-TRM.pdf https://www.xilinx.com/support/documentation/user_guides/ug585-Zynq-7000-TRM.pdf , , [Accessed on Dec. 11, 2016] . .

M Zhou , , , XG Chen , , , Y Liu , , , 等 . . Design and implementation of a random access file system for NVRAM . . IEICE Electron Expr , , 2016 . . 13 ( ( 4 ): ): 20151045 DOI: 10.1587/elex.13.20151045 http://doi.org/10.1587/elex.13.20151045 . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

NICFS: a file system based on persistent memory and SmartNIC

SoftSSD: enabling rapid flash firmware prototyping for solid-state drives^&

An efficient wear-leveling-aware multi-grained allocator for persistent memory file systems^&

Moving from exascale to zettascale computing: challenges and techniques

A reliable and energy-efficient storage system with erasure coding cache