A novel non-volatile memory storage system for I/O-intensive applications

Wen-bing HAN; Xiao-gang CHEN; Shun-fen LI; Ge-zi LI; Zhi-tang SONG; Da-gang LI; Shi-yan CHEN

doi:10.1631/FITEE.1700061

Your Location：

Home >

Browse articles >

A novel non-volatile memory storage system for I/O-intensive applications

Special Issue on Post-exascale Supercomputing | Updated：2022-05-19

- A novel non-volatile memory storage system for I/O-intensive applications
- 针对I/O密集型应用的新型非易失存储系统
- Frontiers of Information Technology & Electronic Engineering Vol. 19, Issue 10, Pages: 1291-1302(2018)
- Affiliations：
  
  Shanghai Institute of Micro-system and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China
  University of Chinese Academy of Sciences, Beijing 100080, China
  School of Electronics and Computer Engineering, Peking University, Shenzhen 518055, China
- Author bio：
  
  [ "Wen-bing HAN, E-mail: hwbx@mail.sim.ac.cn" ]
  Xiao-gang CHEN, E-mail: chenxg@mail.sim.ac.cn
- Funds：
- DOI：10.1631/FITEE.1700061
  CLC： TP333
- Received：20 January 2017，
  
  Revised：2018-10-15，
  
  Published：2018-10
- Accepted：
Scan QR Code
Wen-bing HAN, Xiao-gang CHEN, Shun-fen LI, et al. A novel non-volatile memory storage system for I/O-intensive applications[J]. Frontiers of Information Technology & Electronic Engineering, 2018, 19(10): 1291-1302.
DOI：

Wen-bing HAN, Xiao-gang CHEN, Shun-fen LI, et al. A novel non-volatile memory storage system for I/O-intensive applications[J]. Frontiers of Information Technology & Electronic Engineering, 2018, 19(10): 1291-1302. DOI： 10.1631/FITEE.1700061.

摘要

新型存储技术—如相变存储器（phase change memory

PCM）的兴起，为I/O密集型应用的高性能存储提供了新机遇。然而传统软件栈和硬件架构需要重构优化以提升I/O访问效率。此外，存储内计算技术已经成为当前研究热点，能有效减少I/O请求数量。提出一种基于相变存储器的新型存储系统，包括支持存储内计算的文件系统（in-storage processing enabled filesy stem

ISPFS）和可配置并行计算的存储内计算引擎。一方面，ISPFS充分利用新型非易失存储器（non-volatile memory

NVM）的特性，减少软件冗余和数据拷贝，提供低延迟、高性能的随机访问。另一方面，ISPFS通过命令文件将ISP指令发送给存储内计算引擎来处理I/O密集型任务。实验证明，ISPFS的吞吐量是EXT4文件系统的2–10倍。对于I/O密集型应用，该存储内计算方案比传统软件方案减少97%的I/O请求，效率提升19倍。

Abstract

The emerging memory technologies

such as phase change memory (PCM)

provide chances for highperformance storage of I/O-intensive applications. However

traditional software stack and hardware architecture need to be optimized to enhance I/O efficiency. In addition

narrowing the distance between computation and storage reduces the number of I/O requests and has become a popular research direction. This paper presents a novel PCMbased storage system. It consists of the in-storage processing enabled file system (ISPFS) and the configurable parallel computation fabric in storage

which is called an in-storage processing (ISP) engine. On one hand

ISPFS takes full advantage of non-volatile memory (NVM)'s characteristics

and reduces software overhead and data copies to provide low-latency high-performance random access. On the other hand

ISPFS passes ISP instructions through a command file and invokes the ISP engine to deal with I/O-intensive tasks. Extensive experiments are performed on the prototype system. The results indicate that ISPFS achieves 2 to 10 times throughput compared to EXT4. Our ISP solution also reduces the number of I/O requests by 97% and is 19 times more efficient than software implementation for I/O-intensive applications.

关键词

Keywords

references

J Axboe , , , AD Brunelle , , , N Scott . . blktrace(8) - Linux man page , , 2006 . . https://linux.die.net/man/8/blktrace https://linux.die.net/man/8/blktrace , , [Accessed on Jan. 19, 2016] . .

Q Cao . . SCMFS Performance Enhancement and Implementation on Mobile Platform . . MS Thesis, Texas A & M University, College Station, Texas , , 2012 . . .

AM Caulfield , , , S Swanson . . QuickSAN: a storage area network for fast, distributed, solid state disks . . Proc 40th Annual Int Symp on Computer Architecture , , 2013 . . p.464 - - 474 . . DOI: 10.1145/2485922.2485962 http://doi.org/10.1145/2485922.2485962 . .

CLP Chen , , , CY Zhang . . Data-intensive applications, challenges, techniques and technologies: a survey on big data . . Inform Sci , , 2014 . . 275 314 - - 347 . . DOI: 10.1016/j.ins.2014.01.015 http://doi.org/10.1016/j.ins.2014.01.015 . .

J Condit , , , EB Nightingale , , , C Frost , , , 等 . . Better I/O through byte-addressable, persistent memory . . Proc ACM SIGOPS 22nd Symp on Operating Systems Principles , , 2009 . . p.133 - - 146 . . DOI: 10.1145/1629575.1629589 http://doi.org/10.1145/1629575.1629589 . .

J Do , , , YS Kee , , , JM Patel , , , 等 . . Query processing on smart SSDs: opportunities and challenges . . ACM SIGMOD Int Conf on Management of Data , , 2013 . . p.1221 - - 1230 . . DOI: 10.1145/2463676.2465295 http://doi.org/10.1145/2463676.2465295 . .

E Doller , , , A Akel , , , J Wang , , , 等 . . DataCenter 2020: near-memory acceleration for data-oriented applications . . Symp on VLSI Circuits Digest of Technical Papers , , 2014 . . p.1 - - 4 . . DOI: 10.1109/VLSIC.2014.6858357 http://doi.org/10.1109/VLSIC.2014.6858357 . .

WB Han , , , XG Chen , , , M Zhou , , , 等 . . The storage system of PCM based on random access file system . . Proc SPIE , , 2016 . . 9818 98180G DOI: 10.1117/12.2245028 http://doi.org/10.1117/12.2245028 . .

SW Jun , , , M Liu , , , KE Fleming , , , 等 . . Scalable multi-access flash store for big data analytics . . Proc ACM/SIGDA Int Symp on Field-Programmable Gate Arrays , , 2014 . . p.55 - - 64 . . DOI: 10.1145/2554688.2554789 http://doi.org/10.1145/2554688.2554789 . .

SW Jun , , , M Liu , , , S Lee , , , 等 . . BlueDBM: an appliance for big data analytics . . Proc ACM/IEEE 42nd Annual Int Symp on Computer Architecture , , 2015 . . p.1 - - 13 . . DOI: 10.1145/2749469.2750412 http://doi.org/10.1145/2749469.2750412 . .

Y Kang , , , YS Kee , , , EL Miller , , , 等 . . Enabling costeffective data processing with smart SSD . . Proc IEEE 29th Symp on Mass Storage Systems and Technologies , , 2013 . . p.1 - - 12 . . DOI: 10.1109/MSST.2013.6558444 http://doi.org/10.1109/MSST.2013.6558444 . .

E Lee , , , H Bahn , , , S Yoo , , , 等 . . Empirical study of NVM storage: an operating system's perspective and implications . . Proc IEEE 22nd Int Symp on Modelling, Analysis & Simulation of Computer and Telecommunication Systems , , 2014 . . p.405 - - 410 . . DOI: 10.1109/MASCOTS.2014.56 http://doi.org/10.1109/MASCOTS.2014.56 . .

GZ Li , , , XG Chen , , , B Chen , , , 等 . . An FPGA enhanced extensible and parallel query storage system for emerging NVRAM . . IEICE Electron Expr , , 2016 . . 13 ( ( 4 ): ): 20151109 DOI: 10.1587/elex.13.20151109 http://doi.org/10.1587/elex.13.20151109 . .

Z Li , , , F Wang , , , JN Liu , , , 等 . . A user-visible solid-state storage system with software-defined fusion methods for PCM and NAND flash . . J Syst Archit , , 2016 . . 71 44 - - 61 . . DOI: 10.1016/j.sysarc.2016.08.005 http://doi.org/10.1016/j.sysarc.2016.08.005 . .

W Norcott , , , D Capps . . IOZONE filesystem benchmark , , 2016 . . http://www.iozone.org/ http://www.iozone.org/ , , [Accessed on Jan. 23, 2016] . .

S Qiu , , , ALN Reddy . . NVMFS: a hybrid file system for improving random write in NAND-flash SSD . . Proc IEEE 29th Symp on Mass Storage Systems and Technologies , , 2013 . . p.1 - - 5 . . DOI: 10.1109/MSST.2013.6558434 http://doi.org/10.1109/MSST.2013.6558434 . .

SAMSUNG . . In-storage compute: an ultimate solution for accelerating I/O-intensive applications , , 2015 . . http://www.flashmemorysummit.com/English/Collaterals/Proceedings/2015/20150813_S301D_Ki.pdf http://www.flashmemorysummit.com/English/Collaterals/Proceedings/2015/20150813_S301D_Ki.pdf , , [Accessed on Dec. 11, 2016] . .

EHM Sha , , , XZ Chen , , , Q Zhuge , , , 等 . . Designing an efficient persistent in-memory file system . . IEEE Nonvolatile Memory System and Applications Symp , , 2015 . . p.1 - - 6 . . DOI: 10.1109/NVMSA.2015.7304365 http://doi.org/10.1109/NVMSA.2015.7304365 . .

EHM Sha , , , XZ Chen , , , Q Zhuge , , , 等 . . A new design of in-memory file system based on file virtual address framework . . IEEE Trans Comput , , 2016 . . 65 ( ( 10 ): ): 2959 - - 2972 . . DOI: 10.1109/TC.2016.2516019 http://doi.org/10.1109/TC.2016.2516019 . .

A Szalay , , , J Gray . . 2020 computing: science in an exponential world . . Nature , , 2006 . . 440 ( ( 7083 ): ): 413 - - 414 . . DOI: 10.1038/440413a http://doi.org/10.1038/440413a . .

XJ Wu , , , ALN Reddy . . SCMFS: a file system for storage class memory . . Int Conf for High Performance Computing, Networking, Storage and Analysis , , 2011 . . p.1 - - 11 . . DOI: 10.1145/2063384.2063436 http://doi.org/10.1145/2063384.2063436 . .

XILINX . . Zynq-7000 all programmable SoC technical reference manual , , 2014 . . https://www.xilinx.com/support/documentation/user_guides/ug585-Zynq-7000-TRM.pdf https://www.xilinx.com/support/documentation/user_guides/ug585-Zynq-7000-TRM.pdf , , [Accessed on Dec. 11, 2016] . .

M Zhou , , , XG Chen , , , Y Liu , , , 等 . . Design and implementation of a random access file system for NVRAM . . IEICE Electron Expr , , 2016 . . 13 ( ( 4 ): ): 20151045 DOI: 10.1587/elex.13.20151045 http://doi.org/10.1587/elex.13.20151045 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

NICFS: a file system based on persistent memory and SmartNIC

SoftSSD: enabling rapid flash firmware prototyping for solid-state drives^&

An efficient wear-leveling-aware multi-grained allocator for persistent memory file systems^&

Moving from exascale to zettascale computing: challenges and techniques

A reliable and energy-efficient storage system with erasure coding cache

Related Author

Youyou LU

Yitian YANG

Zili SHAO

Tianyu WANG

Renhai CHEN

Jin XUE

Duo LIU

Shun NIE

Related Institution

Department of Computer Science and Technology, Tsinghua University

Department of Computer Science and Engineering, The Chinese University of Hong Kong

College of Intelligence and Computing, Tianjin University

State Key Laboratory of Public Big Data, College of Computer Science and Technology, Guizhou University

College of Computer Science, Chongqing University

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰