NICFS: a file system based on persistent memory and SmartNIC

Yitian YANG; Youyou LU

doi:10.1631/FITEE.2200469

Your Location：

Home >

Browse articles >

NICFS: a file system based on persistent memory and SmartNIC

Special Feature on Design and Application of New Storage Systems | Updated：2023-05-31

- NICFS: a file system based on persistent memory and SmartNIC
- NICFS：基于持久化内存和智能网卡的文件系统
- Frontiers of Information Technology & Electronic Engineering Vol. 24, Issue 5, Pages: 675-687(2023)
- Affiliations：
  
  Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China
- Author bio：
  
  E-mail: yangyiti22@mails.tsinghua.edu.cn
  ‡ Corresponding author
- Funds：
- DOI：10.1631/FITEE.2200469
  CLC： TP212
- Received：15 October 2022，
  
  Accepted：22 February 2023，
  
  Published：0 May 2023
- Accepted：
Scan QR Code
Yitian YANG, Youyou LU. NICFS: a file system based on persistent memory and SmartNIC[J]. Frontiers of Information Technology & Electronic Engineering, 2023, 24(5): 675-687.
DOI：

Yitian YANG, Youyou LU. NICFS: a file system based on persistent memory and SmartNIC[J]. Frontiers of Information Technology & Electronic Engineering, 2023, 24(5): 675-687. DOI： 10.1631/FITEE.2200469.

摘要

持久化内存和智能网卡等新型硬件的涌现，为文件系统架构设计带来新机遇。本文设计并实现一个基于持久化内存和智能网卡的新型文件系统NICFS。我们将NICFS分为前端与后端。在前端，数据的写入以日志结构的方式追加写到持久化内存上，从而发挥持久化内存的快速持久化优势；在后端，日志中的数据在后台被获取、处理并写入到文件中，从而充分利用智能网卡的处理能力。实验结果显示，NICFS在大粒度和小粒度的读/写性能上分别比Ext4高出约21%/10%和19%/50%。

Abstract

Emergence of new hardware

including persistent memory and smart network interface card (SmartNIC)

has brought new opportunities to file system design. In this paper

we design and implement a new file system named NICFS based on persistent memory and SmartNIC. We divide the file system into two parts: the front end and the back end. In the front end

data writes are appended to the persistent memory in a log-structured way

leveraging the fast persistence advantage of persistent memory. In the back end

the data in logs are fetched

processed

and patched to files in the background

leveraging the processing capacity of SmartNIC. Evaluation results show that NICFS outperforms Ext4 by about 21%/10% and about 19%/50% on large and small reads/writes

respectively.

关键词

Keywords

references

Anderson TE , Canini M , Kim J , et al. , 2019 . Assise: performance and availability via NVM colocation in a distributed file system . https://arxiv.org/abs/1910.05106 https://arxiv.org/abs/1910.05106

Chen YM , Lu YY , Zhu BH , et al. , 2021 . Scalable persistent memory file system with kernel-userspace collaboration . Proc 19 th USENIX Conf on File and Storage Technologies , p. 81 - 95 .

Condit J , Nightingale EB , Frost C , et al. , 2009 . Better I/O through byte-addressable, persistent memory . Proc ACM SIGOPS 22 nd Symp on Operating Systems Principles , p. 133 - 146 .

Gray C , Cheriton D , 1989 . Leases: an efficient fault-tolerant mechanism for distributed file cache consistency . ACM SIGOPS Oper Syst Rev , 23 ( 5 ): 202 - 210 . doi: 10.1145/74851.74870 http://doi.org/10.1145/74851.74870

Kim J , Jang I , Reda W , et al. , 2021 . LineFS: efficient SmartNIC offload of a distributed file system with pipeline parallelism . Proc ACM SIGOPS 28 th Symp on Operating Systems Principles , p. 756 - 771 . doi: 10.1145/3477132.3483565 http://doi.org/10.1145/3477132.3483565

Lee C , Sim D , Hwang JY , et al. , 2015 . F2FS: a new file system for flash storage . Proc 13 th USENIX Conf on File and Storage Technologies , p. 273 - 286 .

Li JR , Lu YY , Wang Q , et al. , 2022 . AlNiCo: SmartNIC-accelerated contention-aware request scheduling for transaction processing . Proc USENIX Annual Technical Conf , p. 951 - 966 .

Liang Z , Lombardi J , Chaarawi M , et al. , 2020 . DAOS: a scale-out high performance storage stack for storage class memory . Proc 6 th Asian Conf on Supercomputing Frontiers , p. 40 - 54 . doi: 10.1007/978-3-030-48842-0_3 http://doi.org/10.1007/978-3-030-48842-0_3

Lu YY , Shu JW , Zheng WM , 2013 . Extending the lifetime of flash-based storage through reducing write amplification from file systems . Proc 11 th USENIX Conf on File and Storage Technologies , p. 257 - 270 . doi: 10.5555/2591272.2591299 http://doi.org/10.5555/2591272.2591299

Lu YY , Shu JW , Wang W , 2014 . ReconFS: a reconstructable file system on flash storage . Proc 12 th USENIX Conf on File and Storage Technologies , p. 75 - 88 .

Lu YY , Shu JW , Chen YM , et al. , 2017 . Octopus: an RDMA-enabled distributed persistent memory file system . Proc USENIX Annual Technical Conf , p. 773 - 785 .

Lu YY , Shu JW , Zhang JC , 2019 . Mitigating synchronous I/O overhead in file systems on open-channel SSDs . ACM Trans Stor , 15 ( 3 ): 17 . doi: 10.1145/3319369 http://doi.org/10.1145/3319369

NVIDIA , 2022 . DOCA . https://developer.nvidia.com/networking/doca https://developer.nvidia.com/networking/doca [Accessed on Oct. 8, 2022 ].

Ou JX , Shu JW , Lu YY , 2016 . A high performance file system for non-volatile main memory . Proc 11 th European Conf on Computer Systems , Article 12 . doi: 10.1145/2901318.2901324 http://doi.org/10.1145/2901318.2901324

Schuh HN , Liang WH , Liu M , et al. , 2021 . Xenic: SmartNIC-accelerated distributed transactions . Proc ACM SIGOPS 28 th Symp on Operating Systems Principles , p. 740 - 755 . doi: 10.1145/3477132.3483555 http://doi.org/10.1145/3477132.3483555

Xu J , Swanson S , 2016 . NOVA: a log-structured file system for hybrid volatile/non-volatile main memories . Proc 14 th USENIX Conf on File and Storage Technologies , p. 323 - 338 .

Zhang JC , Shu JW , Lu YY , 2016 . ParaFS: a log-structured file system to exploit the internal parallelism of flash devices . Proc USENIX Annual Technical Conf , p. 87 - 100 .

Views

111

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

An efficient wear-leveling-aware multi-grained allocator for persistent memory file systems^&

A novel non-volatile memory storage system for I/O-intensive applications

Related Author

Duo LIU

Shun NIE

Chaoshu YANG

Runyu ZHANG

Zhiwang YU

Xiao-gang CHEN

Shi-yan CHEN

Da-gang LI

Related Institution

State Key Laboratory of Public Big Data, College of Computer Science and Technology, Guizhou University

College of Computer Science, Chongqing University

Shanghai Institute of Micro-system and Information Technology, Chinese Academy of Sciences

University of Chinese Academy of Sciences

School of Electronics and Computer Engineering, Peking University

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰