ONFS：面向高性能计算的基于内存、固态硬盘和磁盘的层次式混合文件系统

刘欣; 卢宇彤; 喻杰; 王鹏飞; 吴皆霆; 陆颖

doi:10.1631/FITEE.1700626

Your Location：

Home >

Browse articles >

ONFS：面向高性能计算的基于内存、固态硬盘和磁盘的层次式混合文件系统

特邀文章 | Updated：2022-06-06

- ONFS：面向高性能计算的基于内存、固态硬盘和磁盘的层次式混合文件系统
- ONFS: a hierarchical hybrid file system based on memory, SSD, and HDD for high performance computers
- 信息与电子工程前沿（英文） 2017年18卷第12期页码：1940-1971
- Affiliations：
  
  School of Computer, National University of Defense Technology, Changsha 410073, China
  Computer Science and Engineering, University of Nebraska-Lincoln, Lincoln 68588, USA
  National Supercomputing Center, Tianjin 300457, China)
- Author bio：
  
  [ "", "Xin LIU, first author of this invited paper, received her Bachelor's degree in Computer Science and Technology from the Nanjing University of Science and Technology in China in 2010. She is a PhD candidate in Computer Science and Technology at the National University of Defense Technology in China, and a PhD candidate at the University of Nebraska-Lincoln in the USA. She studies highperformance storage and parallel file system, and participates in many projects supported by Chinese funding agencies" ]
  [ "", "Dr. Yu-tong LU, ISC fellow, a faculty at both Sun Yat-sen University (SYSU) and the National University of Defense Technology (NUDT). She is Director of National Supercomputing Center in Guangzhou. She received her B.S., MS and PhD from the NUDT. She has extensive research and development experience over several generations of Chinese supercomputers, and she is the deputy chief designer of Tianhe-2 system. She leads a number of HPC and big data projects under the support of the Chinese Ministry of Science and Technology, the National Natural Science Foundation of China, and Guangdong Province. Her research interests include parallel operating system (OS), high speed communications, global file systems, and advanced programming environments converging HPC and big data. ytlu@nudt.edu.cn" ]
  [ "Jie YU, yujie@nscc-tj.gov.cn" ]
  [ "Peng-fei WANG, wangpf@nscc-tj.gov.cn" ]
  [ "Jie-ting WU, jwu@cse.unl.edu" ]
  [ "Ying LU, ylu@cse.unl.edu" ]
- Funds：
  
  Project supported by the National Key Research and Development Program of China (No. 2016YFB0200402)
- DOI：10.1631/FITEE.1700626
  中图分类号： TP303
- 收稿：2017-09-25，
  
  修回：2017-12-27，
  
  纸质出版：2017-12
- Accepted：
Scan QR Code
刘欣, 卢宇彤, 喻杰, 等. ONFS：面向高性能计算的基于内存、固态硬盘和磁盘的层次式混合文件系统[J]. 信息与电子工程前沿（英文）, 2017,18(12):1940-1971.

LIU Xin, LU Yu-tong, YU Jie, et al. ONFS: a hierarchical hybrid file system based on memory, SSD, and HDD for high performance computers[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(12): 1940-1971.
刘欣, 卢宇彤, 喻杰, 等. ONFS：面向高性能计算的基于内存、固态硬盘和磁盘的层次式混合文件系统[J]. 信息与电子工程前沿（英文）, 2017,18(12):1940-1971. DOI： 10.1631/FITEE.1700626.

LIU Xin, LU Yu-tong, YU Jie, et al. ONFS: a hierarchical hybrid file system based on memory, SSD, and HDD for high performance computers[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(12): 1940-1971. DOI： 10.1631/FITEE.1700626.

摘要

随着超级计算机向Eflops规模快速发展和计算核数急剧增加，更大规模和更复杂的应用成为可能。大规模科学计算、新的工作流应用以及检查点操作均需要存储系统具有非常高的带宽和低延迟，这使得高性能存储系统面临严峻的技术挑战。当前基于磁盘的底层存储系统难以满足新一代Eflops超级计算机和应用的要求。为此，本文提出了基于计算结点内存、固态硬盘和磁盘的层次式混合存储系统ONFS(on-line and near-line file system)。它具有三个存储层次和统一的命名空间，支持可移植操作系统接口（portable operating system interface

POSIX）协议，可提供高带宽、低延迟和超大存储容量。本文详细分析了分布式元数据管理、内存借用和归还策略、数据一致性、并行访问控制，以及向下迁移和向上主动预迁移机制。在天河一号超级计算机上实现了ONFS原型系统，测试了I/O（input/output）性能和可扩展性。测试结果表明，单线程和多线程读/写性能比基于磁盘的Lustre分别高出6倍和5倍。与Lustre相比，运行在ONFS上的典型数据密集型应用可获得6.35倍的I/O加速。

Abstract

With supercomputers developing towards exascale

the number of compute cores increases dramatically

making more complex and larger-scale applications possible. The input/output (I/O) requirements of large-scale applications

workflow applications

and their checkpointing include substantial bandwidth and an extremely low latency

posing a serious challenge to high performance computing (HPC) storage systems. Current hard disk drive (HDD) based underlying storage systems are becoming more and more incompetent to meet the requirements of next-generation exascale supercomputers. To rise to the challenge

we propose a hierarchical hybrid storage system

on-line and near-line file system (ONFS). It leverages dynamic random access memory (DRAM) and solid state drive (SSD) in compute nodes

and HDD in storage servers to build a three-level storage system in a unified namespace. It supports portable operating system interface (POSIX) semantics

and provides high bandwidth

low latency

and huge storage capacity. In this paper

we present the technical details on distributed metadata management

the strategy of memory borrow and return

data consistency

parallel access control

and mechanisms guiding downward and upward migration in ONFS. We implement an ONFS prototype on the TH-1A supercomputer

and conduct experiments to test its I/O performance and scalability. The results show that the bandwidths of single-thread and multi-thread nreado/nwriteo are 6-fold and 5-fold better than HDD-based Lustre

respectively. The I/O bandwidth of data-intensive applications in ONFS can be 6.35 times that in Lustre.

关键词

Keywords

references

N. Agrawal , W.J. Bolosky , J.R. Douceur , 等 . A five-year study of file-system metadata . ACM Trans. Stor. , 2007 . 3 ( 3 ): 9 DOI: 10.1145/1288783.1288788 http://doi.org/10.1145/1288783.1288788 .

ALCF . Computational Systems: Mira. Argonne Leadership Computing Facility . https://www.alcf.anl.gov/user-guides/computational-systems https://www.alcf.anl.gov/user-guides/computational-systems , 2017 .

N. Ali , P. Carns , K. Iskra , 等 . Scalable I/O forwarding framework for high-performance computing systems . IEEE Int. Conf. on CLUSTER Computing and Workshops , 2009 . p.1 - 10 . .

E. Anderson , J. Hall , J. Hartline , 等 . An experimental study of data migration algorithms . Proc. Algorithm Engineering, Int. Workshop , 2001 . p.145 - 158 . .

R. Appuswamy , D.C. van Moolenbroek , A.S. Tanenbaum . Integrating flash-based SSDs into the storage stack . IEEE Symp. on Mass Storage Systems and Technologies , 2012 . p.1 - 12 . .

J. Bent , G. Grider , B. Kettering , 等 . Storage challenges at Los Alamos National Lab . IEEE 28th Symp. on Mass Storage Systems and Technologies , 2012 . p.1 - 5 . DOI: 10.1109/MSST.2012.6232376 http://doi.org/10.1109/MSST.2012.6232376 .

S. Bharathi , A. Chervenak , E. Deelman , 等 . Characterization of scientific workflows . 3rd Workshop on Workflows in Support of Large-Scale Science , 2008 . p.1 - 10 . DOI: 10.1109/WORKS.2008.4723958 http://doi.org/10.1109/WORKS.2008.4723958 .

S. Byan , J. Lentini , A. Madan , 等 . Mercury: host-side flash caching for the data center . IEEE 28th Symp. on MASS Storage Systems and Technologies , 2012 . p.1 - 12 . .

M. Canim , G.A. Mihaila , B. Bhattacharjee , 等 . SSD bufferpool extensions for database systems . Proc. VLDB Endow. , 2010 . 3 ( 1-2 ): 1435 - 1446 . DOI: 10.14778/1920841.1921017 http://doi.org/10.14778/1920841.1921017 .

P.H. Carns , W.B.III. Ligon , R.B. Ross . PVFS: a parallel file system for Linux clusters . Proc. 4th Annual Linux Showcase and Conf. , 2000 . p.317 - 328 . .

P.H. Carns , K. Harms , W. Allcock , 等 . Understanding and improving computational science storage access through continuous characterization . ACM Trans. Stor. , 2011 . 7 ( 3 ): 1 - 14 . DOI: 10.1145/2027066.2027068 http://doi.org/10.1145/2027066.2027068 .

F. Chen , D.A. Koufaty , X. Zhang . Hystor: making the best use of solid state drives in high performance storage systems . Proc. Int. Conf. on Supercomputing , 2011 . p.22 - 32 . DOI: 10.1145/1995896.1995902 http://doi.org/10.1145/1995896.1995902 .

S.K. Cheong , J.J. Jeong , Y.W. Jeong , 等 . Research on the I/O performance advancement of a low speed HDD using DDR-SSD . 6th Int. Conf. on Future Information Technology , 2011 . p.508 - 513 . DOI: 10.1007/978-3-642-22333-4_66 http://doi.org/10.1007/978-3-642-22333-4_66 .

G. Congiu , S. Narasimhamurthy , T. Süß , 等 . Improving collective I/O performance using non-volatile memory devices . IEEE Int. Conf. on Cluster Computing , 2016 . p.120 - 129 . DOI: 10.1109/CLUSTER.2016.37 http://doi.org/10.1109/CLUSTER.2016.37 .

Cray . Cray Sonexion 3000 . https://www.cray.com/products/storage/sonexion https://www.cray.com/products/storage/sonexion , 2017 .

N. Dai , W. Wu , W. Zhang , 等 . TTI RTM using variable grid in depth . Int. Petroleum Technology Conf. , 2011 . p.1 - 7 . DOI: 10.2523/IPTC-15050-MS http://doi.org/10.2523/IPTC-15050-MS .

EMC Dell . All Flash Storage . https://www.dellemc.com/en-us/storage/discover-flash-storage/index.htm https://www.dellemc.com/en-us/storage/discover-flash-storage/index.htm , 2017 .

W.R. Dong , G.M. Liu , J. Yu , 等 . SFDC: file access pattern aware cache framework for high-performance computer . IEEE 17th Int. Conf. on High Performance Computing and Communications, IEEE 7th Int. Symp. on Cyberspace Safety and Security, IEEE 12th Int. Conf. on Embedded Software and Systems , 2015 . p.342 - 350 . DOI: 10.1109/HPCC-CSS-ICESS.2015.185 http://doi.org/10.1109/HPCC-CSS-ICESS.2015.185 .

X. Dong , Y. Xie , N. Muralimanohar , 等 . Hybrid checkpointing using emerging nonvolatile memories for future exascale systems . ACM Trans. Archit. Code Optim. , 2011 . 8 ( 2 ): 1 - 29 . DOI: 10.1145/1970386.1970387 http://doi.org/10.1145/1970386.1970387 .

J. Dongarra . Impact of architecture and technology for extreme scale on software and algorithm design . Department of Energy Workshop on Cross-cutting Technologies for Computing at the Exascale , 2010 .

Facebook . Flashcache at Facebook from 2010 to 2013 and Beyond . https://www.facebook.com/notes/facebook-engineering/flashcache-at-facebook-from-2010-to-2013-and-beyond/10151725297413920/ https://www.facebook.com/notes/facebook-engineering/flashcache-at-facebook-from-2010-to-2013-and-beyond/10151725297413920/ , 2013 .

Gluster . Gluster File System . http://www.gluster.org http://www.gluster.org , 2017 .

Hitachi Data Systems Cooperation . Dynamic Storage Tiering: the Integration of Block, File and Content . https://shobiziems.com/hitachi_nas/hitachi-white-paper-dynamic-storage-tiering.pdf https://shobiziems.com/hitachi_nas/hitachi-white-paper-dynamic-storage-tiering.pdf , 2010 .

D.A. Holland , E. Angelino , G. Wald , 等 . Flash caching on the storage client . USENIX Annual Technical Conf. , 2013 . p.127 - 138 . .

IBM . IBM Blue Gene/Q . https://www-03.ibm.com/systems/technicalcomputing/solutions/bluegene/ https://www-03.ibm.com/systems/technicalcomputing/solutions/bluegene/ , 2017 .

Intel . Intel Data Center SSD . https://www.intel.com/content/www/us/en/products/memory-storage/solid-state-drives/data-center-SSDs/dc-p4600-series/dc-p4600-4tb-aic-3d1.html https://www.intel.com/content/www/us/en/products/memory-storage/solid-state-drives/data-center-SSDs/dc-p4600-series/dc-p4600-4tb-aic-3d1.html , 2017 .

K. Iskra , J.W. Romein , K. Yoshii , 等 . ZOID: I/O-forwarding infrastructure for petascale architectures . Proc. 13th ACM SIGPLAN Symp. on Principles and Practice of Parallel Programming , 2008 . p.153 - 162 . DOI: 10.1145/1345206.1345230 http://doi.org/10.1145/1345206.1345230 .

Y. Kim , A. Gupta , B. Urgaonkar , 等 . Hybridstore: a cost-efficient, high-performance storage system combining SSDs and HDDs . IEEE 19th Annual Int. Symp. on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems , 2011 . p.227 - 236 . DOI: 10.1109/MASCOTS.2011.64 http://doi.org/10.1109/MASCOTS.2011.64 .

M. Kuhlen , M. Vogelsberger , R. Angulo . Numerical simulations of the dark universe: state of the art and the next decade . Phys. Dark Univ. , 2012 . 1 ( 1 ): 50 - 93 . DOI: 10.1016/j.dark.2012.10.002 http://doi.org/10.1016/j.dark.2012.10.002 .

D. Lee , J. Choi , J.H. Kim , 等 . On the existence of a spectrum of policies that subsumes the least recently used (LRU) and least frequently used (LFU) policies . Proc. ACM SIGMETRICS Int. Conf. on Measurement and Modeling of Computer Systems , 1999 . p.134 - 143 . DOI: 10.1145/301453.301487 http://doi.org/10.1145/301453.301487 .

X. Liao , L. Xiao , C. Yang , 等 . MilkyWay-2 supercomputer: system and application . Front. Comput. Sci. , 2014 . 8 ( 3 ): 345 - 356 . DOI: 10.1007/s11704-014-3501-3 http://doi.org/10.1007/s11704-014-3501-3 .

N. Liu , J. Cope , P. Carns , 等 . On the role of burst buffers in leadership-class storage systems . IEEE 28th Symp. on MASS Storage Systems and Technologies , 2012 . p.1 - 11 . DOI: 10.1109/MSST.2012.6232369 http://doi.org/10.1109/MSST.2012.6232369 .

X. Liu , Y. Lu , J. Yu , 等 . MemUsing: dynamic, efficient memory utilization in compute nodes for HPC memory-based storage systems . Proc. 7th Int. Workshop on Computer Science and Engineering , 2017a . p.8 - 16 . .

X. Liu , Y. Lu , C. Wu , 等 . UGSD: scalable and efficient metadata management for EB-scale file systems . Proc. Int. Conf. on Compute and Data Analysis , 2017b . p.81 - 90 . DOI: 10.1145/3093241.3093257 http://doi.org/10.1145/3093241.3093257 .

LLNL . Sequoia. Lawrence Livermore National Laboratory . https://computation.llnl.gov/computers/sequoia https://computation.llnl.gov/computers/sequoia , 2012 .

J. Lofstead , I. Jimenez , C. Maltzahn , 等 . DAOS and friends: a proposal for an exascale storage system . Int. Conf. for High Performance Computing, Networking, Storage & Analysis , 2016 . p.585 - 596 . DOI: 10.1109/SC.2016.49 http://doi.org/10.1109/SC.2016.49 .

C.Y. Lu , G.A. Alvarez , J. Wilkes . Aqueduct: online data migration with performance guarantees . FAST Conf. on File and Storage Technologies , 2002 . p.219 - 230 . .

E.L. Miller , K. Greenan , A. Leung , 等 . Reliable and efficient metadata storage and indexing using nvram . J. Comput. Sci. Technol. , 2011 . 26 ( 3 ): 344 - 351 . .

S. Muralidhar , W. Lloyd , S. Roy , 等 . f4: Facebook's warm blob storage system . Proc. 11th USENIX Symp. on Operating Systems Design and Implementation , 2014 . p.383 - 398 . .

NERSC . Burst Buffer Architecture and Software Roadmap . National Energy Research Scientific Computing Center. http://www.nersc.gov/users/computational-systems/cori/burst-buffer/burst-buffer http://www.nersc.gov/users/computational-systems/cori/burst-buffer/burst-buffer , 2017a .

NERSC . The Configuration of Cori File System . National Energy Research Scientific Computing Center. http://www.nersc.gov/users/computational-systems/cori/configuration/ http://www.nersc.gov/users/computational-systems/cori/configuration/ , 2017b .

NetApp . All Flash Arrays . http://www.netapp.com/us/products/storage-systems/all-flash-array/aff-a-series.aspx http://www.netapp.com/us/products/storage-systems/all-flash-array/aff-a-series.aspx , 2016 .

K. Ocaña , D. de Oliveira . Parallel computing in genomic research: advances and applications . Adv. Appl. Bioinform. Chem. , 2015 . 8 23 - 25 . DOI: 10.2147/AABC.S64482 http://doi.org/10.2147/AABC.S64482 .

A. Ovsyannikov , M. Romanus , B.V. Straalen , 等 . Scientific workflows at datawarp-speed: accelerated data-intensive science using NERSE's burst buffer . Joint Int. Workshop on Parallel Data Storage & Data Intensive Scalable Computing Systems , 2017 . p.1 - 6 . DOI: 10.1109/PDSW-DISCS.2016.005 http://doi.org/10.1109/PDSW-DISCS.2016.005 .

B. Pawlowski , C. Juszczak , P. Staubach , 等 . NFS version 3: design and implementation . USENIX Summer Technical Conf. , 1994 . p.137 - 152 . .

R. Prabhakar , S.S. Vazhkudai , Y. Kim , 等 . Provisioning a multi-tiered data staging area for extreme-scale machines . Int. Conf. on Distributed Computing Systems , 2011 . p.1 - 12 . DOI: 10.1109/ICDCS.2011.33 http://doi.org/10.1109/ICDCS.2011.33 .

F. Qiao , Z. Song , Y. Bao , 等 . Development and evaluation of an earth system model with surface gravity waves . J. Geophys. Res. Ocean. , 2013 . 118 ( 9 ): 4514 - 4524 . DOI: 10.1002/jgrc.20327 http://doi.org/10.1002/jgrc.20327 .

R. Rajachandrasekar , A. Moody , K. Mohror , 等 . A 1 PB/s file system to checkpoint three million MPI tasks . Proc. 22nd Int. Symp. on High-Performance Parallel and Distributed Computing , 2013 . p.143 - 154 . DOI: 10.1145/2462902.2462908 http://doi.org/10.1145/2462902.2462908 .

O. Rodeh , A. Teperman . zFSja scalable distributed file system using object disks . Proc. 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies , 2003 . p.207 - 218 . DOI: 10.1109/MASS.2003.1194858 http://doi.org/10.1109/MASS.2003.1194858 .

D. Roselli , T.E. Anderson , J.R. Lorchid . A comparison of file system workloads . Proc. USENIX Annual Technical Conf. , 2000 . p.41 - 54 . .

S. Saito , S. Oikawa . Exploration of non-volatile memory management in the OS kernel . 3rd Int. Conf. on Networking and Computing , 2012 . p.302 - 306 . DOI: 10.1109/ICNC.2012.56 http://doi.org/10.1109/ICNC.2012.56 .

K. Sato , K. Mohror , A. Moody , 等 . A user-level infiniband-based file system and checkpoint strategy for burst buffers . 14th IEEE/ACM Int. Symp. on Cluster, Cloud and Grid Computing , 2014 . p.21 - 30 . DOI: 10.1109/CCGrid.2014.24 http://doi.org/10.1109/CCGrid.2014.24 .

M. Satyanarayanan , J.J. Kistler , P. Kumar , 等 . Coda: a highly available file system for a distributed workstation environment . IEEE Trans. Comput. , 1990 . 39 ( 4 ): 447 - 459 . DOI: 10.1109/12.54838 http://doi.org/10.1109/12.54838 .

M. Saxena , M.M. Swift , Y. Zhang . FlashTier: a lightweight, consistent and durable storage cache . Proc. 7th ACM European Conf. on Computer Systems , 2012 . p.267 - 280 . DOI: 10.1145/2168836.2168863 http://doi.org/10.1145/2168836.2168863 .

W. Schenck , S. El Sayed , M. Foszczynski , 等 . Evaluation and performance modeling of a burst buffer solution . ACM SIGOPS Oper. Syst. Rev. , 2017 . 50 ( 1 ): 12 - 26 . DOI: 10.1145/3041710.3041714 http://doi.org/10.1145/3041710.3041714 .

F. Schmuck , R. Haskin . GPFS: a shared-disk file system for large computing clusters . Proc. 1st USENIX Conf. on File and Storage Technologies , 2002 . No. 19 .

Seagate Technology LLC . Seagate NAS+SRS HDD Product Manual . https://www.seagate.com/www-content/product-content/nas-fam/nas-hdd/en-us/docs/100764115g.pdf https://www.seagate.com/www-content/product-content/nas-fam/nas-hdd/en-us/docs/100764115g.pdf , 2017 .

J. Shalf , S. Dosanjh , J. Morrison . Exascale computing technology challenges . Int. Conf. on High Performance Computing for Computational Science , 2010 . p.1 - 25 . .

T. Shibata , S. Choi , K. Taura . File-access patterns of data-intensive workflow applications and their implications to distributed filesystems . Proc. 19th ACM Int. Symp. on High Performance Distributed Computing , 2010 . p.746 - 755 . DOI: 10.1145/1851476.1851585 http://doi.org/10.1145/1851476.1851585 .

G. Soundararajan , V. Prabhakaran , M. Balakrishnan , 等 . Extending SSD lifetimes with disk-based write caches . Proc. 8th USENIX Conf. on File and Storage Technologies , 2010 . No. 8 DOI: 10.1021/ja0386501 http://doi.org/10.1021/ja0386501 .

S.M. Strande , P. Cicotti , R.S. Sinkovits , 等 . Gordon: design, performance, and experiences deploying and supporting a data intensive supercomputer . Proc. 1st Conf. of the Extreme Science and Engineering Discovery Environment: Bridging from the eXtreme to the Campus and Beyond , 2012 . No. 3 DOI: 10.1145/2335755.2335789 http://doi.org/10.1145/2335755.2335789 .

Z. Tan , W. Zhou , D. Feng , 等 . ALDM: adaptive loading data migration in distributed file systems . IEEE Trans. Magn. , 2013 . 49 ( 6 ): 2645 - 2652 . DOI: 10.1109/TMAG.2013.2251616 http://doi.org/10.1109/TMAG.2013.2251616 .

A. Uta , A. Sandu , T. Kielmann . Overcoming data locality . Fut. Gener. Comput. Syst. , 2016 . 54 DOI: 10.1016/j.future.2015.01.013 http://doi.org/10.1016/j.future.2015.01.013 .

B.K.R. Vangoor , V. Tarasov , E. Zadok . To FUSE or not to FUSE: performance of user-space file systems . Proc. 15th USENIX Conf. on File and Storage Technologies , 2017 . p.59 - 72 . .

J.S. Vetter , S. Mittal . Opportunities for nonvolatile memory systems in extreme-scale high-performance computing . Comput. Sci. Eng. , 2015 . 17 ( 2 ): 73 - 82 . DOI: 10.1109/MCSE.2015.4 http://doi.org/10.1109/MCSE.2015.4 .

F. Wang , Q. Xin , B. Hong , 等 . File system workload analysis for large scale scientific computing applications . Proc. 21st IEEE/12th NASA Goddard Conf. on Mass Storage Systems and Technologies , 2004 . p.139 - 152 . .

F. Wang , S. Oral , G. Shipman , 等 . Understanding Lustre Filesystem Internals . No. ORNL/TM-2009/117. Oak Ridge National Laboratory, National Center for Computational Sciences, Oak Ridge, USA , 2010 .

T. Wang , S. Oral , Y. Wang , 等 . BurstMem: a high-performance burst buffer system for scientific applications . IEEE Int. Conf. on Big Data , 2014 . p.71 - 79 . DOI: 10.1109/BigData.2014.7004215 http://doi.org/10.1109/BigData.2014.7004215 .

T. Wang , K. Mohror , A. Moody , 等 . An ephemeral burst-buffer file system for scientific applications . Proc. Int. Conf. for High Performance Computing, Networking, Storage and Analysis , 2016 . p.807 - 818 . DOI: 10.1109/SC.2016.68 http://doi.org/10.1109/SC.2016.68 .

S.A. Weil , S.A. Brandt , E.L. Miller , 等 . Ceph: a scalable, high-performance distributed file system . Proc. 7th Symp. on Operating Systems Design and Implementation , 2006 . p.307 - 320 . .

X.J. Yang , X.K. Liao , K. Lu , 等 . The TianHe-1A supercomputer: its hardware and software . J. Comput. Sci. Technol. , 2011 . 26 ( 3 ): 344 - 351 . DOI: 10.1007/s02011-011-1137-8 http://doi.org/10.1007/s02011-011-1137-8 .

O. Yildiz , M. Dorier , S. Ibrahim , 等 . On the root causes of cross-application I/O interference in HPC storage systems . IEEE Int. Parallel and Distributed Processing Symp. , 2016 . p.750 - 759 . DOI: 10.1109/IPDPS.2016.50 http://doi.org/10.1109/IPDPS.2016.50 .

J. Yu , G.M. Liu , W.R. Dong , 等 . WatCache: a workload-aware temporary cache on the compute side of HPC systems . J. Supercomput. , 2017 . 1 ( 2 ): 1 - 33 . DOI: 10.1007/s11227-017-2167-7 http://doi.org/10.1007/s11227-017-2167-7 .

D.F. Zhao , I. Raicu . HyCache: a user-level caching middleware for distributed file systems . IEEE Int. Symp. on Parallel and Distributed Processing Workshops and Phd Forum , 2013 . p.1997 - 2006 . DOI: 10.1109/IPDPSW.2013.83 http://doi.org/10.1109/IPDPSW.2013.83 .

D.F. Zhao , Z. Zhang , X.B. Zhou , 等 . FusionFS: toward supporting data-intensive scientific applications on extreme-scale high-performance computing systems . IEEE Int. Conf. on Big Data , 2014 . p.61 - 70 . DOI: 10.1109/BigData.2014.7004214 http://doi.org/10.1109/BigData.2014.7004214 .

浏览量

313

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

Self-deployed execution environment for high performance computing

Storage wall for exascale supercomputing