一种采用纠删码缓存的高能效且可靠的存储系统

万继光; 李大平; 瞿晓阳; 殷超; 王军; 谢长生

doi:10.1631/FITEE.1600972

Your Location：

Home >

Browse articles >

一种采用纠删码缓存的高能效且可靠的存储系统

常规文章 | Updated：2022-05-19

- 一种采用纠删码缓存的高能效且可靠的存储系统
- A reliable and energy-efficient storage system with erasure coding cache
- 信息与电子工程前沿（英文） 2017年18卷第9期页码：1370-1384
- Affiliations：
  
  Wuhan National Laboratory for Optoelectronics, Department of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China
- Author bio：
  
  Ji-guang WAN, E-mail: jgwan@mail.hust.edu.cn
  [ "Da-ping LI, E-mail: ldplcp@qq.com" ]
  [ "Chang-sheng XIE, E-mail: cs_xie@mail.hust.edu.cn" ]
- Funds：
  
  Project supported by the National Natural Science Foundation of China (Nos. 61472152, 61432007, 61572209, and 61300047), the Fundamental Research Funds for the Central Universities, China (No. 2015QN069), the Director Fund of Wuhan National Laboratory for Optoelectronics (WNLO), and the MOE Key Laboratory of Data Storage System, China
- DOI：10.1631/FITEE.1600972
  中图分类号： TP316.4
- 收稿：2016-01-31，
  
  修回：2017-;9-23，
  
  纸质出版：2017-09
- Accepted：
Scan QR Code
万继光, 李大平, 瞿晓阳, 等. 一种采用纠删码缓存的高能效且可靠的存储系统[J]. 信息与电子工程前沿（英文）, 2017,18(9):1370-1384.

Ji-guang WAN, Da-ping LI, Xiao-yang QU, et al. A reliable and energy-efficient storage system with erasure coding cache[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(9): 1370-1384.
万继光, 李大平, 瞿晓阳, 等. 一种采用纠删码缓存的高能效且可靠的存储系统[J]. 信息与电子工程前沿（英文）, 2017,18(9):1370-1384. DOI： 10.1631/FITEE.1600972.

Ji-guang WAN, Da-ping LI, Xiao-yang QU, et al. A reliable and energy-efficient storage system with erasure coding cache[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(9): 1370-1384. DOI： 10.1631/FITEE.1600972.

摘要

在现代的多副本节能存储系统中，主副本的磁盘总是保持着开启以对外提供服务，而其他副本的磁盘则可以在负载低时保持关闭状态以节能。然而，因为新的写请求不能够被立即同步到所有的磁盘上，所以系统的可靠性被降低了。本文中，我们设计了一个基于RAID10的具有高可靠性和高能效的副本存储系统——RERAID。RERAID使用主副本磁盘上的一部分空闲空间结合纠删码构造了一个编码缓存来接收新的写请求。因为通过使用纠删码，编码缓存能够支持2个甚至更多磁盘的故障恢复，所以RERAID能够保证与RAID10存储系统想当的可靠性。另外，我们还设计了一个纠删码写（erasure coding write

ECW）算法来缓存那些小的随机写，并把它们合并成大的写数据块，然后并行写入编码缓存中以提高写性能。实验结果显示RERAID相比现有的方案能够提高写性能并且节省更多的能源。

Abstract

In modern energy-saving replication storage systems

a primary group of disks is always powered up to serve incoming requests while other disks are often spun down to save energy during slack periods. However

since new writes cannot be immediately synchronized into all disks

system reliability is degraded. In this paper

we develop a high-reliability and energy-efficient replication storage system

named RERAID

based on RAID10. RERAID employs part of the free space in the primary disk group and uses erasure coding to construct a code cache at the front end to absorb new writes. Since code cache supports failure recovery of two or more disks by using erasure coding

RERAID guarantees a reliability comparable with that of the RAID10 storage system. In addition

we develop an algorithm

called erasure coding write (ECW)

to buffer many small random writes into a few large writes

which are then written to the code cache in a parallel fashion sequentially to improve the write performance. Experimental results show that RERAID significantly improves write performance and saves more energy than existing solutions.

关键词

Keywords

references

Amazon . . . . Amazon S3: Object Storage Built to Store and Retrieve Any Amount of Data from Anywhere , , 2007 . . http://aws.amazon.com/s3/ http://aws.amazon.com/s3/ , , . .

H. Amur , , , J. Cipar , , , V. Gupta , , , 等 . . Robust and flexible power-proportional storage . . Proc. 1st ACM Symp. on Cloud Computing , , 2010 . . p.217 - - 228 . . DOI: 10.1145/1807128.1807164 http://doi.org/10.1145/1807128.1807164 . .

M. Bhadkamkar , , , J. Guerra , , , L. Useche , , , 等 . . BORG: Block-reORGanization for self-optimizing storage systems . . Proc. Usenix Conf. on File and Storage Technologies , , 2009 . . p.183 - - 196 . . . .

M. Blaum , , , J. Brady , , , J. Bruck , , , 等 . . EVENODD: an optimal scheme for tolerating double disk failures in RAID architectures . . Proc. 21st Int. Symp. on Computer Architecture , , 1994 . . p.245 - - 254 . . DOI: 10.1109/isca.1994.288145 http://doi.org/10.1109/isca.1994.288145 . .

D. Borthaku . . . . What is Apache Hadoop? , , 2010 . . http://hadoop.apache.org/ http://hadoop.apache.org/ , , . .

Y. Chen , , , W. Hsu , , , H. Young . . Logging RAID-an approach to fast, reliable, and low-cost disk arrays . . Euro-Par , , 2000 . . p.1302 - - 1312 . . DOI: 10.1007/3-540-44520-x_182 http://doi.org/10.1007/3-540-44520-x_182 . .

D. Colarelli , , , D. Grunwald . . Massive arrays of idle disks for storage archives . . Proc. ACM/IEEE Conf. on Supercomputing , , 2002 . . p.1 - - 11 . . DOI: 10.1109/sc.2002.10058 http://doi.org/10.1109/sc.2002.10058 . .

P. Corbett , , , B. English , , , A. Goel , , , 等 . . Row-diagonal parity for double disk failure correction . . Proc. 3rd USENIX Conf. on File and Storage Technologies , , 2004 . . p.1 - - 14 . . . .

Department of Energy . . NETL shares computing speed, efficiency to tackle barriers . . Fossil Energy Today , , 2012 . . 1 ( ( 6 ): ): 1 - - 3 . . . .

EMC . . ATMOS: Big . . Smart. Elastic. , , 2008 . . http://www.emc.com/storage/atmos/atmos.htm http://www.emc.com/storage/atmos/atmos.htm , , . .

H. Eom , , , J.K. Hollingsworth . . Speed vs. accuracy in simulation for I/O-intensive applications . . Proc. 14th Int. Parallel and Distributed Processing Symp. , , 2000 . . p.315 - - 322 . . DOI: 10.1109/ipdps.2000.846001 http://doi.org/10.1109/ipdps.2000.846001 . .

S. Ghemawat , , , H. Gobioff , , , S. Leung . . The Google File System . . Proc. 19th ACM Symp. on Operating Systems Principles , , 2003 . . p.29 - - 43 . . DOI: 10.1145/945445.945450 http://doi.org/10.1145/945445.945450 . .

Y. Hu , , , Q. Yang . . DCD-disk caching disk: a new approach for boosting I/O performance . . ACM SIGARCH Comput. Archit. News , , 1996 . . 24 ( ( 2 ): ): 169 - - 178 . . DOI: 10.1145/232974.232991 http://doi.org/10.1145/232974.232991 . .

D. Li , , , J. Wang . . EERAID: energy-efficient redundant and inexpensive disk array . . Proc. 11th ACM SIGOPS European Workshop , , 2004 . . p.29 DOI: 10.1145/1133572.1133577 http://doi.org/10.1145/1133572.1133577 . .

D. Li , , , J. Wang . . eRAID: a queuing model based energy saving policy . . Proc. IEEE Int. Symp. on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems , , 2006 . . p.77 - - 86 . . DOI: 10.1109/mascots.2006.23 http://doi.org/10.1109/mascots.2006.23 . .

L. Lu , , , P.J. Varman , , , J. Wang . . DiskGroup: energy efficient disk layout for RAID1 systems . . Proc. Int. Conf. on Networking, Architecture, and Storage , , 2007 . . p.233 - - 242 . . DOI: 10.1109/nas.2007.21 http://doi.org/10.1109/nas.2007.21 . .

B. Mao , , , D. Feng , , , H. Jiang , , , 等 . . GRAID: a green RAID storage architecture with improved energy efficiency and reliability . . Proc. IEEE Int. Symp. on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems , , 2008 . . p.113 - - 120 . . DOI: 10.1109/mascot.2008.4770574 http://doi.org/10.1109/mascot.2008.4770574 . .

J. Menon . . A performanee comparison of RAID-5 and log-struetured arrays . . Proc. 4th IEEE In. Symp. on High Performance Distributed Computing , , 1995 . . p.167 - - 178 . . DOI: 10.1109/hpdc.1995.518707 http://doi.org/10.1109/hpdc.1995.518707 . .

D.A. Patterson , , , G. Gibson , , , R.H. Katz . . A case for redundant arrays of inexpensive disks (RAID) . . Proc. ACM SIGMOD Int. Conf. on Management of Data , , 1988 . . p.109 - - 116 . . DOI: 10.1145/971701.50214 http://doi.org/10.1145/971701.50214 . .

J.S. Plank , , , L.H. Xu . . Optimizing Cauchy ReedSolomon codes for fault-tolerant storage applications . . Proc. 5th Int. Symp. on Network Computing and Applications , , 2006 . . p.173 - - 180 . . DOI: 10.1109/nca.2006.43 http://doi.org/10.1109/nca.2006.43 . .

E. Pinheiro , , , R. Bianchini . . Energy conservation techniques for disk array-based servers . . Proc. 18th Annual Int. Conf. on Supercomputing , , 2004 . . p.68 - - 78 . . DOI: 10.1145/1006209.1006220 http://doi.org/10.1145/1006209.1006220 . .

E. Pinheiro , , , W.D. Weber , , , L.A. Barroso . . Failure trends in a large disk drive population . . Proc. 5th USENIX Conf. on File and Storage Technologies , , 2007 . . p.17 - - 28 . . . .

G. Soundararajan , , , V. Prabhakaran , , , M. Balakrishnan , , , 等 . . Extending SSD lifetimes with disk-based write caches . . Proc. 8th USENIX Conf. on File and Storage Technologies , , 2010 . . p.101 - - 114 . . . .

D. Stodolsky , , , G. Gibson , , , M. Holland . . Parity logging overcoming the small write problem in redundant disk arrays . . ACM SIGARCH Comput. Architect. News , , 1993 . . 21 ( ( 2 ): ): 64 - - 75 . . DOI: 10.1145/173682.165143 http://doi.org/10.1145/173682.165143 . .

E. Thereska , , , A. Donnelly , , , D. Narayanan . . Sierra: practical power-proportionality for data center storage . . Proc. 6th Conf. on Computer Systems , , 2011 . . p.169 - - 182 . . DOI: 10.1145/1966445.1966461 http://doi.org/10.1145/1966445.1966461 . .

J. Wang , , , H.J. Zhu , , , D. Li . . eRAID: conserving energy in conventional disk-based RAID system . . IEEE Trans. Comput. , , 2008 . . 57 ( ( 3 ): ): 359 - - 374 . . DOI: 10.1109/tc.2007.70821 http://doi.org/10.1109/tc.2007.70821 . .

S. Weil , , , S.A. Brandt , , , E.L. Miller , , , 等 . . Ceph: a scalable, high-performance distributed file system . . Proc. 7th Conf. on Operating Systems Design and Implementation , , 2006 . . p.307 - - 320 . . . .

J. Wilkes , , , R. Golding , , , R. Staelin , , , 等 . . The HP AutoRAID hierarchical storage system . . ACM Trans. Comput. Syst. , , 1996 . . 14 ( ( 1 ): ): 108 - - 136 . . DOI: 10.1145/225535.225539 http://doi.org/10.1145/225535.225539 . .

Q. Xin , , , E.L. Miller , , , T. Schwarz , , , 等 . . Reliability mechanisms for very large storage systems . . Proc. 20th IEEE/11th NASA Goddard Conf. on Mass Storage Systems and Technologie , , 2003 . . p.146 - - 156 . . DOI: 10.1109/mass.2003.1194851 http://doi.org/10.1109/mass.2003.1194851 . .

L.H. Xu , , , J. Bruck . . X-code: MDS array codes with optimal encoding . . IEEE Trans. Inform. Theory , , 1999 . . 45 ( ( 1 ): ): 272 - - 276 . . DOI: 10.1109/18.746809 http://doi.org/10.1109/18.746809 . .

Y. Yue , , , L. Tian , , , H. Jiang , , , 等 . . RoLo: a rotated logging storage architecture for enterprise data centers . . Proc. IEEE 30th Int. Conf. on Distributed Computing Systems , , 2010 . . p.293 - - 304 . . DOI: 10.1109/ICDCS.2010.22 http://doi.org/10.1109/ICDCS.2010.22 . .

Y. Yue , , , B. He , , , L. Tian , , , 等 . . Rotated logging storage architectures for data centers: models and optimizations . . IEEE Trans. Comput. , , 2016 . . 65 ( ( 1 ): ): 203 - - 215 . . DOI: 10.1109/tc.2015.2417539 http://doi.org/10.1109/tc.2015.2417539 . .

Q. Zhu , , , Z. Chen , , , L. Tan , , , 等 . . Hibernator: helping disk arrays sleep through the winter . . Proc. 20th ACM Symp. on Operating Systems Principles , , 2005 . . p.177 - - 190 . . DOI: 10.1145/1095809.1095828 http://doi.org/10.1145/1095809.1095828 . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

A spaceborne advanced storage system for remote sensing microsatellites

SoftSSD: enabling rapid flash firmware prototyping for solid-state drives^&

Moving from exascale to zettascale computing: challenges and techniques

A novel non-volatile memory storage system for I/O-intensive applications

Energy-efficient localization and target tracking via underwater mobile sensor networks