一种针对基于一致性哈希的键值存储系统的低能耗副本布局策略

Nan-nan ZHAO; Ji-guang WAN; Jun WANG; Chang-sheng XIE

doi:10.1631/FITEE.1601162

Your Location：

Home >

Browse articles >

一种针对基于一致性哈希的键值存储系统的低能耗副本布局策略

常规文章 | Updated：2022-05-19

- 一种针对基于一致性哈希的键值存储系统的低能耗副本布局策略
- Areliable power management scheme for consistent hashing based distributed key value storage systems#
- 信息与电子工程前沿（英文） 2016年17卷第10期页码：994-1007
- Affiliations：
  
  1Wuhan National Laboratory for Optoelectronics, Wuhan 430074, China
  2Department of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China
  3 Department of Electrical Engineering and Computer Science, University of Central Florida, Orlando, FL 32816, USA
- Author bio：
  
  E-mail: nnzhaocs@hotmail.com
  E-mail: jgwan@mail.hust.edu.cn
  E-mail: jwang@mail.ucf.edu
  E-mail: cs_xie@mail.hust.edu.cn
- Funds：
  
  #A preliminary version of this paper was presented at the 31st International Conference on Massive Storage Systems and Technology, Santa Clara, CA, USA, June 1–5, 2015
- DOI：10.1631/FITEE.1601162
  中图分类号： TP316.4
- 收稿：2016-04-13，
  
  录用：2016-6-3，
  
  纸质出版：2016-10
- Accepted：
Scan QR Code
一种针对基于一致性哈希的键值存储系统的低能耗副本布局策略[J]. 信息与电子工程前沿（英文）, 2016,17(10):994-1007.

Nan-nan ZHAO, Ji-guang WAN, Jun WANG, et al. Areliable power management scheme for consistent hashing based distributed key value storage systems#[J]. Frontiers of Information Technology & Electronic Engineering, 2016, 17(10): 994-1007.
一种针对基于一致性哈希的键值存储系统的低能耗副本布局策略[J]. 信息与电子工程前沿（英文）, 2016,17(10):994-1007. DOI： 10.1631/FITEE.1601162.

Nan-nan ZHAO, Ji-guang WAN, Jun WANG, et al. Areliable power management scheme for consistent hashing based distributed key value storage systems#[J]. Frontiers of Information Technology & Electronic Engineering, 2016, 17(10): 994-1007. DOI： 10.1631/FITEE.1601162.

摘要

分布式键值存储作为最常用的分布式存储系统之一，目前广泛部署在大规模数据中心中。然而，大规模数据中心的高能耗是一个亟待解决的问题。为达到较好节能效果，同时满足数据可用性要求，本文提出一个针对基于一致性哈希的分布式键值存储系统的低能耗副本布局策略——GreenCHT，它包括一个分层副本布局方案、一个可靠的分布式日志和一个预测能耗模式调节器。GreenCHT将副本分布在互不重叠的多个节点层，而非随机放置于哈希环的部分节点。在分层副本布局中，部分节点层可以维持活动状态，其他节点可以被关闭而不影响数据可用性，以达到节能目的。能耗模式调节器（power mode scheduler

PMS）能够预测I/O负载，并根据负载高低波动变化，相应关闭或开启某些节点层。为保证节能状态下的系统可靠性，对于待机副本的写请求，被重新映射到活动的服务器，以保证系统的容错性。通过修改Sheepdog原有的数据分布算法和副本布局策略，GreenCHT被配置在Sheepdog存储集群中。实验中，GreenCHT能够节省35%–61%能耗，同时维持较好性能和可靠性。

Abstract

Distributed key value storage systems are among the most important types of distributed storage systems currently deployed in data centers. Nowadays

enterprise data centers are facing growing pressure in reducing their power consumption. In this paper

we propose GreenCHT

a reliable power management scheme for consistent hashing based distributed key value storage systems. It consists of a multi-tier replication scheme

a reliable distributed log store

and a predictive power mode scheduler (PMS). Instead of randomly placing replicas of each object on a number of nodes in the consistent hash ring

we arrange the replicas of objects on nonoverlapping tiers of nodes in the ring. This allows the system to fall in various power modes by powering down subsets of servers while not violating data availability. The predictive PMS predicts workloads and adapts to load fluctuation. It cooperates with the multi-tier replication strategy to provide power proportionality for the system. To ensure that the reliability of the system is maintained when replicas are powered down

we distribute the writes to standby replicas to active servers

which ensures failure tolerance of the system. GreenCHT is implemented based on Sheepdog

a distributed key value storage system that uses consistent hashing as an underlying distributed hash table. By replaying 12 typical real workload traces collected from Microsoft

the evaluation results show that GreenCHT can provide significant power savings while maintaining a desired performance. We observe that GreenCHT can reduce power consumption by up to 35%–61%.

关键词

Keywords

references

H. Amur , , , J. Cipar , , , V. Gupta , , , 等 . . Robust and flexible power-proportional storage . . 2010 . . Proc. 1st ACM Symp. on Cloud Computing . . 217 - - 228 . . DOI: 10.1145/1807128.1807164 http://doi.org/10.1145/1807128.1807164 . .

R. Bhagwan , , , S. Savage , , , G.M. Voelker . . Replication strategies for highly available peer-to-peer storage . . 2003 . . In : Future Directions in Distributed Computing. Springer-Verlag . . 153 - - 158 . . . .

G.E.P. Box , , , G. Jenkins . . Time series analysis forecasting and control . . In : Wiley Series in Probability and Statistics. Holden-Day, Inc . . 1990 . . .

P.J. Brockwell , , , R.A. Davis . . Time series: theory and methods . . In : Springer Series in Statistics. SpringerVerlag, New York, NY, USA. . . 1991 . . DOI: 10.1007/978-1-4419-0320-4 http://doi.org/10.1007/978-1-4419-0320-4 . .

Cisco Systems FNV-1 . . Available from: http://www.isthe.com/chongo/tech/comp/fnv/index.html. http://www.isthe.com/chongo/tech/comp/fnv/index.html 2012 . . .

D. Colarelli , , , D. Grunwald . . Massive arrays of idle disks for storage archives . . 2002 . . Proc. ACM/IEEE Conf. on Supercomputing . . 1 - - 11 . . . .

G. DeCandia , , , D. Hastorun , , , M. Jampani , , , 等 . . Dynamo: Amazon’s highly available key-value store . . 2007 . . Proc. ACM SIGOPS Symp. on Operating Systems Principles . . 205 - - 220 . . DOI: 10.1145/1294261.1294281 http://doi.org/10.1145/1294261.1294281 . .

I. Goiri , , , K. Le , , , M.E. Haque , , , 等 . . Greenslot: scheduling energy consumption in green datacenters . . 2011 . . Proc. Int. Conf. for High Performance Computing, Networking, Storage and Analysis . . 1 - - 11 . . DOI: 10.1145/2063384.2063411 http://doi.org/10.1145/2063384.2063411 . .

I. Goiri , , , K. Le , , , T.D. Nguyen , , , 等 . . GreenHadoop: leveraging green energy in data-processing frameworks . . 2012 . . Proc. 7th ACM European Conf. on Computer Systems . . 57 - - 70 . . DOI: 10.1145/2168836.2168843 http://doi.org/10.1145/2168836.2168843 . .

S. Gorini , , , M. Quirini , , , A. Menciassi , , , 等 . . PARAID: a Gear-Shifting Power-Aware Raid . . 2007 . . .

D. Harnik , , , D. Naor , , , I. Segall . . Low power mode in cloud storage systems . . 2009 . . Proc. Int. Symp. on Parallel and Distributed Processing Systems . . 1 - - 8 . . . .

D. Karger , , , E. Lehman , , , T. Leighton , , , 等 . . Consistent hashing and random trees: distributed caching protocols for relieving hot spots on the World Wide Web . . 1997 . . Proc. 29th Annual ACM Symp. on Theory of Computing . . 654 - - 663 . . DOI: 10.1145/258533.258660 http://doi.org/10.1145/258533.258660 . .

R.T. Kaushik , , , M. Bhandarkar . . GreenHDFS: towards an energy-conserving, storage-efficient, hybrid Hadoop compute cluster . . 2010 . . Proc. Int. Conf. on Power Aware Computing and Systems . . 1 - - 9 . . . .

R. Kaushik , , , L. Cherkasova , , , R. Campbell , , , 等 . . Lightning: self-adaptive, energy-conserving, multizoned, commodity green cloud storage system . . 2010 . . Proc. 19th ACM Int. Symp. on High Performance Distributed Computing . . 332 - - 335 . . DOI: 10.1145/1851476.1851523 http://doi.org/10.1145/1851476.1851523 . .

A. Lakshman , , , P. Malik . . Cassandra—a decentralized structured storage system . . ACM SIGOPS Oper. Syst.Rev. , , 2010 . . 44 ( ( 2 ): ): 35 - - 40 . . DOI: 10.1145/1773912.1773922 http://doi.org/10.1145/1773912.1773922 . .

C. Li , , , A. Qouneh , , , T. Li . . iSwitch: coordinating and optimizing renewable energy powered node clusters . . Proc. 39th Annual Int. Symp. on Computer Architecture . . 2012 . . 512 - - 553 . . DOI: 10.1145/2366231.2337218 http://doi.org/10.1145/2366231.2337218 . .

LinkedIn Voldemort Project , , 2009 . . Available from: http://www.project-voldemort.com/voldemort/ http://www.project-voldemort.com/voldemort/ . .

Microsoft Research Ltd. MRS Cambridge Traces , , 2014 . . Available from: http://project-voldemort.com/ http://project-voldemort.com/ . .

MySQL SysBench , , 2004 . . Available from: http://sysbench.sourceforge.net/ http://sysbench.sourceforge.net/ . .

D. Narayanan , , , A. Donnelly , , , A. Rowstron . . Write offloading: practical power management for enterprise storage . . ACM Trans. Stor. , , 2008 . . 4 ( ( 3 ): ): 1 - - 10 . . DOI: 10.1145/1416944.1416949 http://doi.org/10.1145/1416944.1416949 . .

NTT Group Sheepdog , , 2011 . . Available from: https://github.com/sheepdog/sheepdog/wiki https://github.com/sheepdog/sheepdog/wiki . .

Open Source and Linux Organization Blktrace User Guide. Hewlett-Packard Company , , 2007 . . Available from: http://www.cse.unsw.edu.au/aaronc/iosched/doc/blktrace.html http://www.cse.unsw.edu.au/aaronc/iosched/doc/blktrace.html . .

H. Park , , , K. Park . . Parallel algorithms for red-black trees . . Theor. Comput. Sci. , , 2001 . . 262 ( ( 1-2 ): ): 415 - - 435 . . DOI: 10.1016/S0304-3975(00)00287-5 http://doi.org/10.1016/S0304-3975(00)00287-5 . .

E. Pinheiro , , , R. Bianchini . . Energy conservation techniques for disk array-based servers . . 2006 . . Proc. 18th Annual Int. Conf. on Supercomputing . . 68 - - 78 . . DOI: 10.1145/1006209.1006220 http://doi.org/10.1145/1006209.1006220 . .

E. Pinheiro , , , R. Bianchini , , , C. Dubnicki . . Exploiting redundancy to conserve energy in storage systems . . 2006 . . Proc. Joint Int. Conf. on Measurement and Modeling of Computer Systems . . 15 - - 26 . . DOI: 10.1145/1140277.1140281 http://doi.org/10.1145/1140277.1140281 . .

I. Stoica , , , R. Morris , , , D. Karger , , , 等 . . Chord: a scalable peer-to-peer lookup service for Internet applications . . 2001 . . Proc. Conf. on Applications, Technologies, Architectures, and Protocols for Computer Communications . . 149 - - 160 . . DOI: 10.1145/383059.383071 http://doi.org/10.1145/383059.383071 . .

E. Thereska , , , A. Donnelly , , , D. Narayanan . . Sierra: practical power-proportionality for data center storage . . 2011 . . Proc. 6th Conf. on Computer Systems . . 169 - - 182 . . DOI: 10.1145/1966445.1966461 http://doi.org/10.1145/1966445.1966461 . .

Q. Zhu , , , Z. Chen , , , L. Tan , , , 等 . . Hibernator: helping disk arrays sleep through the winter . . 2005 . . 20th ACM Symp. on Operating Systems Principles . . 177 - - 190 . . DOI: 10.1145/1095810.1095828 http://doi.org/10.1145/1095810.1095828 . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

A spaceborne advanced storage system for remote sensing microsatellites

A reliable and energy-efficient storage system with erasure coding cache

Performance-driven assignment and mapping for reliable networks-on-chips