VirtMan: iVCE环境下同构虚拟机大规模部署系统的设计与实现

Zi-yang LI; Yi-ming ZHANG; Dong-sheng LI; Peng-fei ZHANG; Xi-cheng LU

doi:10.1631/FITEE.1500216

Your Location：

Home >

Browse articles >

VirtMan: iVCE环境下同构虚拟机大规模部署系统的设计与实现

常规文章 | Updated：2022-05-19

- VirtMan: iVCE环境下同构虚拟机大规模部署系统的设计与实现
- VirtMan: design and implementation of a fast booting system for homogeneous virtual machines in iVCE
- 信息与电子工程前沿（英文） 2016年17卷第2期页码：110-121
- Affiliations：
  
  National Laboratory for Parallel and Distributed Processing, School of Computer, Department of Mathematics, Zhejiang University, Hangzhou 310027, China
- Author bio：
  
  [ "" ]
  [ "", "Xi-cheng LU, Editor-in-Chief of Frontiers of Information Technology & Electronic Engineering, received the B.Sc. degree in computer science from Harbin Military Engineering Institute, Harbin, China, in 1970. He was a visiting scholar at the University of Massachusetts between 1982 and 1984. He is currently a professor in the School of Computer, National University of Defense Technology, China. His research interests include distributed computing, computer networks, and parallel computing. He has served as a member of editorial boards of several journals and has cochaired many professional conferences. He is a joint recipient of more than a dozen academic awards, including four First-Class National Scientific and Technological Progress Prize of China. He is a member of the Chinese Academy of Engineering." ]
- Funds：
  
  Project supported by the National Natural Science Foundation of China (Nos. 61379055 and 61379053)
- DOI：10.1631/FITEE.1500216
  中图分类号： TP399
- 收稿：2015-07-08，
  
  录用：2015-12-17，
  
  纸质出版：2016-02
- Accepted：
Scan QR Code
VirtMan: iVCE环境下同构虚拟机大规模部署系统的设计与实现[J]. 信息与电子工程前沿（英文）, 2016,17(2):110-121.

Zi-yang LI, Yi-ming ZHANG, Dong-sheng LI, et al. VirtMan: design and implementation of a fast booting system for homogeneous virtual machines in iVCE[J]. Frontiers of Information Technology & Electronic Engineering, 2016, 17(2): 110-121.
VirtMan: iVCE环境下同构虚拟机大规模部署系统的设计与实现[J]. 信息与电子工程前沿（英文）, 2016,17(2):110-121. DOI： 10.1631/FITEE.1500216.

Zi-yang LI, Yi-ming ZHANG, Dong-sheng LI, et al. VirtMan: design and implementation of a fast booting system for homogeneous virtual machines in iVCE[J]. Frontiers of Information Technology & Electronic Engineering, 2016, 17(2): 110-121. DOI： 10.1631/FITEE.1500216.

摘要

目的

在互联网环境下聚合数据中心中计算资源的虚拟计算环境（iVCE）可以提供经济而有效的服务。在iVCE中，我们广泛地应用虚拟机技术以实现用户间的隔离，保证计算环境的可信性。但是传统的虚拟机需要很长时间来启动，难以满足iVCE环境下大规模高动态的应用需求。针对这一问题，我们设计并实现了VirtMan，一个可以快速启动大量同构虚拟机的系统。

创新点

设计并实现了支持虚拟机镜像动态挂载的缓存组管理系统，可以实现动态地添加和删除缓存设备，减小从存储服务器上读取的数据量；设计并实现了支持虚拟机镜像数据快速分发的层级挂载技术，每个计算节点的本地缓存数据都可以提供给其他节点上的同构虚拟机，进一步减小存储服务器成为性能瓶颈的可能。

方法

VirtMan将远程的镜像块设备挂载到计算节点本地。在我们缓存组管理系统中为其新建一个缓存设备，并在缓存设备上为每个虚拟机建立快照，随后在快照设备上启动虚拟机。由于快照保证了缓存是只读的，我们将每个缓存设备作为新的挂载点，为其他节点上的同构虚拟机提供镜像数据。

结论

VirtMan通过弹性缓存组管理系统以及层级挂载等技术，极大地提高了大规模同构虚拟机的部署速度，可以实现在2分钟内部署1000台虚拟机。

Abstract

Internet-based virtual computing environment (iVCE) has been proposed to combine data centers and other kinds of computing resources on the Internet to provide efficient and economical services. Virtual machines (VMs) have been widely used in iVCE to isolate different users/jobs and ensure trustworthiness

but traditionally VMs require a long period of time for booting

which cannot meet the requirement of iVCE's large-scale and highly dynamic applications. To address this problem

in this paper we design and implement VirtMan

a fast booting system for a large number of virtual machines in iVCE. VirtMan uses the Linux Small Computer System Interface (SCSI) target to remotely mount to the source image in a scalable hierarchy

and leverages the homogeneity of a set of VMs to transfer only necessary image data at runtime. We have implemented VirtMan both as a standalone system and for OpenStack. In our 100-server testbed

VirtMan boots up 1000~VMs (with a 15~GB image of Windows Server 2008) on 100 physical servers in less than 120~s

which is three orders of magnitude lower than current public clouds.

关键词

Keywords

references

M Armbrust , , , A Fox , , , R Griffith , , , 等 . . A view of cloud computing . . Commun. ACM , , 2010 . . 53 ( ( 4 ): ): 50 - - 58 . . DOI: 10.1145/1721654.1721672 http://doi.org/10.1145/1721654.1721672 . .

Z Chen , , , Y Zhao , , , X Miao , , , 等 . . Rapid provisioning of cloud infrastructure leveraging peer-to-peer networks . . 2009 . . Proc. 29th IEEE Int. Conf. on Distributed Computing Systems Workshops . . p.324 - - 329 . . DOI: 10.1109/ICDCSW.2009.35 http://doi.org/10.1109/ICDCSW.2009.35 . .

M.D Flouris , , , A Bilas . . Violin: a framework for extensible block-level storage . . 2005 . . Proc. 13th NASA Goddard Conf. on Mass Storage Systems and Technologies . . 128 - - 142 . . DOI: 10.1109/MSST.2005.41 http://doi.org/10.1109/MSST.2005.41 . .

M.D Flouris , , , R Lachaize , , , A Bilas . . Orchestra: extensible block-level support for resource and data sharing in networked storage systems . . 2008 . . Proc. 14th IEEE Int. Conf. on Parallel and Distributed Systems . . 237 - - 244 . . DOI: 10.1109/ICPADS.2008.110 http://doi.org/10.1109/ICPADS.2008.110 . .

Apache Software Foundation Hot Standby for NameNode , , 2015 . . 3.1. Available from: https://pypi.python.org/pypi/tox https://pypi.python.org/pypi/tox [Accessed on June 28] . .

H.A Lagar-Cavilla , , , J.A Whitney , , , A.M Scannell , , , 等 . . SnowFlock: rapid virtual machine cloning for cloud computing . . 2009 . . Proc. 4th ACM European Conf. on Computer systems . . 1 - - 12 . . DOI: 10.1145/1519065.1519067 http://doi.org/10.1145/1519065.1519067 . .

Apache Software Foundation Hot Standby for NameNode , , 2015 . . 8.1. Available from: https://pypi.python.org/pypi/testtools https://pypi.python.org/pypi/testtools [Accessed on June 28] . .

J Li , , , D Li , , , Y Ye , , , 等 . . Efficient multi-tenant virtual machine allocation in cloud data centers . . Tsinghua Sci. Technol. , , 2015 . . 20 ( ( 1 ): ): 81 - - 89 . . DOI: 10.1109/TST.2015.7040517 http://doi.org/10.1109/TST.2015.7040517 . .

X Lu , , , H Wang , , , J Wang . . Internet-based virtual computing environment (iVCE): concepts and architecture . . Sci. China Ser. F , , 2006 . . 49 ( ( 6 ): ): 681 - - 701 . . DOI: 10.1007/s11432-006-2030-6 http://doi.org/10.1007/s11432-006-2030-6 . .

M Mao , , , M Humphrey . . A performance study on the VM startup time in the cloud . . 2012 . . Proc. 5th Int. Conf. on Cloud Computing . . 423 - - 430 . . DOI: 10.1109/CLOUD.2012.103 http://doi.org/10.1109/CLOUD.2012.103 . .

D.T Meyer , , , G Aggarwal , , , B Cully , , , 等 . . Parallax: virtual disks for virtual machines . . ACM SIGOPS Oper. Syst. Rev. , , 2008 . . 42 ( ( 4 ): ): 41 - - 54 . . DOI: 10.1145/1357010.1352598 http://doi.org/10.1145/1357010.1352598 . .

B Nicolae , , , J Bresnahan , , , K Keahey , , , 等 . . Going back and forth: efficient multideployment and multisnapshotting on clouds . . 2011 . . Proc. 20th Int. Symp. on High Performance Distributed Computing . . 147 - - 158 . . DOI: 10.1145/1996130.1996152 http://doi.org/10.1145/1996130.1996152 . .

C Peng , , , M Kim , , , Z Zhang , , , 等 . . VDN: virtual machine image distribution network for cloud data centers . . 2012 . . Proc. IEEE INFOCOM . . 181 - - 189 . . DOI: 10.1109/INFCOM.2012.6195556 http://doi.org/10.1109/INFCOM.2012.6195556 . .

K Razavi , , , A Ion , , , T Kielmann . . Squirrel: scatter hoarding VM image contents on IaaS compute nodes . . 2014 . . Proc. 23rd Int. Symp. on High-Performance Parallel and Distributed Computing . . 265 - - 278 . . DOI: 10.1145/2600212.2600221 http://doi.org/10.1145/2600212.2600221 . .

M Shamma , , , D.T Meyer , , , J Wires , , , 等 . . Capo: recapitulating storage for virtual desktops . . 2011 . . FAST . . 31 - - 45 . . . .

J.E Smith , , , R Nair . . The architecture of virtual machines . . Computer , , 2005 . . 38 ( ( 5 ): ): 32 - - 38 . . DOI: 10.1109/MC.2005.173 http://doi.org/10.1109/MC.2005.173 . .

R Wartel , , , T Cass , , , B Moreira , , , 等 . . Image distribution mechanisms in large scale cloud providers . . 2010 . . Proc. 2nd Int. Conf. on Cloud Computing Technology and Science . . 112 - - 117 . . DOI: 10.1109/CloudCom.2010.73 http://doi.org/10.1109/CloudCom.2010.73 . .

S.A Weil , , , S.A Brandt , , , E.L Miller , , , 等 . . Ceph: a scalable, high-performance distributed file system . . 2006 . . Proc. 7th Symp. on Operating Systems Design and Implementation . . 307 - - 320 . . . .

Y Zhang , , , L Liu . . Distributed line graphs: a universal technique for designing DHTs based on arbitrary regular graphs . . IEEE Trans. Knowl. Data Eng. , , 2012 . . 24 ( ( 9 ): ): 1556 - - 1569 . . DOI: 10.1109/TKDE.2011.258 http://doi.org/10.1109/TKDE.2011.258 . .

Y Zhang , , , L Chen , , , X Lu , , , 等 . . Enabling routing control in a DHT . . IEEE J. Sel. Areas Commun. , , 2010 . . 28 ( ( 1 ): ): 28 - - 38 . . DOI: 10.1109/JSAC.2010.100104 http://doi.org/10.1109/JSAC.2010.100104 . .

Y Zhang , , , C Guo , , , D Li , , , 等 . . CubicRing: enabling one-hop failure detection and recovery for distributed in-memory storage systems . . 2015 . . Proc. 12th USENIX Symp. on Networked Systems Design and Implementation . . 529 - - 542 . . . .

Z Zhang , , , Z Li , , , K Wu , , , 等 . . VMThunder: fast provisioning of large-scale virtual machine clusters . . IEEE Trans. Parall. Distr. Syst. , , 2014 . . 25 ( ( 12 ): ): 3328 - - 3338 . . DOI: 10.1109/TPDS.2014.7 http://doi.org/10.1109/TPDS.2014.7 . .

Y Zhao , , , J Wu , , , C Liu . . On peer-assisted data dissemination in data center networks: analysis and implementation . . Tsinghua Sci. Technol. , , 2014 . . 19 ( ( 1 ): ): 51 - - 64 . . DOI: 10.1109/TST.2014.6733208 http://doi.org/10.1109/TST.2014.6733208 . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

暂无数据