JZUS - Journal of Zhejiang University SCIENCE

Frontiers of Information Technology & Electronic Engineering

Accepted manuscript available online (unedited version)

VirtMan: design and implementation of a fast booting system for homogeneous virtual machines in iVCE

Author(s): Zi-yang Li, Yi-ming Zhang, Dong-sheng Li, Peng-fei Zhang, Xi-cheng Lu
Affiliation(s): National Laboratory for Parallel and Distributed Processing, School of Computer, National University of Defense Technology, Changsha 410073, China
Corresponding email(s): ymzhang@nudt.edu.cn
Key Words: Virtual machine, Fast booting, Homogeneity, Internet-based virtual computing environment (iVCE)

Share this article to： More <<< Previous Paper \|Next Paper >>>

Zi-yang Li, Yi-ming Zhang, Dong-sheng Li, Peng-fei Zhang, Xi-cheng Lu. VirtMan: design and implementation of a fast booting system for homogeneous virtual machines in iVCE[J]. Frontiers of Information Technology & Electronic Engineering,in press.https://doi.org/10.1631/FITEE.1500216

@article{title="VirtMan: design and implementation of a fast booting system for homogeneous virtual machines in iVCE",
author="Zi-yang Li, Yi-ming Zhang, Dong-sheng Li, Peng-fei Zhang, Xi-cheng Lu",
journal="Frontiers of Information Technology & Electronic Engineering",
year="in press",
publisher="Zhejiang University Press & Springer",
doi="https://doi.org/10.1631/FITEE.1500216"
}

%0 Journal Article
%T VirtMan: design and implementation of a fast booting system for homogeneous virtual machines in iVCE
%A Zi-yang Li
%A Yi-ming Zhang
%A Dong-sheng Li
%A Peng-fei Zhang
%A Xi-cheng Lu
%J Frontiers of Information Technology & Electronic Engineering
%P 110-121
%@ 2095-9184
%D in press
%I Zhejiang University Press & Springer
doi="https://doi.org/10.1631/FITEE.1500216"

TY - JOUR
T1 - VirtMan: design and implementation of a fast booting system for homogeneous virtual machines in iVCE
A1 - Zi-yang Li
A1 - Yi-ming Zhang
A1 - Dong-sheng Li
A1 - Peng-fei Zhang
A1 - Xi-cheng Lu
J0 - Frontiers of Information Technology & Electronic Engineering
SP - 110
EP - 121
%@ 2095-9184
Y1 - in press
PB - Zhejiang University Press & Springer
ER -
doi="https://doi.org/10.1631/FITEE.1500216"

Abstract
Chinese Summary
Academic Network
Reviewer Comment

Abstract: internet-based virtual computing environment (iVCE) has been proposed to combine data centers and other kinds of computing resources on the Internet to provide efficient and economical services. virtual machines (VMs) have been widely used in iVCE to isolate different users/jobs and ensure trustworthiness, but traditionally VMs require a long period of time for booting, which cannot meet the requirement of iVCE’s large-scale and highly dynamic applications. To address this problem, in this paper we design and implement VirtMan, a fast booting system for a large number of virtual machines in iVCE. VirtMan uses the Linux Small Computer System Interface (SCSI) target to remotely mount to the source image in a scalable hierarchy, and leverages the homogeneity of a set of VMs to transfer only necessary image data at runtime. We have implemented VirtMan both as a standalone system and for OpenStack. In our 100-server testbed, VirtMan boots up 1000 VMs (with a 15 GB image of Windows Server 2008) on 100 physical servers in less than 120 s, which is three orders of magnitude lower than current public clouds.

Abstract: This interesting piece of work describes VirtMan, a fast booting system for a large number of virtual machines via the Linux SCSI target. The basic idea is the same described in a previous journal paper (VMThunder) by the same authors, that is to mount the VM image in a scalable hierarchy, transferring only necessary data at runtime. The novelty/addition here is mainly given by the integration with OpenStack, since a coordinator already existed in VMThunder.

VirtMan: iVCE环境下同构虚拟机大规模部署系统的设计与实现

目的：在互联网环境下聚合数据中心中计算资源的虚拟计算环境（iVCE）可以提供经济而有效的服务。在iVCE中，我们广泛地应用虚拟机技术以实现用户间的隔离，保证计算环境的可信性。但是传统的虚拟机需要很长时间来启动，难以满足iVCE环境下大规模高动态的应用需求。针对这一问题，我们设计并实现了VirtMan，一个可以快速启动大量同构虚拟机的系统。
创新点：设计并实现了支持虚拟机镜像动态挂载的缓存组管理系统，可以实现动态地添加和删除缓存设备，减小从存储服务器上读取的数据量；设计并实现了支持虚拟机镜像数据快速分发的层级挂载技术，每个计算节点的本地缓存数据都可以提供给其他节点上的同构虚拟机，进一步减小存储服务器成为性能瓶颈的可能。
方法：VirtMan将远程的镜像块设备挂载到计算节点本地。在我们缓存组管理系统中为其新建一个缓存设备，并在缓存设备上为每个虚拟机建立快照，随后在快照设备上启动虚拟机。由于快照保证了缓存是只读的，我们将每个缓存设备作为新的挂载点，为其他节点上的同构虚拟机提供镜像数据。
结论：VirtMan通过弹性缓存组管理系统以及层级挂载等技术，极大地提高了大规模同构虚拟机的部署速度，可以实现在2分钟内部署1000台虚拟机。

关键词组：虚拟机；快速启动；同构性；基于互联网的虚拟计算环境（iVCE）

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference

[1]Armbrust, M., Fox, A., Griffith, R., et al., 2010. A view of cloud computing. Commun. ACM, 53(4):50-58.

[2]Chen, Z., Zhao, Y., Miao, X., et al., 2009. Rapid provisioning of cloud infrastructure leveraging peer-to-peer networks. Proc. 29th IEEE Int. Conf. on Distributed Computing Systems Workshops, p.324-329.

[3]Flouris, M.D., Bilas, A., 2005. Violin: a framework for extensible block-level storage. Proc. 13th NASA Goddard Conf. on Mass Storage Systems and Technologies, p.128-142.

[4]Flouris, M.D., Lachaize, R., Bilas, A., 2008. Orchestra: extensible block-level support for resource and data sharing in networked storage systems. Proc. 14th IEEE Int. Conf. on Parallel and Distributed Systems, p.237-244.

[5]Krekel, H., 2015. Python Tox 2.3.1. Available from https://pypi.python.org/pypi/tox [Accessed on June 28, 2015].

[6]Lagar-Cavilla, H.A., Whitney, J.A., Scannell, A.M., et al., 2009. SnowFlock: rapid virtual machine cloning for cloud computing. Proc. 4th ACM European Conf. on Computer systems, p.1-12.

[7]Lange, J.M., 2015. Python Testtools 1.8.1. Available from https://pypi.python.org/pypi/testtools [Accessed on June 28, 2015].

[8]Li, J., Li, D., Ye, Y., et al., 2015. Efficient multi-tenant virtual machine allocation in cloud data centers. Tsinghua Sci. Technol., 20(1):81-89.

[9]Lu, X., Wang, H., Wang, J., 2006. Internet-based virtual computing environment (iVCE): concepts and architecture. Sci. China Ser. F, 49(6):681-701.

[10]Mao, M., Humphrey, M., 2012. A performance study on the VM startup time in the cloud. Proc. 5th Int. Conf. on Cloud Computing, p.423-430.

[11]Meyer, D.T., Aggarwal, G., Cully, B., et al., 2008. Parallax: virtual disks for virtual machines. ACM SIGOPS Oper. Syst. Rev., 42(4):41-54.

[12]Nicolae, B., Bresnahan, J., Keahey, K., et al., 2011. Going back and forth: efficient multideployment and multisnapshotting on clouds. Proc. 20th Int. Symp. on High Performance Distributed Computing, p.147-158.

[13]Peng, C., Kim, M., Zhang, Z., et al., 2012. VDN: virtual machine image distribution network for cloud data centers. Proc. IEEE INFOCOM, p.181-189.

[14]Razavi, K., Ion, A., Kielmann, T., 2014. Squirrel: scatter hoarding VM image contents on IaaS compute nodes. Proc. 23rd Int. Symp. on High-Performance Parallel and Distributed Computing, p.265-278.

[15]Shamma, M., Meyer, D.T., Wires, J., et al., 2011. Capo: recapitulating storage for virtual desktops. FAST, p.31-45.

[16]Smith, J.E., Nair, R., 2005. The architecture of virtual machines. Computer, 38(5):32-38.

[17]Wartel, R., Cass, T., Moreira, B., et al., 2010. Image distribution mechanisms in large scale cloud providers. Proc. 2nd Int. Conf. on Cloud Computing Technology and Science, p.112-117.

[18]Weil, S.A., Brandt, S.A., Miller, E.L., et al., 2006. Ceph: a scalable, high-performance distributed file system. Proc. 7th Symp. on Operating Systems Design and Implementation, p.307-320.

[19]Zhang, Y., Liu, L., 2012. Distributed line graphs: a universal technique for designing DHTs based on arbitrary regular graphs. IEEE Trans. Knowl. Data Eng., 24(9):1556-1569.

[20]Zhang, Y., Chen, L., Lu, X., et al., 2010. Enabling routing control in a DHT. IEEE J. Sel. Areas Commun., 28(1):28-38.

[21]Zhang, Y., Guo, C., Li, D., et al., 2015. CubicRing: enabling one-hop failure detection and recovery for distributed in-memory storage systems. Proc. 12th USENIX Symp. on Networked Systems Design and Implementation, p.529-542.

[22]Zhang, Z., Li, Z., Wu, K., et al., 2014. VMThunder: fast provisioning of large-scale virtual machine clusters. IEEE Trans. Parall. Distr. Syst., 25(12):3328-3338.

[23]Zhao, Y., Wu, J., Liu, C., 2014. On peer-assisted data dissemination in data center networks: analysis and implementation. Tsinghua Sci. Technol., 19(1):51-64.

Open peer comments: Debate/Discuss/Question/Opinion

<1>

- Go to

VirtMan: iVCE环境下同构虚拟机大规模部署系统的设计与实现

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference