Svoboda | Graniru | BBC Russia | Golosameriki | Facebook

Article

Black-box and gray-box strategies for virtual machine migration

Authors:

Prashant Shenoy,

Arun Venkataramani, and

Mazin YousifAuthors Info & Claims

NSDI'07: Proceedings of the 4th USENIX conference on Networked systems design & implementation

April 2007

Page 17

Published: 11 April 2007 Publication History

Abstract

Virtualization can provide significant benefits in data centers by enabling virtual machine migration to eliminate hotspots. We present Sandpiper, a system that automates the task of monitoring and detecting hotspots, determining a new mapping of physical to virtual resources and initiating the necessary migrations. Sandpiper implements a black-box approach that is fully OS- and application-agnostic and a gray-box approach that exploits OS- and application-level statistics. We implement our techniques in Xen and conduct a detailed evaluation using a mix of CPU, network and memory-intensive applications. Our results show that Sandpiper is able to resolve single server hotspots within 20 seconds and scales well to larger, data center environments. We also show that the gray-box approach can help Sandpiper make more informed decisions, particularly in response to memory pressure.

References

[1]

K. Appleby, S. Fakhouri, L. Fong, M. Goldszmidt, S. Krishnakumar, D. Pazel, J. Pershing, and B. Rochwerger. Oceano - slabased management of a computing utility. In Proc. IFIP/IEEE Symposium on Integrated Management, May 2001.

[2]

M. Aron, P. Druschel, and W. Zwaenepoel. Cluster reserves: A mechanism for resource management in cluster-based network servers. In Proc. ACM SIGMETRICS '00.

Digital Library

[3]

P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In Proc. SOSP'03, pages 164-177, October 2003.

Digital Library

[4]

G. P. Box, G. M. Jenkins, and G. C. Reinsel. Time Series Analysis Forecasting and Control Third Edition. Prentice Hall, 1994.

Digital Library

[5]

J. Chase, D. Anderson, P. Thakar, A. Vahdat, and R. Doyle. Managing energy and server resources in hosting centers. In Proc. SOSP '01.

Digital Library

[6]

C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proc. NSDI '05, May 2005.

Digital Library

[7]

K. Govil, D. Teodosiu, Y. Huang, and M. Rosenblum. Cellular disco: Resource management using virtual clusters on sharedmemory multiprocessors. In Proc. SOSP'99, pages 154-169, December 1999.

Digital Library

[8]

L. Grit, D. Irwin, A. Yumerefendi, and J. Chase. Virtual Machine Hosting for Networked Clusters: Building the Foundations for Autonomic Orchestration. In Proc. VTDC '06.

Digital Library

[9]

D. Gupta, L. Cherkasova, R. Gardner, and A. Vahdat. Enforcing Performance Isolation Across Virtual Machines in Xen. In Proc. Middleware '06, October, 2006.

Digital Library

[10]

D. Gupta, R. Gardner, and L. Cherkasova. Xenmon: Qos monitoring and performance profiling tool. Technical Report HPL- 2005-187, HP Labs, 2005.

[11]

S. Jones, A. Arpaci-Dusseau, and R. Arpaci-Dusseau. Geiger: Monitoring the buffer cache in a virtual machine environment. In Proc. ASPLOS'06, pages 13-23, October 2006.

Digital Library

[12]

A. Kamra, V. Misra, and E. Nahum. Yaksha: A self-tuning controller for managing the performance of 3-tiered web sites. In Proc. IWQoS '04, June 2004.

[13]

L. Kleinrock. Queueing Systems, Volume 2: Computer Applications. John Wiley and Sons, Inc., 1976.

[14]

D. Menasce and M. Bennani. Autonomic Virtualized Environments. In IEEE ICAS 06.

Digital Library

[15]

M. Nelson, B. Lim, and G. Hutchins. Fast Transparent Migration for Virtual Machines. In Proc. USENIX 2005.

Digital Library

[16]

S. Osman, D. Subhraveti, G. Su, and J. Nieh. The design and implementation of zap: A system for migrating computing environments, In Proc. OSDI 2002.

Digital Library

[17]

S. Ranjan, J. Rolia, H. Fu, and E. Knightly. Qos-driven server migration for internet data centers. In Proc. IWQoS 2002.

[18]

P. Ruth, J. Rhee, D. Xu, R. Kennell, and S. Goasguen. Autonomic Live Adaptation of Virtual Computational Environments in a Multi-Domain Infrastructure. In Proc. IEEE ICAC '06.

Digital Library

[19]

C. Sapuntzakis, R. Chandra, B. Pfaff, J. Chow, M. Lam, and M. Rosenblum. Optimizing the migration of virtual computers. In Proc. OSDI '02.

Digital Library

[20]

V. Sundaram, T. Wood, and P. Shenoy. Efficient Data Migration in Self-managing Storage Systems. In Proc. ICAC '06.

Digital Library

[21]

A. Sundararaj, A. Gupta, and P. Dinda. Increasing Application Performance in Virtual Environments through Run-time Inference and Adaptation. In Proc. HPDC '05.

Digital Library

[22]

M. M. Theimer, K. A. L., and D. R. Cheriton. Preemptable Remote Execution Facilities for the V-System. In Proc. SOSP December 1985.

Digital Library

[23]

B. Urgaonkar, P. Shenoy, A. Chandra, and P. Goyal. Dynamic provisioning for multi-tier internet applications. In Proc. ICAC '05, June 2005.

Digital Library

[24]

VMware Dynamic Resource Scheduler. http://www.vmware.com/products/vi/vc/drs.html.

Cited By

Satpathy ASahoo MSangaiah ASwain CBakshi S(2022)CoMapComputer Networks: The International Journal of Computer and Telecommunications Networking10.1016/j.comnet.2022.109248216:COnline publication date: 24-Oct-2022
https://dl.acm.org/doi/10.1016/j.comnet.2022.109248
Qiao BYang FLuo CWang YLi JLin QZhang HDatta MZhou AMoscibroda TRajmohan SZhang DSpinellis DGousios GChechik MDi Penta M(2021)Intelligent container reallocation at Microsoft 365Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3468264.3473936(1438-1443)Online publication date: 20-Aug-2021
https://dl.acm.org/doi/10.1145/3468264.3473936
Xing JChen ANg T(2020)Secure State Migration in the Data PlaneProceedings of the Workshop on Secure Programmable Network Infrastructure10.1145/3405669.3405822(28-34)Online publication date: 10-Aug-2020
https://dl.acm.org/doi/10.1145/3405669.3405822
Show More Cited By

Black-box and gray-box strategies for virtual machine migration

Recommendations

Improving Total Migration Time in Live Virtual Machine Migration
ICCCT '15: Proceedings of the Sixth International Conference on Computer and Communication Technology 2015

Virtualization is the key underlying technology enabling cloud providers to host services for a large number of customers. Live migration is an essential feature of virtualization that allows transfer of virtual machines from one physical server to ...
Read More
Performance Metrics of Virtual Machine Live Migration
CLOUD '15: Proceedings of the 2015 IEEE 8th International Conference on Cloud Computing

Live virtual machine migration allows resources from one physical server to be moved to another with little or no interruption in the processes of the guest operating system. The process involved in performing a live migration includes copying the guest ...
Read More
A Technical Review for Efficient Virtual Machine Migration
CUBE '13: Proceedings of the 2013 International Conference on Cloud & Ubiquitous Computing & Emerging Technologies

This paper presents the recent technical research survey on the efficient live migration of virtual machines. Virtual machine migration is required for many reasons like load balancing, energy reduction, dynamic resizing, and to increase availability. ...
Read More

Comments

Information & Contributors

Information

Published In

NSDI'07: Proceedings of the 4th USENIX conference on Networked systems design & implementation

April 2007

27 pages

Sponsors

VMware
Google Inc.
Microsoft Research: Microsoft Research
Intel: Intel
CISCO

Publisher

USENIX Association

United States

Publication History

Published: 11 April 2007

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

185
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Other Metrics

View Author Metrics

Citations

Cited By

Satpathy ASahoo MSangaiah ASwain CBakshi S(2022)CoMapComputer Networks: The International Journal of Computer and Telecommunications Networking10.1016/j.comnet.2022.109248216:COnline publication date: 24-Oct-2022
https://dl.acm.org/doi/10.1016/j.comnet.2022.109248
Qiao BYang FLuo CWang YLi JLin QZhang HDatta MZhou AMoscibroda TRajmohan SZhang DSpinellis DGousios GChechik MDi Penta M(2021)Intelligent container reallocation at Microsoft 365Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3468264.3473936(1438-1443)Online publication date: 20-Aug-2021
https://dl.acm.org/doi/10.1145/3468264.3473936
Xing JChen ANg T(2020)Secure State Migration in the Data PlaneProceedings of the Workshop on Secure Programmable Network Infrastructure10.1145/3405669.3405822(28-34)Online publication date: 10-Aug-2020
https://dl.acm.org/doi/10.1145/3405669.3405822
Wu CSreekanti VHellerstein J(2020)Autoscaling tiered cloud storage in AnnaThe VLDB Journal — The International Journal on Very Large Data Bases10.1007/s00778-020-00632-730:1(25-43)Online publication date: 9-Sep-2020
https://dl.acm.org/doi/10.1007/s00778-020-00632-7
Gangadhar PHota ARao MRao V(2019)Performance of Memory Virtualization Using Global Memory Resource BalancingInternational Journal of Cloud Applications and Computing10.4018/IJCAC.20190101029:1(16-32)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.4018/IJCAC.2019010102
Wu CSreekanti VHellerstein J(2019)Autoscaling tiered cloud storage in AnnaProceedings of the VLDB Endowment10.14778/3311880.331188112:6(624-638)Online publication date: 1-Feb-2019
https://dl.acm.org/doi/10.14778/3311880.3311881
Hermenier FRamesh ANagpal AShukla HChandra R(2019)Hotspot Mitigations for the MassesProceedings of the ACM Symposium on Cloud Computing10.1145/3357223.3362717(102-113)Online publication date: 20-Nov-2019
https://dl.acm.org/doi/10.1145/3357223.3362717
Moghaddam SBuyya RRamamohanarao K(2019)Performance-Aware Management of Cloud ResourcesACM Computing Surveys10.1145/333795652:4(1-37)Online publication date: 30-Aug-2019
https://dl.acm.org/doi/10.1145/3337956
Chaufournier LAli-Eldin ASharma PShenoy PTowsley DApte VDi Marco ALitoiu MMerseguer J(2019)Performance Evaluation of Multi-Path TCP for Data Center and Cloud WorkloadsProceedings of the 2019 ACM/SPEC International Conference on Performance Engineering10.1145/3297663.3310295(13-24)Online publication date: 4-Apr-2019
https://dl.acm.org/doi/10.1145/3297663.3310295
Boukerche AGuan SGrande R(2019)Sustainable Offloading in Mobile Cloud ComputingACM Computing Surveys10.1145/328668852:1(1-37)Online publication date: 21-Feb-2019
https://dl.acm.org/doi/10.1145/3286688
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents