Svoboda | Graniru | BBC Russia | Golosameriki | Facebook
skip to main content
Advanced Search
10.1145/339331.339383acmconferencesArticle/Chapter ViewAbstractPublication PagesmetricsConference Proceedingsconference-collections

Cluster reserves: a mechanism for resource management in cluster-based network servers

Authors: Mohit Aron, Peter Druschel, Willy ZwaenepoelAuthors Info & Claims
SIGMETRICS '00: Proceedings of the 2000 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Pages 90 - 101
https://doi.org/10.1145/339331.339383
Published: 01 June 2000 Publication History
Metrics
Total Citations166
Total Downloads1,418
Last 12 Months97
Last 6 weeks17
PDFeReader

Abstract

In network (e.g., Web) servers, it is often desirable to isolate the performance of different classes of requests from each other. That is, one seeks to achieve that a certain minimal proportion of server resources are available for a class of requests, independent of the load imposed by other requests. Recent work demonstrates how to achieve this performance isolation in servers consisting of a single, centralized node; however, achieving performance isolation in a distributed, cluster based server remains a problem.
This paper introduces a new abstraction, the cluster reserve, which represents a resource principal in a cluster based network server. We present a design and evaluate a prototype implementation that extends existing techniques for performance isolation on a single node server to cluster based servers.
In our design, the dynamic cluster-wide resource management problem is formulated as a constrained optimization problem, with the resource allocations on individual machines as independent variables, and the desired cluster-wide resource allocations as constraints. Periodically collected resource usages serve as further inputs to the problem.
Experimental results show that cluster reserves are effective in providing performance isolation in cluster based servers. We demonstrate that, in a number of different scenarios, cluster reserves are effective in ensuring performance isolation while enabling high utilization of the server resources.

References

[1]
D. Andresen et al. SWEB: Towaxds a Scalable WWW Server on MultiComputers. In Proccedings of the lOtb lnterna~iona! Parallel Processing Symposium~ Apr. 1996.]]
Digital Library
Google Scholar
[2]
Apache. http://www.apa~he.org/.]]
Google Scholar
[3]
M. F. Arlitt a~d C. b. WiUiamson. Web Server Workload Characterization: The Search for Invariants. In Proceedings of the A CM SIGMETRICS '96 Conference, Philadelphia~ PA, Apr. 1996.]]
Digital Library
Google Scholar
[4]
M. Aron, P. Druschel, and W. Zwaenepoel. Efficient Support for P-HTTP in Cluster-based Web Servers. In Proceedings of the U~ENIX 1999 Annual Technical Conference, Monterey~ CA, June 1999.]]
Digital Library
Google Scholar
[5]
M. Aron, D. Sanders, P. Druschel, and W. Zwaenepoel. Scalable Content-aware Request Distribution in Cluster-based Network Servers. In Proceedings of the USENIX 2000 Annual Technical Conference, San Diego~ CA~ June 2000.]]
Digital Library
Google Scholar
[6]
G. Banga and P. Druschel. Measuring the capacity of a Web server under realistic loads. World Wide Web Journal (Special Issue on World Wide Web Characterization and Performance Evaluation), 1999.]]
Digital Library
Google Scholar
[7]
G. Banga, P. Druschei, and J. C. Mogul. Resource containers: A new facility for resource management in server systems. In Proceedings of the 3rd USBNIX Symposium on Operating Systems Design and Implementation~ Feb. 1999.]]
Digital Library
Google Scholar
[8]
T. Brisco. DNS Support for Load Balancing. RFC 1794, Apr. 1995.]]
Digital Library
Google Scholar
[9]
J. Bruno, J. Brustoloni, E. Gabber, B. Ozden, and A. Silberschatz. Retrofitting Quality of Service into a Time-Sharing Operating System. In Proceedings of the USENIX 1.999 Annual Technical Conference, Monterey, CA, June 1999.]]
Digital Library
Google Scholar
[10]
J. Bruno, E. Gabber, B. Ozden, and A. Silberschatz. The Eclipse Operating System: Providing Quality of Service via l~eservation Domains. In Proceedings of the USENIX 1998 Annual Technical Conference, Berkeley, CA~ June 1998.]]
Digital Library
Google Scholar
[11]
Cisco Systems Inc. LocalDirector. http://www.cisco.com.]]
Google Scholar
[12]
O. P. Damani, P.-Y. E. Chung, Y. Huang, C. Kintala, and Y.-M. Wang. ONE-IP: Techniques for hosting a service on a cluster of machines. Computer Networks and I2?DN Systems~ 29:1019-1027~ 1997.]]
Digital Library
Google Scholar
[13]
P. Druschel and G. Banga. Lazy receiver processing (LRP): A network subsystem architecture for server systems. In Proceedings of the 2nd USENIX Symposium on Operating Systems Design and Implementation, Seattle~ WAs Oct. 1996.]]
Digital Library
Google Scholar
[14]
A. Fox, S. D. Gribble, Y. Chawathe, E. A. Brewer, and P. Gauthier. Cluster-based scalable network services. In Proceedings of the Sixteenth A CM Symposium on Operating System Principles, San Malo, France, Oct. 1997.]]
Digital Library
Google Scholar
[15]
P. Goyal, X. Guo, and H. M. Vin. A Hierarchical CPU Scheduler for Multimedia Operating System. In Proceedings of the 2nd USENIX Symposium on Operabing Systems Design and Implementa~ion~ Seattle, WA, Oct. 1996.]]
Digital Library
Google Scholar
[16]
IBM Corporation. IBM interactive network dispatcher. http://www.ics.raleigh.ibm.com/ics/isslearn.htm.]]
Google Scholar
[17]
M. B. Jones, P. J. Leach, R. P. Draves, and J. S. Barrera. Modular real-time resource management in the Rialto operating system. In Proceedings of the Fifth Workshop on Hot Topics in Operating Systems (HotOS-V), Orcas Island, WA, May 1995.]]
Digital Library
Google Scholar
[18]
J. C. Mogul. The Case for Persistent-Connection I-ITTP. In Proceedings of the ACM SIGCOMM '95 Symposium, 1995.]]
Digital Library
Google Scholar
[19]
J. Nieh and M. S. Lam. The Design, Implementation and Evaluation of SMART: A Scheduler for Multimedia Applications. In Proceedings of the 16fl~ Symposium on Operating Systems Principles (SOSP-97), New York, Oct. 1997.]]
Digital Library
Google Scholar
[20]
V. S. Pai, M. Aron, G. Banga, M. Svendsen, P. Druschel, W. Zwaenepoel, and E. Nahum. Locality-Aware Request Distribution in Cluster-based Network Servers. In Proceeding8 of the 8th Conference on Architectural Support .for Programming Languages and Operating Systems~ San Jose, CA, Oct. 1998.]]
Digital Library
Google Scholar
[21]
Resonate inc. Resonate dispatch. http://www.resonateinc.com.]]
Google Scholar
[22]
J. Sethuraman and M. S. Squillante. Optimal stochastic scheduling in multiclass parallel queues. In Proceedings of the A CM Sigmetrics Conference on Measurement and Modeling of Computer Systeras, Atlanta, GA~ May 1999.]]
Digital Library
Google Scholar
[23]
O. Spatscheck and L. L. Peterson. Defending Against Denial of Service Attacks in Scout. In Proceedings of the 3rd USENIX Symposium on Operating Systems Design and Implementation~ Feb. 1999.]]
Digital Library
Google Scholar
[24]
R. Vanderbei. LOQO: An interior point code for quadratic programming. Optimization Methods and Software, 1999.]]
Crossref
Google Scholar
[25]
B. Verghese, A. Gupta, and M. Rosenblum. Performance Isolation: Sharing and Isolation in Shared-Memory Multiprocessors. In Proceedings of the 8th Conference on Architectural Support for Programming Languages and Operating Systems, San Jose~ CA, Oct. 1998.]]
Digital Library
Google Scholar
[26]
C. A. Waldspurger and W. E. Weihl. Lottery Scheduling: Flexible Proportional-Share Resource Management. In Proceedings of the Ist USENIX Symposium on Operating Systems Design and Implementation, Monterey, CA, Nov. 1994.]]
Digital Library
Google Scholar
[27]
C. Yoshikawa, B. Chun, P. Easthaxn, A. Vahdat, T. Anderson, and D. Culler. Using Smart Clients to Build Scalable Services. In Proceedings of the 1997 USENIX Technical Conference~ Berkeley, CA, Jan. 1997.]]
Digital Library
Google Scholar

Cited By

View all
  • Shirali AKazemi Kordestani JMeybodi M(2018)Self-adaptive multi-population genetic algorithms for dynamic resource allocation in shared hosting platformsGenetic Programming and Evolvable Machines10.1007/s10710-018-9326-319:4(505-534)Online publication date: 1-Dec-2018
    https://dl.acm.org/doi/10.1007/s10710-018-9326-3
  • Taton Cde Palma NBouchenak S(2018)Adaptive Middleware for Message Queuing SystemsEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_1540(57-61)Online publication date: 7-Dec-2018
    https://doi.org/10.1007/978-1-4614-8265-9_1540
  • Macedo RMelniski LSantos AGhamri-Doudane YNogueira M(2017)SPARTAComputer Networks: The International Journal of Computer and Telecommunications Networking10.1016/j.comnet.2017.04.033121:C(37-52)Online publication date: 5-Jul-2017
    https://dl.acm.org/doi/10.1016/j.comnet.2017.04.033
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

SIGMETRICS '00: Proceedings of the 2000 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
June 2000
329 pages
ISBN:1581131941
DOI:10.1145/339331
  • ACM SIGMETRICS Performance Evaluation Review  Volume 28, Issue 1
    Special issue on proceedings of ACM SIGMETRICS 2000
    June 2000
    327 pages
    ISSN:0163-5999
    DOI:10.1145/345063
    Issue’s Table of Contents
Copyright © 2000 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 2000

Permissions

Request permissions for this article.
Request Permissions

Check for updates

Qualifiers

  • Article

Conference

SIGMETRICS00
Sponsor:
SIGMETRICS00: The International Conference on Measurement and Modeling of Computer Systems
June 18 - 21, 2000
California, Santa Clara, USA

Acceptance Rates

SIGMETRICS '00 Paper Acceptance Rate 28 of 165 submissions, 17%;
Overall Acceptance Rate 459 of 2,691 submissions, 17%
More

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)97
  • Downloads (Last 6 weeks)17
Reflects downloads up to 25 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all
  • Shirali AKazemi Kordestani JMeybodi M(2018)Self-adaptive multi-population genetic algorithms for dynamic resource allocation in shared hosting platformsGenetic Programming and Evolvable Machines10.1007/s10710-018-9326-319:4(505-534)Online publication date: 1-Dec-2018
    https://dl.acm.org/doi/10.1007/s10710-018-9326-3
  • Taton Cde Palma NBouchenak S(2018)Adaptive Middleware for Message Queuing SystemsEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_1540(57-61)Online publication date: 7-Dec-2018
    https://doi.org/10.1007/978-1-4614-8265-9_1540
  • Macedo RMelniski LSantos AGhamri-Doudane YNogueira M(2017)SPARTAComputer Networks: The International Journal of Computer and Telecommunications Networking10.1016/j.comnet.2017.04.033121:C(37-52)Online publication date: 5-Jul-2017
    https://dl.acm.org/doi/10.1016/j.comnet.2017.04.033
  • Veeraraghavan KMeza JChou DKim WMargulis SMichelson SNishtala RObenshain DPerelman DSong YKeeton KRoscoe T(2016)KrakenProceedings of the 12th USENIX conference on Operating Systems Design and Implementation10.5555/3026877.3026926(635-650)Online publication date: 2-Nov-2016
    https://dl.acm.org/doi/10.5555/3026877.3026926
  • Macedo RSantos AGhamri-Doudane YNogueira M(2016)A scheme for DDoS attacks mitigation in IdM systems through reorganizationsNOMS 2016 - 2016 IEEE/IFIP Network Operations and Management Symposium10.1109/NOMS.2016.7502825(298-305)Online publication date: Apr-2016
    https://doi.org/10.1109/NOMS.2016.7502825
  • Taton CDe Palma NBouchenak S(2016)Adaptive Middleware for Message Queuing SystemsEncyclopedia of Database Systems10.1007/978-1-4899-7993-3_1540-2(1-5)Online publication date: 26-Dec-2016
    https://doi.org/10.1007/978-1-4899-7993-3_1540-2
  • Saifullah MMohammed M(2015)Scalable load balancing using enhanced server health monitoring and adimission control2015 IEEE International Conference on Engineering and Technology (ICETECH)10.1109/ICETECH.2015.7275005(1-4)Online publication date: Mar-2015
    https://doi.org/10.1109/ICETECH.2015.7275005
  • Panda SGupta IJana P(2015)Allocation-aware Task Scheduling for Heterogeneous Multi-cloud SystemsProcedia Computer Science10.1016/j.procs.2015.04.08150(176-184)Online publication date: 2015
    https://doi.org/10.1016/j.procs.2015.04.081
  • Belaid IEyraud-Dubois L(2015)Column Generation Integer Programming for Allocating Jobs with Periodic Demand VariationsRevised Selected Papers of the First International Workshop on Algorithmic Aspects of Cloud Computing - Volume 951110.1007/978-3-319-29919-8_3(35-48)Online publication date: 14-Sep-2015
    https://dl.acm.org/doi/10.1007/978-3-319-29919-8_3
  • Song YSun YShi W(2013)A Two-Tiered On-Demand Resource Allocation Mechanism for VM-Based Data CentersIEEE Transactions on Services Computing10.1109/TSC.2011.416:1(116-129)Online publication date: Sep-2014
    https://doi.org/10.1109/TSC.2011.41
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media

Download PDF
View Table of Contents