Data Center Power And Performance Optimization Through Global Selection Of P-states And Utilization Rates

The vast majority of Internet services available today rely on the computing capabilities of data centers. The load in a data center varies according to the time of day, week and year, thus it is important to be able to optimize the use of computing resources dynamically and continuously. This paper presents a framework for modeling and simulating the power and performance behavior of data centers, as well as optimization algorithms capable of power and performance trade-offs, considering all cores in a data center simultaneously. The contributions of this paper are threefold. First, it presents a novel concept of Virtual Power States (VPSs) which are combinations of processors power states and utilization rates, which are used for continuous optimization of power and performance. Second, it presents two algorithms (one optimal and one heuristic) for selecting the power states in each core in a data center in order to optimize the overall power and performance. Third, it presents a power and performance simulation model for data centers, and it shows that for a given varying workload, the algorithms can be applied at regular time intervals, change the power states of the CPU cores to adapt to varying workload and power policies, keeping the data center running at near optimal points continuously. Examples using Intel i7-based and AMD Opteron-based web servers are presented. © 2012 Elsevier Inc.24198208Koomey, J., (2007) Estimating Total Power Consumption by Servers in the U.S. and the World, , http://files.me.com/jgkoomey/98ygy0, Analytics PressBianchini, R., Rajamony, R., Power and energy management for server systems (2004) IEEE Computer, 37 (11), pp. 68-74. , 10.1109/MC.2004217Filani, D., He, J., Gao, S., Rajappa, M., Kumar, A., Shah, P., Nagappan, R., Dynamic data center power management: Trends, issues, and solutions (2008) Intel Technology Journal, 12Bohrer, P., Elnozahy, E.N., Keller, T., Kistler, M., Lefurgy, C., MacDowel, C., Rajamony, R., The case for power management in web servers (2002) Power-Aware Computing, , R. Graybill, R. Melhem, Kluwer Series in Computer ScienceIsci, C., Buyuktosunoglu, A., Cher, C., Bose, P., Martonosi, M., An analysis of efficient multi-core global power management policies: Maximizing performance for a given power budget (2006) Proceedings of the 39th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO-39 2006), pp. 347-358. , 10.1109/MICRO.2006.8Naveh, A., Rotem, E., Mendelson, A., Gochman, S., Chabukswar, R., Krishnan, K., Kumar, A., Power and thermal management in the Intel Core Duo processor (2006) Intel Technology Journal, 10Balancing Performance and Power Consumption, , http://download.intel.com/embedded/322286.pdf, Intel Technology BriefACPI Specification, , http://www.acpi.info/spec.htmChase, J., Anderson, D.C., Thakar, P.N., Vahdat, A., Doyle, R.P., Managing energy and server resources in hosting centers (2001) Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP 2001), pp. 103-116. , 10.1145/502034.502045Kusic, D., Kephart, J.O., Hanson, J.E., Kandasamy, N., Jiang, G., Power and performance management of virtualized computing environments via lookahead control (2009) Cluster Computing, 12 (1), pp. 1-15. , 10.1007/s10586-008-0070-yElnozahy, E.N., Kistler, M., Rajamony, R., Energy conservation policies for web servers (2003) Proceedings of the 4th Conference on USENIX Symposium on Internet Technologies and Systems (USITS'03), 4Elnozahy, E.N., Kistler, M., Rajamony, R., Energy-efficient server clusters (2003) Lecture Notes in Computer Science, pp. 179-197. , 10.1007/3-540-36612-1-12 23252003Rajamani, K., Lefurgy, C., On evaluating request-distribution schemes for saving energy in server clusters (2003) Proceedings of the 2003 IEEE International Symposium on Performance Analysis of Systems and Software, pp. 111-122. , 10.1109/ISPASS.2003.1190238Chen, Y., Das, A., Qin, W., Sivasubramaniam, A., Wang, Q., Gautam, N., Managing server energy and operational costs in hosting centers (2005) ACM SIGMETRICS Performance Evaluation Review, 33 (1), pp. 303-314. , 10.1145/1071690.1064253Bertini, L., Leite, J.C.B., Mossé, D., Power optimization for dynamic configuration in heterogeneous web server clusters (2010) Journal of Systems and Software, 83 (4), pp. 585-598. , 10.1016/j.jss.2009.10.040Bertini, L., Leite, J.C.B., Mossé, D., Power and performance control of soft real-time web server clusters (2010) Information Processing Letters, 110 (17), pp. 767-773. , 10.1016/j.ipl.2010.06.013Cardellini, V., Colajanni, M., Yu, P.S., Dynamic load balancing on web-server systems (1999) IEEE Internet Computing, 3 (3), pp. 28-39. , 10.1109/4236.769420Intel® Core™ i7-800 and i5-700 Desktop Processor SeriesDatasheet, , http://download.intel.com/design/processor/datashts/322164.pdfPiga, L., Bergamaschi, R.A., Azevedo, R., Rigo, S., Power Measuring Infrastructure for Computing Systems, March 2011. Technical Report (IC-11-09), , Institute of Computing, University of Campinas, BrazilPiga, L., Bergamaschi, R.A., Klein, F., Azevedo, R., Rigo, S., Empirical Web server power modeling and characterization (2011) Proceedings of the 2011 IEEE International Symposium on Workload Characterization, p. 75. , 10.1109/IISWC.2011.6114200SpecInt Benchmarks, , http://www.spec.org/cpu2000/SpecWeb Benchmarks., , http://www.spec.org/web2009/Preparata, F.P., Shamos, M.I., (1985) Computational Geometry - An Introduction, , Springer 3-540-96131-3LP-SOLVE, , http://lpsolve.sourceforge.net/SystemC, , http://www.accellera.org/downloads/standards/systemc/about_systemc/AMD Opteron Processor Power and Thermal Data Shee