New paradigms for processing and storing data such as cloud computing require new approaches for the measurement of cloud service performance. To establish a Service Level Agreement (SLA) between a cloud service provider and its customers, the cloud services and their service level objectives need to be identified. An additional challenge in the performance measurement of cloud services is the lack of models that integrate the different perspectives of providers, maintainers and customers within the same model in order to define the concepts commonly used in cloud SLA contracts. This work proposes a three-dimensional Performance Measurement Model for Cloud Computing (P2M2C-3D) which consolidates performance measurement from the perspectives of providers, maintainers and customers for the different types of cloud services.
References
[1]
ISO/IEC. (2008) ISO/IEC 15939: 2007 Systems and Software Engineering—Measurement Process. International Organization for Standardization, Geneva.
[2]
ISO/IEC. (1999) ISO/IEC 14756: Measurement and Rating of Performance of Computer-Based Software Systems. International Organization for Standardization, Geneva.
[3]
ISO/IEC. (2014) ISO/IEC 17788: Information Technology—Cloud Computing—Overview and vocabulary. International Organization for Standarization, Geneva, p. 10.
[4]
ISO/IEC. (2014) ISO/IEC 17789: Information Technology—Cloud Computing—Reference Architecture. International Organization for Standarization, Geneva, p. 53.
[5]
ISO/IEC. (2015) ISO/IEC Editor’s Draft Revised CD 19086-1: Cloud Computing—Service Level Agreement (SLA) framework—Part 1: Overview and Concepts. American National Standards Institute, New York, p. 43.
[6]
Bautista, L., Abran, A. and April, A. (2012) Design of a Performance Measurement Framework for Cloud Computing. Journal of Software Engineering and Applications, 5, 69-75.
[7]
Buglione, L. and Abran, A. (2002) QEST nD: n-Dimensional Extension and Generalization of a Software Performance Measurement Model. Advances in Engineering Software, 33, 1-7. https://doi.org/10.1016/S0965-9978(01)00050-3
[8]
Iosup, A., Ostermann, S., Yigitbasi, N., Prodan, R., Fahringer, T. and Epema, D. (2011) Performance Analysis of Cloud Computing Services for Many-Tasks Scientific Computing. IEEE Transactions on Parallel and Distributed Systems, 22, 931-945. https://doi.org/10.1109/TPDS.2011.66
[9]
Jackson, K.R., Ramakrishnan, L., Muriki, K., Canon, S., Cholia, S., Shalf, J., et al. (2010) Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud. IEEE Second International Conference on Cloud Computing Technology and Science (CloudCom), Indianapolis, IN, 30 November-3 December 2010, 159-168. https://ieeexplore.ieee.org/document/5708447/
[10]
Kaiqi, X. and Perros, H. (2009) Service Performance and Analysis in Cloud Computing. World Conference on Services, Los Angeles, CA, 6-10 July 2009, 693-700.
[11]
Jesús Montes, A.S., Memishi, B., Pérez, M.S. and Antoniu, G. (2013) GMonE: A Complete Approach to Cloud Monitoring. Future Generation Computer Systems, 29, 14.
[12]
Jain, R. (1991) The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling. John Wiley & Sons Interscience, New York, NY.
[13]
ISO/IEC. (2011) ISO/IEC 25010: Systems and Software Engineering—Systems and Software Product Quality Requirements and Evaluation (SQuaRE)—System and Software Quality Models. International Organization for Standardization, Geneva, p. 43.
[14]
Buglione, L. and Abran, A. (1999) Multidimensional Software Performance Measurement Models: A Tetrahedron-Based Design. In: Software Measurement, Springer, 93-107. https://doi.org/10.1007/978-3-663-08949-0_6
