Open Access Open Access  Restricted Access Subscription or Fee Access

Efficient and Dynamic Resource Provisioning Strategy for Data Processing Using Cloud Computing


(*) Corresponding author


Authors' affiliations


DOI: https://doi.org/10.15866/irecos.v11i8.9681

Abstract


Cloud computing provides on-demand virtualized resources to its hosted applications and services. However, if the hosted applications are intended to majorly analyze the data, they are complex to handle because of uncertainty in the demand of resources and large volume of data. The life cycle of compute/scientific job requires some data processing analysis and computation in order to obtain the needed results. It entails appropriate controls of the service instance to generate informative (semantic) and useful data to be processed in a pool of distributed resources. To execute the service instance of the trained data, an adaptive cloud, able to manage the diverse computing resources using dynamic resource provisioning strategy, is needed. This paper proposes a framework for the processing of data on cloud using efficient resource to manage the demanded resources. The model of the proposed architecture for the adaptive cloud, detailed system architecture and the data processing mechanism are presented in this paper.
Copyright © 2016 Praise Worthy Prize - All rights reserved.

Keywords


Resource Provisioning; Conventional Cloud; Adaptive Cloud; Data Processing; Service Provisioning Dynamism in Resource Provisioning

Full Text:

PDF


References


C. Ji, Y. Li, W. Qiu, U. Awada, and K. Li, Big data processing in cloud computing environments, in Pervasive Systems, Algorithms and Networks (ISPAN), (2012) 12th International Symposium on. IEEE, pp. 17–23.
http://dx.doi.org/10.1109/i-span.2012.9

Changlong Li, Hang Zhuang, Kun Lu, Mingming Sun, JinhongZhou, Dong Dai, Xuehai Zhou, An Adaptive Auto-Configuration Tool for Hadoop, (2014) 19th International Conference on Engineering of Complex Computer Systems. IEEE, pp.69-72.
http://dx.doi.org/10.1109/iceccs.2014.17

Ficco, M, Security event coorelation approach for cloud computing, (2013) International Journal of High Performance Computing and Networking (IJHPCN) 7(3).
http://dx.doi.org/10.1504/ijhpcn.2013.056525

Kuan Ching Li,Hai Jiang, Laurence T. Yang, Alfredo Cuzzocrea, Big Data Algorithms, Analytics and Applications, (2014)Chapman & Hall/CRC Big Data Series, ISSN- 13:978-1-4822-4056-6,pp 1-425,2014.

Nian-feng Li, Li-rong Wang, Meng Zhang, Hua-xun Zhang, ’Hadoop based data processing method and its application on Braille identification’ , (2012) Fifth International Conference on Intelligent Networks and Intelligent Systems, IEEE, 2012, pp.329-332.
http://dx.doi.org/10.1109/icinis.2012.79

Z. Zheng, J. Zhu, and M. R. Lyu, Service-generated big data and big data-as-a-service: An overview, (2013) IEEE International Congress on Big Data, IEEE, pp. 403–410, 2013.
http://dx.doi.org/10.1109/bigdata.congress.2013.60

E. Dede, M. Govindaraju, D. Gunter, R. S. Canon, and L. Ramakrishnan, Performance evaluation of a MongoDB and Hadoop platform for scientific data analysis, (2013) 4th ACM Workshop on Scientific Cloud Computing (ScienceCloud ’13), pp. 13–20, ACM.
http://dx.doi.org/10.1145/2465848.2465849

Mohammad Mehedi Hassan, Biao Song, M. Shamim Hossain and Atif Alamri, QoS-aware Resource Provisioning for Big Data Processing in Cloud Computing Environment,(2014) International Conference on Computational Science and Computational Intelligence, IEEE, pp 107-112.
http://dx.doi.org/10.1109/csci.2014.103

Guigang Zhang, Chao Li, Yong Zhang, Chunxiao Xing, Jijiang Yang, An Efficient Massive Data Processing Model in the Cloud, (2013) Seventh China Grid Annual Conference, IEEE, 2013, pp 148-155.
http://dx.doi.org/10.1109/chinagrid.2012.21

Hongyong Yu, Deshuai Wang, Mass Log Data Processing and Mining Based on Hadoop and Cloud Computing, (2012)7th International Conference on Computer Science & Education (ICCSE 2012. Melbourne, Australia, IEEE, pp 197-202.
http://dx.doi.org/10.1109/iccse.2012.6295056

Yi Wei, M. Brian Blake and Iman Saleh, Adaptive Resource Management for Service Workflows in Cloud Environments, (2013) IEEE 27th International Symposium on Parallel & Distributed Processing Workshops and PhD Forum, IEEE, pp 2147-2156.
http://dx.doi.org/10.1109/ipdpsw.2013.151

W. Iqbal, N. Matthew, D. Carrera and P. Janecek, Adaptive resource provisioning for read intensive multi-tier applications in the cloud,(2011) Future Generation Computer Systems, Vol. 27, No. 6, Springer, pp. 871 – 894.
http://dx.doi.org/10.1016/j.future.2010.10.016

Ying Zhang, Gang Huang, Xuanzhe Liu, and Hong Mei, Integrating Resource Consumption and Allocation for Infrastructure Resources on-Demand, (2010) IEEE 3rd International Conference on Cloud Computing, IEEE, pp. 75-82.
http://dx.doi.org/10.1109/cloud.2010.11

Long Wang, Rubing Duan, Xiaorong Li, Sifei Lu,Terence Hung, Rodrigo N. Calheiros, Rajkumar Buyya, An Iterative Optimization Framework for Adaptive Workflow Management in Computational Clouds, (2013)11th IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA), Melbourne, Australia,
http://dx.doi.org/10.1109/trustcom.2013.128

Ashish Nagavaram, A cloud-based dynamic workflow for mass spectrometry data analysis, eScience, (2011) International Conference on Cloud Computing and Service Computing, IEEE, pp 219-226.
http://dx.doi.org/10.1109/escience.2011.15

Bo Liu, Yanshan Xiao, Philip S. Yu, Fellow, Longbing Cao, Senior Member, Yun Zhang, and Zhifeng Hao,Uncertain One-Class Learning and Concept Summarization Learning on Uncertain Data Streams,(2014) IEEE Transactions on knowledge and data engineering ,vol. 26, No. 2, pp 468-484.
http://dx.doi.org/10.1109/tkde.2012.235

B. Yekkehkhany, S. Homayouni, H. McNairn and A. Safari, Multi Temporal full polarimetry L-band SAR data classification for agriculture land cover mapping, (2014) IGARSS-2014, IEEE, pp 2770-2773.
http://dx.doi.org/10.1109/igarss.2014.6947050

Galip Aydin, Ibrahim Riza Hallac, and Betul Karakus, Architecture and Implementation of a Scalable Sensor Data Storage and Analysis System Using Cloud Computing and Big Data Technologies,(2015) Hindawi Publishing Corporation, Journal of Sensors.
http://dx.doi.org/10.1155/2015/834217

F. Liang, C. Feng, X. Lu, and Z. Xu, Performance benefits of DataMPI: a case study with Big Data Bench, in Big Data Bench- marks,Performance Optimization,and Emerging Hardware, vol. 8807 of Lecture Notes in Computer Science, pp. 111–123, (2014) Springer International Publishing, Cham, Switzerland.
http://dx.doi.org/10.1007/978-3-319-13021-7_9

O. Sefraoui, M. Aissaoui, and M. Eleuldj(2012), OpenStack: toward an open-source solution for cloud computing, (2012)International Journal of Computer Applications, vol. 55, no. 3, pp. 38–42.
http://dx.doi.org/10.5120/8738-2991

Alzabin, N., Mesleh, A., Hamed, S., Massadeh, S., AlHeyasat, O., AlQaisi, A., A QoS Based DSR Routing Protocol for MANETs Using Bandwidth, (2014) International Journal on Communications Antenna and Propagation (IRECAP), 4 (5), pp. 151-156.
http://dx.doi.org/10.15866/irecap.v4i5.3702

Yakine, F., Idrissi, A., Performance Comparison of ILP Models for QoS Topology Control to Conserve Energy in WANETs, (2015) International Journal on Communications Antenna and Propagation (IRECAP), 5 (6), pp. 328-336.
http://dx.doi.org/10.15866/irecap.v5i6.7653

Rammohan, N., Baburaj, E., Genetic Clustering with Workload Multi-task Scheduler in Cloud Environment, (2014) International Journal on Communications Antenna and Propagation (IRECAP), 4 (3), pp. 77-86.

Azougaghe, A., Kartit, Z., Hedabou, M., Belkasmi, M., Benmiloud, M., Marraki, M., An Efficient Electronic Voting System in a Cloud Computing Environment, (2015) International Review on Computers and Software (IRECOS), 10 (11), pp. 1103-1109.
http://dx.doi.org/10.15866/irecos.v10i11.7667

Fei Long, Yufeng Zhang, Lv Bin, A Method for Mining Association Rules Based on Cloud Computing, (2011) International Review on Computers and Software (IRECOS), 6 (6), pp. 1112-1116.

OpenNebula Web page, 2015, http://www.opennebula.org.

Eucalyptus,2015,https://www.eucalyptus.com/eucalyptus-cloud/ iaas.

OpenStack,2015,http://www.openstack.org.


Refbacks

  • There are currently no refbacks.



Please send any question about this web site to info@praiseworthyprize.com
Copyright © 2005-2024 Praise Worthy Prize