Built-in Stigmergy-Based Load Balancing Model for HPC Clusters


(*) Corresponding author


Authors' affiliations


DOI's assignment:
the author of the article can submit here a request for assignment of a DOI number to this resource!
Cost of the service: euros 10,00 (for a DOI)

Abstract


HPC load balancing aims to manage and share multiple computational resources in order to increase system performance. Several researches have been conducted on the issue of HPC load balancing. Their common point is that they consider processes (workload) as passive units to be balanced among cluster nodes (computational resources) to ensure optimal load balancing. The hypothesis behind our work assumes that the unit to be balanced, i.e. a process (computational task), is more likely to know its needs, and thus more likely to decide whether to migrate to another node or not. Therefore, the load balancing issue is studied at the parallel programming phase. Generated processes, after being recompiled using our LB integrator tool, will be systematically granted a built-in intelligence. The latter enables them to monitor their environment and migrate from one node to another in case of overloading. For this end, we have designed a built-in load balancing model based on stigmergy and collective intelligence concepts (BSLB). A novel P2P cluster computing system has been designed using Repast toolkit and the BSLB algorithm, allowing arbitrary users to initiate intelligent processes.
Copyright © 2014 Praise Worthy Prize - All rights reserved.

Keywords


Dynamic Load Balancing; Stigmergy; HPC Cluster; Collective Intelligence; Multi-Agent Systems; Parallel Programming

Full Text:

PDF


References


Ahmed ADNANE and Hicham MEDROMI. Architecture Dynamique Distribuée de Calcul Haute Performance. Proceedings of Journées Doctorales des Technologies d’Information et de Communication (JDTIC- 2012).

Ahmed ADNANE and Hicham MEDROMI. Adaptive HPC Cluster Load Balancing Approaches and Implementations. Proceedings of International Conference on Intelligent Information and Network Technology (IC2INT-2013).

Ahmed ADNANE and Hicham MEDROMI. Equilibrage de Charge et Intelligence Collective au sein d'un Cluster de Calcul. Proceedings of First Workshop on Data mining and Optimization, (FDO-2012, 109-118).

Abhijit A. Rajguru, S.S. Apte. A Comparative Performance Analysis of Load Balancing Algorithms in Distributed System using Qualitative Parameters. International Journal of Recent Technology and Engineering (IJRTE) ISSN, 2277-3878, Volume-1, Issue-3, August 2012.

Md. Firoj Ali, Rafiqul Zaman Khan. The Study on Load Balancing Strategies in Distributed Computing System. International Journal of Computer Science & Engineering Survey (IJCSES) Vol.3, No.2, April 2012.

Neeraj Kumar. Load Balancing in Heterogeneous Networks: a Mobile Agent Approach. Shri Mata Vaishno Devi University, Katra 182320. February 2009.

Ratan Mishra and Anant Jaiswal. Ant colony Optimization: A Solution of Load balancing in Cloud. International Journal of Web & Semantic Technology (IJWesT) Vol.3, No.2, April 2012.

Mohammed A. Alsaih, Rohaya Latip, Azizol Abdullah, Shamala K. Subramaniam. A Taxonomy of Load Balancing Techniques in Cloud Computing. International Review on Computers and Software (IRECOS), Vol. 8. n. 1, pp. 64-76, 2013.

Sandeep Sharma, Sarabjit Singh, and Meenakshi Sharma. Performance Analysis of Load Balancing Algorithms. World Academy of Science, Engineering and Technology 38 2008.

FERRARI D., ZHOU S. An Empirical Investigation of Load Indices for Load Balancing Applications. Technical Report UCB/CSD-87-353, EECS Department, University of California, Berkeley, 1987.

Werstein, Hailing Situ, Zhiyi Huang. Load Balancing in a Cluster Computer. Seventh International Conference on Parallel and Distributed Computing, Applications and Technologies, 2006. PDCAT'06.

Waraich, Khalsa Coll., Amritsar. Classification of Dynamic Load Balancing Strategies in a Network of Workstations. Fifth International Conference on Information Technology. New Generations, 2008. ITNG 2008.

K. Qureshi, B. Majeed, J. H. Kazmi, and S. A. Madani. Task Partitioning, Scheduling and Load Balancing Strategy for Mixed Nature of Tasks. The Journal of Supercomputing, vol. 19, no. 8, pp. 2228–41, 2011.

Adeela Bashiry, Sajjad A. Madaniy, Jawad Haider Kazmiy, Kalim Qureshix. Task Partitioning and Load Balancing Strategy for Matrix Applications on Distributed System. Journal of Computers, Vol. 8, No. 3, March 2013.

Archer C.J., Mullins T.J, Sidelnik A. and Smith B.E. Parallel Computing System Using Coordinator and Master Nodes for Load Balancing and Distributing Work. United State Patent, 2010.

Scott Pakin. Receiver-initiated Message Passing over RDMA Networks. IEEE International Symposium on Parallel and Distributed Processing, 2008. IPDPS 2008.

S. Dandamudi and H. Hadavi. Performance Impact of I/O on Sender-Initiated and Receiver-Initiated Load Sharing Policies in Distributed Systems. School of Computer Science, Carleton University, Technical Report TR-96-23, 1996.

S. Dandamudi and M. Lo. Hierarchical Load Sharing Policies for Distributed Systems. Centre for Parallel and Distributed Computing, School of Computer Science, Carleton University, Technical Report SCS-96-1, January 1996.

T.L. Casavant, and J.G. Kuhl. Effects of Response and Stability on Scheduling in Distributed Computing Systems. IEEE Transactions on Software Engineering, 14(11), pp. 1578- 588, November 1988.

Mohammed Javeed Zaki, Wei Li and Srinivasan Parthasarathy. Customized Dynamic Load Balancing for a Network of Workstations. Proceedings of 5th IEEE International Symposium on High Performance Distributed Computing 1996.

Ossama Othman, Carlos O'Ryan, Douglas C. Schmidt. Designing an Adaptive CORBA Load Balancing Service Using TAO. IEEE Distributed Systems Online 2(4) 2001.

Mercy Gnana Rani. Artificial Fish Swarm Load Balancing and Job Migration Task with Overloading Detection in Cloud Computing Environments. International Review on Computers and Software (IRECOS), Vol 9, No 4 (2014).

A. Montresor, H. Meling, and O. Babaoglu, Messor: Load-Balancing Through a Swarm of Autonomous Agents, Tech. report, Dept. of Computer Science, University of Bologna, 2002.

M. Resnick, Turtles, Termites, and Traffic Jams: Explorations in Massively Parallel Microworlds, MIT Press, Cambridge, MA, USA, 1994.

Théraulaz, G. and Bonabeau, E. Auto-Organisation et Comportement, chapter Auto-Organisation et comportement collectifs : la modélisation des sociétés d’insectes, pages 91–140. Hermes, guy théraulaz and françois spitz edition (1997).

P.P. Grassé, La Reconstruction du Nid et les Coordinations Interindividuelles chez Bellicositermes Natalensis et Cubitermes. La théorie de la stigmergie: essai d’interprétation du comportement des termites constructeurs, Insectes Sociaux (1959) 41–81.

North MJ, Collier NT, Vos RJ: Experiences Creating Three Implementations of the Repast Agent Modeling Toolkit. 16(1) edition. ACM, New York; 2006:1-25. [ACM Transactions on Modeling and Computer Simulation]

North MJ, Howe TR, Collier NT, Vos RJ: The Repast Simphony Runtime System. In Proceedings of the agent 2005 conference on generative social processes, models, and mechanisms. Edited by Macal C, North M, Sallach D. Argonne National Laboratory, Argonne, IL; 2005:151-158.


Refbacks

  • There are currently no refbacks.



Please send any question about this web site to info@praiseworthyprize.com
Copyright © 2005-2022 Praise Worthy Prize