Open Access Open Access  Restricted Access Subscription or Fee Access

A Fuzzy Path Planning System Based on a Collaborative Reinforcement Learning


(*) Corresponding author


Authors' affiliations


DOI: https://doi.org/10.15866/ireaco.v10i2.10623

Abstract


In this paper, we present a novel collaborative Q-Learning based path planning system using Holonic Multi Agent System architecture, and the Fuzzy Inference System, to be used in autonomous mobile robots, represented as head-holons, in order to find the optimal path among any starting point, and a goal in a to 2D grid environment. The decision of the navigation is provided by a fuzzy system controller and then it is verified by a sensor validator.
Copyright © 2017 Praise Worthy Prize - All rights reserved.

Keywords


Multi-Agent Systems; Reinforcement Learning; Autonomous Robots; Q-Learning; Path Planning; Fuzzy System

Full Text:

PDF


References


T. Lozano-Pérez and M. a. Wesley, An algorithm for planning collision-free paths among polyhedral obstacles, Commun. ACM, vol. 22, no. 10, pp. 560–570, 1979.
http://dx.doi.org/10.1145/359156.359164

B. Bridge, A. Ramirez-Serrano, H. Liu, and G. C. Pettinaro, Mobile robot localization in quasi-dynamic environments, Industrial Robot: An International Journal, vol. 35, no. 3, pp. 246–258, 2008.
http://dx.doi.org/10.1108/01439910810868570

A. Ghorbani, S. Shiry, and A. Nodehi, Using genetic algorithm for a mobile robot path planning, in Future Computer and Communication, 2009. ICFCC 2009. International Conference on. IEEE, 2009, pp.164–166.
http://dx.doi.org/10.1109/icfcc.2009.28

K. H. Sedighi, K. Ashenayi, T. W. Manikas, R. L. Wainwright, and H.-M. Tai, Autonomous local path planning for a mobile robot using a genetic algorithm, in Evolutionary Computation, 2004. CEC2004. Congress on, vol. 2. IEEE, 2004, pp. 1338–1345.
http://dx.doi.org/10.1109/cec.2004.1331052

J.-H. Liang and C.-H. Lee, Efficient collision-free path-planning of multiple mobile robots system using efficient artificial bee colony algorithm, Advances in Engineering Software, vol. 79, pp. 47–56, 2015
http://dx.doi.org/10.1016/j.advengsoft.2014.09.006

X. Bajrami, A. Dërmaku, and N. Demaku, Artificial neural fuzzy logic algorithm for robot path finding, IFAC PapersOnLine, vol. 48, no. 24, pp. 123–127, 2015.
http://dx.doi.org/10.1016/j.ifacol.2015.12.068

P. Bhattacharjee, P. Rakshit, I. Goswami, A. Konar, and A. K. Nagar, Multi-robot path-planning using artificial bee colony optimization algorithm, in Nature and Biologically Inspired Computing (NaBIC), 2011 Third World Congress on. IEEE, 2011, pp. 219–224.
http://dx.doi.org/10.1109/nabic.2011.6089601

Y. Ma, H. Wang, Y. Xie, and M. Guo, Path planning for multiple mobile robots under double-warehouse, Inf. Sci. (Ny)., vol. 278, pp. 357–379, 2014.
http://dx.doi.org/10.1016/j.ins.2014.03.058

G. Nirmala, S. Geetha, and S. Selvakumar, Intellectual method of guiding mobile robot navigation using reinforcement learning algorithm, in Engineering and Technology (ICETECH), 2015 IEEE International Conference on. IEEE, 2015, pp. 1–4.
http://dx.doi.org/10.1109/icetech.2015.7275038

Y. Li, C. Li, and Z. Zhang, Q-learning based method of adaptive path planning for mobile robot, in 2006 IEEE International Conference on Information Acquisition. IEEE, 2006, pp. 983–987.
http://dx.doi.org/10.1109/icia.2006.305871

C. J. Watkins and P. Dayan, Q-learning, Machine learning, vol. 8, no. 3-4, pp. 279–292, 1992
http://dx.doi.org/10.1023/a:1022676722315

S. T. Brassai, B. Iantovics, and C. Enachescu, Artificial intelligence in ˘the path planning optimization of mobile agent navigation, Procedia Economics and Finance, vol. 3, no.12, pp. 243–250, 2012.
http://dx.doi.org/10.1016/s2212-5671(12)00147-5

C. G. Cena, P. F. Cardenas, R. S. Pazmino, L. Puglisi, and R. A. Santonja, A cooperative multi-agent robotics system:Design and modelling, Expert Syst. Appl., vol. 40, no. 12, pp. 4737–4748, 2013.
http://dx.doi.org/10.1016/j.eswa.2013.01.048

C. Gerber, J. Siekmann, and G. Vierke, Holonic multi-agent systems, In: AAAI Spring Symposium on Agents with Adjustable Autonomy (1999), vol. 49, no. 681, 1999.
http://dx.doi.org/10.1007/978-3-540-45185-3_8

L. A. Zadeh, Fuzzy Logic and Approximate Reasoning, D. Reidel Publ. Co., vol. 30, no. 3-4, pp. 407–428, 1975.
http://dx.doi.org/10.1007/bf00485052

M. Sugeno, An introductory survey of fuzzy control, Information sciences, vol. 36, no. 1–2, pp. 59–83, 1985.
http://dx.doi.org/10.1016/0020-0255(85)90026-x

E. H. Mamdani and S. Assilian, An experiment in linguistic synthesis with a fuzzy logic controller, International journal of man-machine studies, vol. 7, no. 1, pp. 1–13, 1975.
http://dx.doi.org/10.1016/s0020-7373(75)80002-2

L. A. Zadeh, Outline of a new approach to the analysis of complex systems and decision processes, IEEE Transactions on systems, Man, and Cybernetics, no. 1, pp. 28–44, 1973.
http://dx.doi.org/10.1109/tsmc.1973.5408575

M. P. Garcia, O. Montiel, O. Castillo, R. Sepúlveda, and P. Melin, Path planning for autonomous mobile robot navigation with ant colony optimization and fuzzy cost function evaluation, Applied Soft Computing, vol. 9, no. 3, pp. 1102–1110, 2009
http://dx.doi.org/10.1016/j.asoc.2009.02.014

H. Boubertakh, M. Tadjine, and P. Y. Glorennec, A new mobile robot navigation method using fuzzy logic and a modified Q-learning algorithm, J. Intell. Fuzzy Syst., vol. 21, no. 1–2, pp. 113–119, 2010.
http://dx.doi.org/10.1007/978-3-540-85563-7_84

P. Payeur, H. Le-Huy, and C. Gosselin, Robot path planning using neural networks and fuzzy logic, in Industrial Electronics, Control and Instrumentation, 1994. IECON’94., 20th International Conference on, vol. 2. IEEE, 1994, pp. 800–805.
http://dx.doi.org/10.1109/iecon.1994.397888

Hassanzadeh and S. M. Sadigh, Path planning for a mobile robot using fuzzy logic controller tuned by ga, in Mechatronics and its Applications, 2009. ISMA’09. 6th International Symposium on. IEEE, 2009, pp. 1–5.
http://dx.doi.org/10.1109/isma.2009.5164798

C. Lamini, Y. Fathi, and S. Benhlima, Collaborative q-learning path planning for autonomous robots based on holonic multi-agent system, in 2015 10th International Conference on Intelligent Systems: Theories and Applications (SITA). IEEE, 2015, pp. 1–6.
http://dx.doi.org/10.1109/sita.2015.7358432

Fathi, Y., Benhlima, S., Embedded Component-as-Agent Robotic Software Platform for Autonomous Robots, (2016) International Review on Computers and Software (IRECOS), 11 (2), pp. 102-108.
http://dx.doi.org/10.15866/irecos.v11i2.8320

A. Fipa, Fipa acl message structure specification, Foundation for Intelligent Physical Agents, http://www. fipa. org/specs/fipa00061/SC00061G. html (30.6. 2004), 2002.

H. Arndt, M. Bundschus, and A. Naegele, Towards a next-generation matrix library for java, in 2009 33rd Annual IEEE International Computer Software and Applications Conference, vol. 1. IEEE, 2009, pp. 460–467
http://dx.doi.org/10.1109/compsac.2009.67

P. Cingolani and J. Alcala-Fdez, jfuzzylogic: a robust and flexible fuzzy-logic inference system language implementation, in FUZZ-IEEE. Citeseer, 2012, pp. 1–8.
http://dx.doi.org/10.1109/fuzz-ieee.2012.6251215

Li, S., Xu, X., & Zuo, L. (2015, August). Dynamic path planning of a mobile robot with improved Q-learning algorithm. In Information and Automation, 2015 IEEE International Conference on (pp. 409-414). IEEE.
http://dx.doi.org/10.1109/icinfa.2015.7279322


Refbacks

  • There are currently no refbacks.


Please send any question about this web site to info@praiseworthyprize.com
Copyright © 2005-2024 Praise Worthy Prize