Open Access Open Access  Restricted Access Subscription or Fee Access

A MIMO Approach to Supervisory Control in Robot Visual Feedback

(*) Corresponding author

Authors' affiliations



A two camera system providing sensory information between a robot and the environment enabling visual guidance and feedback can be modelled as a Multiple Input Multiple Output (MIMO) system with interaction. Condition Number of the matrix describing the system or Relative Gain Array can be used to measure the loop interaction in a MIMO system This paper presents a supervisory control in visual servoing, integrating the cooperation of two similar sensors motivated by the fact that no single strategy delivers solutions to the problems associated with visual servoing especially for large and complex workspaces. The movement of a manipulator is a challenge in physically limited or hazardous workspaces. Hybrid algorithms are more suitable in such cases rather than relying on any single scheme. The interaction of a stationary master camera with an eye in hand camera expands the scope of visual feedback. Simulation and experimentation suggest the validity of the proposed control strategy especially for manipulator poses from where the target is not visible and neural networks are used to improve the performance.
Copyright © 2017 Praise Worthy Prize - All rights reserved.


Condition Number; Machine Vision; MIMO; Robot Motion; Supervisory Control; Visual Servoing

Full Text:



R.A. Brooks, A Robust Layered Control-System for a Mobile Robot, IEEE J. Robot. Autom. 2 (1986) 14–23.

J. Kosecka, L. Bogoni, Application of discrete events systems for modeling and controlling robotic agents, in: IEEE Comput. Soc. Press, 1994: pp. 2557–2562.

J. T. Feddema, R. D. Robinett and B. J. Driessen, "Designing stable finite state machine behaviours using phase plane analysis and variable structure control," Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146), Leuven, 1998, pp. 1134-1141 vol.2.

X. Wang, P. Lee, A. Ray, S. Phoha, Discrete Event Supervisory Control of a Mobile Robotic System, in: A. Ray, V.V. Phoha, S.P. Phoha (Eds.), Quantitative Measure for Discrete Event Supervisory Control, Springer New York, New York, NY, 2005: pp. 133–156.

Dale E Seborg, D. a Mellichamp, T.F. Edgar, F.J. Doyle, Process Dynamics and Control, Process Dyn. Control. (2010) 2010. ISBN-10: 0470128674.

A. Shahmansoorian, The Relationship between the Condition Number, RGA and Interaction in Multivariable Systems, Applied and Computational Mathematics ACM. 3 (2014) 121.

S. A. Hutchinson, G.D.G.D. Hager, P.I. Corke, Hutchinson, Seth, A tutorial on visual servo control, IEEE Trans. Robot. Autom. 12 (1996) 651–670.

F. Chaumette, Potential problems of stability and convergence in image-based and position-based visual servoing, Conflu. Vis. Control. 237 (1998) 66–78.

F. Chaumette, E. Malis, 2 1/2 D visual servoing: a possible solution to improve image-basednand position-based visual servoings, Proc. 2000 ICRA. Millenn. Conf. IEEE Int. Conf. Robot. Autom. Symp. Proc. (Cat. No.00CH37065). 1 (2000) 630–635.

P.I. Corke, S.A. Hutchinson, A new partitioned approach to image-based visual servo control, IEEE Trans. Robot. Autom. 17 (2001) 507–515.

K. Deguchi, Optimal motion control for image-based visual servoing by decoupling translation and rotation, in: Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., 1998: pp. 705–711.

C. Gao, X. Piao, W. Tong, Optimal motion control for IBVS of robot, in: Proc. World Congr. Intell. Control Autom., 2012: pp. 4608–4611.

C.J. Taylor, J.P. Ostrowski, Robust Vision-based Pose Control, IEEE Int. Conf. Robot. Autom. 3 (2000) 2734–2740.

Y. Mezouar, F. Chaumette, Path Planning in Image Space for Robust Visual Servoing, in: IEEE Int. Conf. Robot. Autom., 2000: pp. 2759–2764.

V. Kyrki, D. Kragic, H.I. Christensen, New shortest-path approaches to visual servoing, in: 2004 IEEE/RSJ Int. Conf. Intell. Robot. Syst. (IEEE Cat. No.04CH37566), 2004: pp. 349–354.

N.J. Cowan, J.D. Weingarten, D.E. Koditschek, Visual servoing via navigation functions, IEEE Trans. Robot. Autom. 18 (2002) 521–533.

A. Assa and F. Janabi-Sharifi, "Hybrid predictive control for constrained visual servoing," 2014 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, Besacon, 2014, pp. 931-936.

N.R. Gans, S.A. Hutchinson, Stable visual servoing through hybrid switched-system control, IEEE Trans. Robot. 23 (2007) 530–540.

L. Deng, F. Janabi-Sharifi, W.J. Wilson, Hybrid Motion Control and Planning Strategies for Visual Servoing, Ind. Electron. IEEE Trans. 52 (2005) 1024–1040.

G. Chesi, A. Vicino, Visual servoing for large camera displacements, IEEE Trans. Robot. Autom. 20 (2004) 724–735.

B.J. Nelson, P.K. Khosla, Strategies for Increasing the Tracking Region of an Eye-in-Hand System by Singularity and Joint Limit Avoidance, The International Journal of Robotics Research. 14 (1995) 255–269.

G. Flandin, F. Chaumette and E. Marchand, "Eye-in-hand/eye-to-hand cooperation for visual servoing," Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065), San Francisco, CA, 2000, pp. 2741-2746 vol.3.

Guoliang Zhang, Bin Wang, Jie Wang and H. Liu, "A hybrid visual servoing control of 4 DOFs space robot," 2009 International Conference on Mechatronics and Automation, Changchun, 2009, pp. 3287-3292.

A. T. Vijayan and S. Ashok, "A stable switched visual servoing with supervisory control," 2015 International Conference on Industrial Instrumentation and Control (ICIC), Pune, 2015, pp. 223-227.

Sunami, Yusuke; Minami, Mamoru; Yanou, Akira, Experimental evaluations of prediction servoing to moving object by hand-eye robotic system, in SICE Annual Conference (SICE), 2013 Proceedings of , vol., no., pp.1310-1315, 14-17 Sept. 2013

C.-H. Tsai, C.-H. Wu, Y.-D. Huang, Vision-Based Coordinate Transformation with Back Propagation Neural Networks on Mobile Robots, in: 2012 Sixth Int. Conf. Genet. Evol. Comput., 2012: pp. 492–495.

D. Ramachandram, M. Rajeswari, Neural network-based robot visual positioning for intelligent assembly, J. Intell. Manuf. 15 (2004) 219–231.

H.-B. Wang, M. Liu, Design of robotic visual servo control based on neural network and genetic algorithm, Int. J. Autom. Comput. 9 (2012) 24–29.

ABB IRB 1200 Product Manual c1257ceb0072 2d6e/IRB1200_ROB0275EN.pdf.


  • There are currently no refbacks.

Please send any question about this web site to
Copyright © 2005-2023 Praise Worthy Prize