Open Access Open Access  Restricted Access Subscription or Fee Access

Design of a Gesture Controlled Mobile Robotic Arm

(*) Corresponding author

Authors' affiliations



This paper presents a new and an effective sensing and actuating approach to control a mobile robotic arm using gestures and body postures. This makes human-machine interaction and sensing more receptive and intuitive for the user. Programming robots to perform human-like tasks can be hard and time consuming. However, controlling a robot by gestures and body postures is a simple method that offers a simpler and direct approach to perform these human-like tasks. Therefore, the overall goal of this paper is to design and implement a mobile robotic arm that is commanded by human gestures, which are captured by a skeletal motion sensing device and processed through a digital controller to manage the movement of the mobile robotic arm. A complete system with integrated hardware and software subsystems were designed, constructed, and tested.
Copyright © 2018 Praise Worthy Prize - All rights reserved.


Mobile Robotic Arm; Human Gestures; Digital Controller; Skeletal Motion Sensor

Full Text:



S. Shirwalkar, A. Singh, K. Sharma, N. Singh, Telemanipulation of an industrial robotic arm using gesture recognition with Kinect, Control, Automation, Robotics and Embedded Systems (CARE), 2013 International Conference on, Year: 2013, Pages: 1 – 6.

I. Bogoslavskyi, O. Vysotska, J. Serafin, G. Grisetti, C. Stachniss, Efficient traversability analysis for mobile robots using the Kinect sensor, Mobile Robots (ECMR), 2013 European Conference on Year: 2013 Pages: 158 – 163.

B. Min, E. Matson, A. Smith, J. Dietz, Using directional antennas as sensors to assist fire-fighting robots in large scale fires, 2014 IEEE Sensors Applications Symposium (SAS), 2014, Pages: 360 – 365.

C. Lai, K. Su, Development of an intelligent mobile robot localization system using Kinect RGB-D mapping and neural network, Computers & Electrical Engineering, In Press, Corrected Proof, Available online 5 May 2016.

D. Gorinevsky, S. Boyd, G. Stein, Optimization-based tuning of low-bandwidth control in spatially distributed systems, American Control Conference, Vol. 3, pp. 2658–2663, Denver, CO, June 2003.

J. Okazaki, A. Hoshina, M. Sugaya, Rehabilitation Robot for Elderly with Estimation of Stride, Procedia Computer Science, Volume 112, 2017, Pages 2004-2013.

C. Su, C. Chiang, J. Huang, Kinect-enabled home-based rehabilitation system using Dynamic Time Warping and fuzzy logic, Applied Soft Computing, Volume 22, September 2014, Pages 652-666.

V. Bonnet, C. Azevedo Coste, L. Lapierre, J. Cadic, P. Fraisse, R. Zapata, C. Geny, Venture Towards an affordable mobile analysis platform for pathological walking assessment, Robotics and Autonomous Systems, Volume 66, April 2015, Pages 116-128.

J. González, J. Pulido, F. Fernández, A three-layer planning architecture for the autonomous control of rehabilitation therapies based on social robots, Cognitive Systems Research, Volume 43, June 2017, Pages 232-249.

M. Al-Faiz, A. Shanta, Kinect-Based Humanoid Robotic Manipulator for Human Upper Limbs Movements Tracking. Intelligent Control and Automation, 6, 29-37.

M. Hussein, A. Ali, F. Elmisery, R. Mostafa, Research Motion Control of Robot by using Kinect Sensor, Research Journal of Applied Sciences, Engineering and Technology 8(11): 1384-1388, 2014, 8(11): 1384-1388, 2014 ISSN: 2040-7459.

M. Fareed, Q. Akram, S. Anees; A. Fakih, Gesture Based Wireless Single-Armed Robot in Cartesian 3D Space Using Kinect Communication Systems and Network Technologies (CSNT), 2015 Fifth International Conference on Year: 2015 Pages: 1210 – 1215.

G. Du, P. Zhang, Markerless human–robot interface for dual robot manipulators using Kinect sensor, Robotics and Computer-Integrated Manufacturing, Volume 30, Issue 2, April 2014, Pages 150-159.

K. Khoshelham, S. Elberink, Accuracy and resolution of kinect depth data for indoor mapping applications. Sensors 2012, 12, 1437–1454.

G. Vasiljevic, N. Jagodin, Z. Kovacic, Kinect-based Robot Teleoperation by Velocities Control in the Joint/Cartesian Frames, IFAC Proceedings Volumes, Volume 45, Issue 22, 2012, Pages 805-810.

Krechetov, I., Skvortsov, A., Lavrikov, P., Korotkovs, V., Development of Dual-Arm Assistant Robot: Motion Trajectory Planning for the Manipulator Arm, (2017) International Review of Mechanical Engineering (IREME), 11 (9), pp. 683-691.

Salazar, G., Ramos, O., Amaya, D., Control Algorithm for an Industrial Robotic Arm Using Computer Vision, (2015) International Review of Mechanical Engineering (IREME), 9 (2), pp. 182-189.

Cáceres, C., Rosário, J., Amaya, D., Approach to Assistive Robotics Based on an EEG Sensor and a 6-DoF Robotic Arm, (2016) International Review of Mechanical Engineering (IREME), 10 (4), pp. 253-260.


  • There are currently no refbacks.

Please send any question about this web site to
Copyright © 2005-2023 Praise Worthy Prize