Open Access Open Access  Restricted Access Subscription or Fee Access

Automatic Detection of Movement Inception During Hand Gesture


(*) Corresponding author


Authors' affiliations


DOI: https://doi.org/10.15866/ireaco.v13i3.17705

Abstract


Hand movement recognition based on ElectroMyographic signals is a crucial subject frequently addressed using feature extraction and classifiers such as neuronal networks. However, there is no model to allow automatic movement inception using superficial ElectroMyographic signals; in the present paper is presented a solution to the above problem. To understand the beginning of movement permits the start of other systems for different applications such as activation of human-machine interface, wearable devices among others, this allows saving energy in terms of computation cost, because only at the right moment the system will activate. The mathematical model presented uses the principle of a) superficial EMG signal model, b) the entropy, and c) the flow entropy. The synergy between all the above elements enables the determination of the produced information rate to track significant variation and causing sharp peaks in the entropy flow. The occurrence of each positive peak in the entropy flow corresponds to a movement begging and the occurrence time of each negative peak corresponds to a movement termination. The model was validated through an experimental procedure using a wearable device, in this case, it is used the MyoArmBand as device for subjects to perform release and grasp gestures. As a result, it is found that the proposed model can automatically detect the beginning of the movements at approximately 245.9ms. This value of time change depends on the device used due to connection systems and the computing capacity. Moreover, the proposed procedure can be implemented using other wearable devices as smart watches, smart bands, smart t-shirts, or others instruments that measure the electrical activity.
Copyright © 2020 Praise Worthy Prize - All rights reserved.

Keywords


EMG; Movement Inception; Wearable Device; Hand Gestures

Full Text:

PDF


References


N. Anil and S. H. Sreeletha, EMG Based Gesture Recognition Using Machine Learning, Second International Conference on Intelligent Computing and Control Systems (ICICCS), pp. 1560-1564, Madurai, India, 2018.
https://doi.org/10.1109/iccons.2018.8662987

A. Junlasat, T. Kamolklang, P. Uthansakul and M. Uthansakul, Finger Movement Detection Based on Multiple EMG Positions, 11th International Conference on Information Technology and Electrical Engineering (ICITEE), 2019, pp. 1-4, Pattaya, Thailand.
https://doi.org/10.1109/iciteed.2019.8929980

A. Bhattacharya, A. Sarkar and P. Basak, Time domain multi-feature extraction and classification of human hand movements using surface EMG, 4th International Conference on Advanced Computing and Communication Systems (ICACCS), 2017, pp. 1-5, Coimbatore, India.
https://doi.org/10.1109/icaccs.2017.8014594

M. Karuna, C. Ganesh, R. P. Das and M. V. Kumar, "Classification of wrist movements through EMG signals with fuzzy logic algorithm, International Conference on Energy, Communication, Data Analytics and Soft Computing (ICECDS), 2017, pp. 2258-2261, Chennai, Tamil Nadu, India.
https://doi.org/10.1109/icecds.2017.8389854

A. Zhang, N. Gao, L. Wang and Q. Li, Combined Influence of Classifiers, Window Lengths and Number of Channels on EMG Pattern Recognition for Upper Limb Movement Classification, 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), 2018, pp. 1-5, Beijing, China.
https://doi.org/10.1109/cisp-bmei.2018.8633114

G. Luh, J. Cai and Y. Lee, Estimation of elbow motion intension under varing weight in lifting movement using an EMG-Angle neural network model, 2017 International Conference on Machine Learning and Cybernetics (ICMLC), 2017, pp. 640-645, Ningbo, China.
https://doi.org/10.1109/icmlc.2017.8108981

C. K. Bhattachargee, N. Sikder, M. T. Hasan and A. Nahid, Finger Movement Classification Based on Statistical and Frequency Features Extracted from Surface EMG Signals, 2019 International Conference on Computer, Communication, Chemical, Materials and Electronic Engineering (IC4ME2), 2019, pp. 1-4, Rajshahi, Bangladesh.
https://doi.org/10.1109/ic4me247184.2019.9036671

C. Seguna, A. von Brockdorff, J. Scerri and K. Scicluna, Development of a New Low-Cost EMG Monitoring System for the Classification of Finger Movement, 2018 New Generation of CAS (NGCAS), 2018, pp. 126-129, Valletta, Malta.
https://doi.org/10.1109/ngcas.2018.8572217

J. Zhang, C. Ling and S. Li, Human Movements Classification Using Multi-channel Surface EMG Signals and Deep Learning Technique, 2019 International Conference on Cyberworlds (CW), 2019, pp. 267-273, Kyoto, Japan.
https://doi.org/10.1109/cw.2019.00051

L. Shao, Facial Movements Recognition Using Multichannel EMG Signals, 2019 IEEE Fourth International Conference on Data Science in Cyberspace (DSC), 2019, pp. 561-566, Hangzhou, China.
https://doi.org/10.1109/dsc.2019.00091

L. Liao, Y. Tseng, H. Chiang and W. Wang, EMG-based Control Scheme with SVM Classifier for Assistive Robot Arm, 2018 International Automatic Control Conference (CACS), 2018, pp. 1-5, Taoyuan, Taiwan.
https://doi.org/10.1109/cacs.2018.8606762

A. S. Hassan et al., Properties of Motor Units of Elbow and Ankle Muscles Decomposed Using High-Density Surface EMG, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2019, pp. 3874-3878, Berlin, Germany.
https://doi.org/10.1109/embc.2019.8857475

V. P. Maurya, P. Kumar and S. Halder, Optimisation and Classification of EMG signal using PSO-ANN, 2019 Devices for Integrated Circuit (DevIC), 2019, pp. 191-195, Kalyani, India.
https://doi.org/10.1109/devic.2019.8783882

S. Das, D. Nandi Das and B. Neogi, Design Approach for Artificial Human Ankle Movement, 2019 Devices for Integrated Circuit (DevIC), 2019, pp. 404-407, Kalyani, India.
https://doi.org/10.1109/devic.2019.8783302

D. R. Freer, J. Liu and G. Yang, Optimization of EMG movement recognition for use in an upper limb wearable robot, 2017 IEEE 14th International Conference on Wearable and Implantable Body Sensor Networks (BSN), 2017, pp. 202-205, Eindhoven, Netherlands.
https://doi.org/10.1109/bsn.2017.7936041

Y. Yang, S. Ruan, P. Chen, Y. Liu and Y. Hsueh, Implementation of a Low-cost Wireless Multi-channel Surface EMG Acquisition System, IEEE Consumer Electronics Magazine.
https://doi.org/10.1109/mce.2020.2986792

M. Heydarzadeh, J. Birjandtalab and M. Nourani, EMG Spectral Analysis for Prosthetic Finger Control, 2017 European Conference on Electrical Engineering and Computer Science (EECS), 2017, pp. 131-135. Bern, Switzerland.
https://doi.org/10.1109/eecs.2017.33

L. Pan, D. L. Crouch and H. Huang, Comparing EMG-Based Human-Machine Interfaces for Estimating Continuous, Coordinated Movements, in IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 27, no. 10, pp. 2145-2154, Oct. 2019.
https://doi.org/10.1109/tnsre.2019.2937929

T. Shibanoki and K. Jin, A 3D-printable Prosthetic Hand Considering Dual-arm Operation, IEEE 2nd Global Conference on Life Sciences and Technologies (LifeTech), 2020, pp. 262-263, Kyoto, Japan.
https://doi.org/10.1109/lifetech48969.2020.1570620385

T. Shibanoki, G. Nakamura, T. Tsuji, K. Hashimoto and T. Chin, A New Approach for Training on EMG-based Prosthetic Hand Control, IEEE 2nd Global Conference on Life Sciences and Technologies (LifeTech) pp. 307-308, Kyoto, Japan, 2020.
https://doi.org/10.1109/lifetech48969.2020.1570620346

Y. Wang, B. Metcalfe, Y. Zhao and D. Zhang, An Assistive System for Upper Limb Motion Combining Functional Electrical Stimulation and Robotic Exoskeleton, IEEE Transactions on Medical Robotics and Bionics, vol. 2, no. 2; 260-268, May 2020.
https://doi.org/10.1109/tmrb.2020.2990318

A. A. Abdhul, D. Subramani, J. Ganesan, S. Subramaniam and K. G. Dharani, Design and Development of EMG Based Prosthetic Arm, 6th International Conference on Advanced Computing and Communication Systems (ICACCS), pp. 502-504, Coimbatore, India, 2020.
https://doi.org/10.1109/icaccs48705.2020.9074206

D. R. Freer, J. Liu and G. Yang, Optimization of EMG movement recognition for use in an upper limb wearable robot, 2017 IEEE 14th International Conference on Wearable and Implantable Body Sensor Networks (BSN), 2017, pp. 202-205, Eindhoven, Netherlands.
https://doi.org/10.1109/bsn.2017.7936041

M. S. Hazam Majid, W. Khairunizam, A. B. Shahriman, I. Zunaidi, B. N. Sahyudi and M. R. Zuradzman, EMG Feature Extractions for Upper-Limb Functional Movement During Rehabilitation, 2018 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), 2018, pp. 314-320, Bangkok, Thailand.
https://doi.org/10.1109/iciibms.2018.8549932

B. N. Cahyadi, W. Khairunizam, M. N. Muhammad, Z. Ibrahim, S.H. Majid Majid, M. R. Mohd Nor, S. Abu Bakar, Z. Mohamad Razlan, W. A. Mustafa. Analysis of EMG based Arm Movement Sequence using Mean and Median Frequency, 2018 5th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI), 2018, pp. 440-444, Malang, Indonesia.
https://doi.org/10.11591/eecsi.v5i5.1584

P. Wang, Q. Zhang, Y. Wang and F. Ru, Active tracking movements of flexion and extension on the elbow joint for an initial prototype of EMG-driven assistant exoskeleton, 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO), 2017, pp. 2687-2692, Macau, China.
https://doi.org/10.1109/robio.2017.8324825

N. Irastorza-Landa, A. Sarasola-Sanz, E. Lopez-Larraz, C. Bibian, P. Shiman, N. Birbaumer, A. Ramos-Murguialday, Design of continuous EMG classification approaches towards the control of a robotic exoskeleton in reaching movements, 2017 International Conference on Rehabilitation Robotics (ICORR), 2017, pp. 128-133, London.
https://doi.org/10.1109/icorr.2017.8009234

S. Y. Gordleeva et al., , S. A. Lobov, N. A. Grigorev, A. O. Savosenkov, M. O. Shamshin, M. V. Lukoyanov, M. A. Khoruzhko, and V. B. Kazantsev, Real-Time EEG–EMG Human–Machine Interface-Based Control System for a Lower-Limb Exoskeleton, IEEE Access, vol. 8, pp. 84070-84081, 2020.
https://doi.org/10.1109/access.2020.2991812

N. F. Fadhlannisa and B. Basari, Design of Wireless Electromyography (EMG) Monitoring System for Muscle Activity Detection on Parkinson Disease, International Conference on Smart Technology and Applications (ICoSTA), pp. 1-4, Surabaya, Indonesia, 2020.
https://doi.org/10.1109/icosta48221.2020.1570609982

F. Wang, C. Wu, K. Gan, H. Yu, H. Qi, G. Wang, D. Rong. A close-loop EMG model for continuous joint movements estimation of a rehabilitation robot, 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO), 2017, pp. 2675-2680, Macau, China.
https://doi.org/10.1109/robio.2017.8324823

N. Irastorza-Landa, A. Sarasola-Sanz, E. López-Larraz, C. Bibián, F. Shiman, N. Birbaumer, A. Ramos-Murguialday, Design of continuous EMG classification approaches towards the control of a robotic exoskeleton in reaching movements, 2017 International Conference on Rehabilitation Robotics (ICORR), 2017, pp. 128-133, London, UK.
https://doi.org/10.1109/icorr.2017.8009234

Y. Mangukiya, B. Purohit and K. George, Electromyography(EMG) sensor controlled assistive orthotic robotic arm for forearm movement, 2017 IEEE Sensors Applications Symposium (SAS), Glassboro, NJ, 2017, pp. 1-4.
https://doi.org/10.1109/sas.2017.7894065

Rubiano A, Ramirez J L, El Korso M N, Jouandeau N, Gallimard L and Polit O 2015 Elbow flexion and extension identification using surface electromyography signals proceedings of 23th European Signal Processing Conference (EUSIPCO) (Nice) pp 644-648.
https://doi.org/10.1109/eusipco.2015.7362462

Rubiano A, Ramirez J L, El Korso M N, Jouandeau N, Gallimard L and Polit O 2015 Features selection and classification to estimate elbow movements Journal of Physics: Conference Series 657, ISSN: 1742-6596 (JPCS) pp 1-6.
https://doi.org/10.1088/1742-6596/657/1/012012

Ramirez J L, Rubiano A, Jouandeau N, Gallimard L and Polit O, chap Morphological optimization of prosthesis’ finger for precision grasping, New Trends in Medical and Service Robots, pp 1-15, ISSN: 978-3-319-30673-5 vol 39, Nantes, France:(Springer, 2016).
https://doi.org/10.1007/978-3-319-30674-2_19

Ramirez J, Rubiano A, Jouandeau N, Gallimard L and Polit O 2015, chap Artificial muscles design methodology applied to robotic fingers, (Springer, pp 1-17).
https://doi.org/10.1007/978-3-319-44507-6_11

Ramirez J L 2016 Development of an artificial muscle for a soft robotic hand 270 prosthesis Ph.D. dissertation. Paris Nanterre University, Paris France, 2013.

H. Wang, K. J. Rajotte, H. Wang, C. Dai, Z. Zhu, M. Bhuiyan, X. Huang, E. A Clancy , Optimal Estimation of EMG Standard Deviation (EMG) in Additive Measurement Noise: Model-Based Derivations and Their Implications, IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 27, no. 12, pp. 2328-2335, December. 2019.
https://doi.org/10.1109/tnsre.2019.2951081

J. Han, Q. Ding, A. Xiong and X. Zhao, A State-Space EMG Model for the Estimation of Continuous Joint Movements, IEEE Transactions on Industrial Electronics, vol. 62, no. 7, pp. 4267-4275, July 2015.
https://doi.org/10.1109/tie.2014.2387337

Labs T 2020 Gesture control armband https://developerblog.myo.com/author/thalmic-labs/,consulted: 27/05/2020.

Tapu R, Mocanu B and Tapu E 2014 A survey on wearable devices used to 275 assist the visual impaired user navigation in outdoor environments 2014 11th International Symposium on Electronics and Telecommunications (ISETC) pp 1-4, Timisoara, Romania, August 2014.
https://doi.org/10.1109/isetc.2014.7010793

O. D. Lara and M. A. Labrador, A Survey on Human Activity Recognition using Wearable Sensors, in IEEE Communications Surveys & Tutorials, vol. 15, no. 3, pp. 1192-1209, Third Quarter 2013.
https://doi.org/10.1109/surv.2012.110112.00192

Munroe C, Meng Y, Yanco H and Begum M, Augmented reality eyeglasses for promoting home-based rehabilitation for children with cerebral palsy 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp 565-565, Christchurch New Zealand March, 2016.
https://doi.org/10.1109/hri.2016.7451858

Phelan I, Arden M, Garcia C and Roast C 2015 Exploring virtual reality and prosthetic training IEEE Virtual Reality (VR) 2015 pp 353-354 ISSN 1087-8270.
https://doi.org/10.1109/vr.2015.7223441

Sathiyanarayanan M and Rajan S 2016 MYO armband for physiotherapy healthcare: A case study using gesture recognition application 8th International Conference on Communication Systems and Networks (COM-SNETS2016) pp 1-6, Bengaluru, India, November, 2018.
https://doi.org/10.1109/comsnets.2016.7439933

Pomboza-Junez G and A Holgado-Terriza J 2015 Control of home devices based on hand gestures 2015 IEEE 5th International Conference on Consumer Electronics - Berlin (ICCE-Berlin), pp 510-514, June, Berlin, Germany.
https://doi.org/10.1109/icce-berlin.2015.7391325

D. G. Fantinato, D. G. Silva, R. Attux and A. Neves, Multivariate Shannon's entropy for adaptive IIR filtering via kernel density estimators, Electronics Letters, vol. 55, no. 15, pp. 859-861, 25 7 2019.
https://doi.org/10.1049/el.2019.1430

Z. Zhang, J. Lou, M. Jin, Y. Yao and J. Zhu, Application of Maximum Entropy Theorem in Channel Estimation, Chinese Journal of Electronics, vol. 29, no. 2, pp. 361-370, 3 2020.
https://doi.org/10.1049/cje.2020.01.015

J. Lu, X. Zheng, M. Sheng, J. Jin and S. Yu, Efficient human activity recognition using a single wearable sensor, IEEE Internet of Things Journal.
https://doi.org/10.1109/jiot.2020.2995940

L. Yang, T. Xie, J. Yu, L. Zhai and Q. Tian, Data Processing Based on Variance Weighted Information Entropy and Maximally Stable Extremal Regions, 2020 IEEE 5th International Conference on Cloud Computing and Big Data Analytics (ICCCBDA), pp. 280-283, Chengdu, China,.
https://doi.org/10.1109/icccbda49378.2020.9095615

Rubiano A, Smart control of a soft robotic hand prosthesis Ph.D. dissertation. Paris Nanterre University, Paris France, 2013.


Refbacks

  • There are currently no refbacks.



Please send any question about this web site to info@praiseworthyprize.com
Copyright © 2005-2024 Praise Worthy Prize