Open Access Open Access  Restricted Access Subscription or Fee Access

Signer-Independent SLR System Using PCA and Multi-Class SVM


(*) Corresponding author


Authors' affiliations


DOI: https://doi.org/10.15866/irecos.v9i12.4838

Abstract


The aim of Sign Language Recognition (SLR) is to provide accurate and an efficient mechanism to transliterate sign language into a text or speech. State of the art SLR must be able to solve the signer-independent problem for realistic applications. This paper presents a novel method to recognize 32 unique American Sign Language (ASL) letters and numbers from images of signs, independent of signer and environment of image capture. Input images are mapped to the YCbCr colour space, binarized and resized to 70x70 pixels. Principal Component Analysis (PCA) is then performed on these binary images using their pixels as features. This method recognized signer-dependent signs with an accuracy of 100% and signer-independent signs with an accuracy of 62.37% for 32 unique classes and which increases to 78.49% when considering 23 classes, with very similar signs grouped together. Multi class Support Vector Machine (SVM) were employed as a classification method after processing the images, giving a result of 39.78% for 32 unique classes and 55.91% for 23 classes. This paper evaluates the efficiency of feature extraction method PCA on ASL hand gestures. To evaluate the impact of features on sign recognition rate, classifiers such as minimum distance, SVM is used. Experimental trials indicate higher recognition rate for PCA in comparison to those of other techniques and also previous works on ASL recognition.
Copyright © 2014 Praise Worthy Prize - All rights reserved.

Keywords


American Sign Language (ASL); Image Processing; Principal Component Analysis (PCA); Sign Language Recognition Systems; Support Vector Machines (SVM)

Full Text:

PDF


References


Moghaddam, M, Rasht, Iran, Nahvi, M, Pak, R.H, “Static Persian Sign Language Recognition Using Kernel-Based Feature Extraction”, Machine Vision and Image Processing, 2011.
http://dx.doi.org/10.1109/iranianmvip.2011.6121539

Rohit Sharma, Yash Nemani, Sumit Kumar, Lalit Kane, Pritee Khanna, “Recognition of Single Handed Sign Language Gestures using Contour Tracing Descriptor”, Proceedings of the World Congress on Engineering, 2013.

Ravikiran J, Kavi Mahesh, Suhas Mahishi, Dheeraj R, Sudheender S, Nitin V Pujari, “Finger Detection for Sign Language Recognition”, Proceedings of the International MultiConference of Engineers and Computer Scientists, 2009.
http://dx.doi.org/10.1007/978-90-481-3517-2_25

Thad Starner and Alex Pentland, “Real-time american sign language recognition from video using hidden markov models in Motion-Based Recognition”, Springer, pp. 227-243, 1997.
http://dx.doi.org/10.1007/978-94-015-8935-2_10

Sylvie C.W. Ong and Surendra Ranganath, “Automatic sign language analysis: A survey and the future beyond lexical meaning”, IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 873-891, 2005.
http://dx.doi.org/10.1109/tpami.2005.112

M. G. Suraj and D. S. Guru, "Appearance based recognition methodology for recognising fingerspelling alphabets," In International Joint Conference on Artificial Intelligence, pp. 605-610, 2007.

Shu-Fai Wong and Roberto Cipolla, “Real-time interpretation of hand motions using a sparse bayesian classifier on motion gradient orientation images”, In Proceedings of the British Machine Vision Conference, pp. 379-388, 2005.
http://dx.doi.org/10.5244/c.19.41

Jose L. Hernandez-Rebollar, Robert W. Lindeman and Nicholas Kyriakopoulos, “A multi-class pattern recognition system for practical finger spelling translation”, IEEE International Conference on Multimodal Interfaces, 2002.
http://dx.doi.org/10.1109/icmi.2002.1166990

Vassilis Athitsos, “Large lexicon project: American Sign Language video corpus and sign language indexing/retrieval algorithms”, Workshop on the Representation and Processing of Sign Languages: Construction and Exploitation of Sign Language Corporation, 2010.

Henrik Birk, Thomas B. Moeslund and Claus B. Madsen, “Real-Time Recognition of Hand Alphabet Gestures Using Principal Component Analysis”, Scandinavian Conference on Image Analysis, 1997.

Wen Gao, Jiyong Ma, Jiangqin Wu, and Chunli Wang, “Sign language recognition based on HMM/ANN/DP”, International Journal of Pattern Recognition and Artificial Intelligence, pp.587-602, 2000.
http://dx.doi.org/10.1142/s0218001400000386

Nicolas Pugeault, and Richard Bowden, “Spelling it out: Real-time asl fingerspelling recognition”, IEEE International Conference on Computer Vision Workshops, pp. 1114-1119, 2011.
http://dx.doi.org/10.1109/iccvw.2011.6130290

Suat Akyol and Ulrich Canzler, “An information terminal using vision based sign language recognition”, In ITEA Workshop on Virtual Home Environments, pp. 61-68, 2002.

Ila Agarwal, Swati Johar, and Jayashree Santhosh, “A Tutor for the hearing impaired (developed using Automatic Gesture Recognition)”, International Journal of Computer Science, Engineering and Applications, 2011.
http://dx.doi.org/10.5121/ijcsea.2011.1405

Dominique Uebersax, Juergen Gall, Michael Van den Bergh, and Luc Van Gool, “Real-time sign language letter and word recognition from depth data”, IEEE International Conference on Computer Vision Workshops, pp. 383-390, 2011.
http://dx.doi.org/10.1109/iccvw.2011.6130267

László Havasi, and Helga M. Szabó, “A motion capture system for sign language synthesis: overview and related issues”, International Conference on Computer as a Tool, pp. 445-448, 2005.
http://dx.doi.org/10.1109/eurcon.2005.1629959

Rogerio Feris, Matthew Turk, Ramesh Raskar, Karhan Tan, and Gosuke Ohashi, “Exploiting depth discontinuities for vision-based fingerspelling recognition”, IEEE International Conference on Computer Vision Workshops, pp. 155-155, 2004.
http://dx.doi.org/10.1109/cvpr.2004.336

Ming-Hsuan Yang, Narendra Ahuja, and Mark Tabb, “Extraction of 2d motion trajectories and its application to hand gesture recognition”, IEEE Transactions on Pattern Analysis and Machine Intelligence, pp.1061-1074, 2002.
http://dx.doi.org/10.1109/tpami.2002.1023803

Zieren, J., Kraiss, K.F, “Robust person-independent visual sign language recognition”, Iberian Conference on Pattern Recognition and Image Analysis, 2005.
http://dx.doi.org/10.1007/11492429_63

Von Agris, U., Schneider, D., Zieren, J., Kraiss, K.F, “Rapid signer adaptation for isolated sign language recognition”, IEEE Conference on Computer Vision and Pattern Recognition Workshop, 2006.
http://dx.doi.org/10.1109/cvprw.2006.165

Von Agris, Ulrich, and Karl-Friedrich Kraiss, “Towards a video corpus for signerindependent continuous sign language recognition”, Gesture in Human-Computer Interaction and Simulation, 2007.

Kwak N, “Principal Component Analysis Based on L1-Norm Maximization”, IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1672-1680, 2008.
http://dx.doi.org/10.1109/tpami.2008.114

Lipovetsky S, “PCA and SVD with nonnegative loadings”, Pattern Recognition Letters, pp. 68-76, 2009.
http://dx.doi.org/10.1016/j.patcog.2008.06.025

Jackson, J.E, “A User’s Guide to Principal Components”, John Wiley & Sons, 1991.
http://dx.doi.org/10.3102/10769986020001105

Michael Kirby, and Lawrence Sirovich, “Application of the Karhunen-Loeve procedure for the characterization of human faces”, IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 103-108, 1990.
http://dx.doi.org/10.1109/34.41390

Matthew Turk and Alex Pentland, “Eigenfaces for recognition”, Journal of cognitive neuroscience, pp. 71-86, 1991.
http://dx.doi.org/10.1162/jocn.1991.3.1.71

Jiang-Wen Deng and Hung-Tat Tsui, “A novel two-layer PCA/MDA scheme for hand posture recognition”, International Conference on Pattern Recognition, pp. 283-286, 2002.
http://dx.doi.org/10.1109/icpr.2002.1044688

Vandar Kuzhali, J., Vengataasalam, S., Hybrid model based feature selection approach using Kernel PCA for large datasets, (2013) International Review on Computers and Software (IRECOS), 8 (11), pp. 2586-2592.

Jawad, M.S., Al-Shargie, F., Al-Yoonus, M., Zakaria, Z.B., Performance analysis comparative study of fingerprint recognition systems, (2014) International Review on Computers and Software (IRECOS), 9 (7), pp. 1154-1162.

Akram A. Moustafa and Ziad A. Alqadi, “Reconstructed Color Image Segmentation”, Proceedings of the World Congress on Engineering and Computer Science, 2009.
http://dx.doi.org/10.3844/jcs.2009.250.254

Bharathi S, Karthik Kumar S, P Deepa Shenoy, Venugopal K R, L M Patnaik, “Bag of Features Based Remote Sensing Image Classification Using RANSAC And SVM”, Proceedings of the International MultiConference of Engineers and Computer Scientists, 2014.

Adewole A. Philip and Mustapha Mutairu Omotosho, “Image Processing Techniques for Denoising, Object Identification and Feature Extraction”, Proceedings of the World Congress on Engineering, 2013.

A. L. C. Barczak, N. H. Reyes, M. Abastillas, A. Piccio, and T. Susnjak, “A new 2D static hand gesture colour image dataset for asl gestures”, Res Lett Inf Math Sci 15, 2011.

Otsu N, “A Threshold Selection Method from Gray-Level Histograms”, IEEE Transactions on Systems, Man, and Cybernetics, pp. 62-66, 1979.
http://dx.doi.org/10.1109/tsmc.1979.4310076

N.S. Patil, P.S. Shelokar, V.K. Jayaraman, B.D. Kulkarni, “Regression models using pattern search assisted least square support vector machines”, Chemical Engineering Research and Design, pp.1030-1037, 2005.
http://dx.doi.org/10.1205/cherd.03144

Li D., Yang W., Wang S, “Classification of foreign fibers in cotton lint using machine vision and multi-class support vector machine”, Computers and Electronics in Agriculture, 274-279, 2010.
http://dx.doi.org/10.1016/j.compag.2010.09.002

Zhi-Hang, T., Bei-Ping, T., Han, Y., Yi-Jie, L., Xiang-Ling, L., Wen-Bin, T., Hai-Bin, W., A new pattern recognition method based on nonlinear support vector machine, (2013) International Review on Computers and Software (IRECOS), 8 (1), pp. 262-266.

Karthikeyan, T., Kumar, S.V., Hyperspectral image classification using multiple kernel learning SVM with FA-KLD-LFDA for multi feature selection, (2014) International Review on Computers and Software (IRECOS), 9 (8), pp. 1338-1347.
http://dx.doi.org/10.15866/irecos.v9i8.2598

Ruslan Kurdyumov, Phillip Ho, Justin Ng, “Sign Language Classification Using Webcam Images”, December 16, 2011.

Yonggang, L., Haiming, Y., Specific erotic image detection method based on SVM, (2013) International Review on Computers and Software (IRECOS), 8 (1), pp. 180-185.

Khazaee, A., Ebrahimzadeh, A., Electrocardiogram beat classification using support vector machines and efficient features, (2011) International Journal on Communications Antenna and Propagation (IRECAP), 1 (6), pp. 515-521.

Abidin, A.F., Mohamed, A., Shareef, H., Intelligent classification of three phase fault and voltage collapse for correct distance relay operation using support vector machine, (2012) International Review on Modelling and Simulations (IREMOS), 5 (2), pp. 623-631.


Refbacks




Please send any question about this web site to info@praiseworthyprize.com
Copyright © 2005-2024 Praise Worthy Prize