An Intelligent Speed Limit Sign Recognition Approach Towards an Embedded Driver Assistance System

Hanene Rouabeh; Chokri Abdelmoula; Mohamed Masmoudi

doi:10.15866/ireaco.v12i6.17559

An Intelligent Speed Limit Sign Recognition Approach Towards an Embedded Driver Assistance System

Hanene Rouabeh^(1*), Chokri Abdelmoula⁽²⁾, Mohamed Masmoudi⁽³⁾

^(*) Corresponding author

Authors' affiliations

DOI: https://doi.org/10.15866/ireaco.v12i6.17559

Abstract

Road traffic safety has become a significant global public health issue. The number of traffic crashes is increasing in alarming proportions, leading to a large number of deaths and injuries. Most road accidents occur due to human errors including exceeding speed limit and failure to abide by driving rules. Therefore, in order to solve this issue, advanced driver-assistance systems are more and more in use thanks to their capabilities in minimizing the human error. These systems are used to enhance or adapt some or all of the tasks involved in operating a vehicle. Designers rely heavily on Artificial Intelligence in order to operate these systems. In this framework, this paper discusses the development of an intelligent speed limit signs’ recognition system, which can substantially enhance road safety. Since this system is conceived to be implanted on an FPGA card, the main challenges consist in achieving a high recognition rate with a low complexity level in the proposed algorithm. This will undoubtedly lead up to an optimized hardware architecture suitable for real time processing. For this purpose, a two-step based vision speed limit signs’ detection and recognition system has been proposed. The first step concerns sign candidate’s detection based on color and shape analysis; it consists in different sub image processing levels. The second step deals with the recognition and identification of the detected signs. To this end, several Machine Learning algorithms and several architectures of multilayer Neural Network and Wavelet Neural Network have been evaluated. The analysis of performance results and comparison with other widely used techniques have shown the effectiveness and efficiency of the proposed technique in terms of percentage of correct classification and execution time even for images captured under varied orientations and varied illumination conditions.
Copyright © 2019 Praise Worthy Prize - All rights reserved.

Keywords

Traffic Sign Recognition; Image Processing; Neural Networks; Driver Assistance Systems

Full Text:

PDF

References

Mazouzi, A., Bel Bachir, M., Enhancement of the Detection for Intelligent Vehicle Systems - Case Rain/Snow, (2017) International Review of Automatic Control (IREACO), 10 (2), pp. 112-117.
https://doi.org/10.15866/ireaco.v10i2.8242

A V Vinuchandran and R Shanmughasundaram, A real-time lane departure warning and vehicle detection system using monoscopic camera, International Conference on Intelligent Computing, Instrumentation and Control Technologies, 6-7 July 2017, Kannur, India, pp. 1565 – 1569.
https://doi.org/10.1109/icicict1.2017.8342803

Maryam Hemmati, Morteza Biglari-Abhari, Smail Niar and Stevan Berber, Real-Time Multi-Scale Pedestrian Detection for Driver Assistance Systems, Proceedings of the 54th Annual Design Automation Conference, Austin, TX, USA, June 18 - 22, 2017, pp. 1-6.
https://doi.org/10.1145/3061639.3062308

Xinyu Zhang, Hongbo Gao, Chong Xue, Jianhui Zhao, Yuchao Liu, Real-time vehicle detection and tracking using improved histogram of gradient features and Kalman filters, International Journal of Advanced Robotic Systems Volume: 15 issue: 1, 2018.
https://doi.org/10.1177/1729881417749949

Basjaruddin, N., Margana, D., Kuspriyanto, K., Rinaldi, R., Suhendar, S., Hardware Simulation of Advanced Driver Assistance Systems Based on Fuzzy Logic, (2018) International Review on Modelling and Simulations (IREMOS), 11 (1), pp. 24-31.
https://doi.org/10.15866/iremos.v11i1.12691

A. Ellahyani, Mohamed El Ansari, Ilyas El Jaafari, Traffic sign detection and recognition based on random forests, Applied Soft Computing Journal, Vol 46, Pages 805-815, 2016.
https://doi.org/10.1016/j.asoc.2015.12.041

Selcan Kaplan Berkaya, Huseyin Gunduz,Ozgur Ozsen, Cuneyt Akinlar and Serkan Gunal, On circular traffic sign detection and recognition, Expert Systems with Applications: An International Journal, Volume 48 Issue C, Pages 67-75, April 2016.
https://doi.org/10.1016/j.eswa.2015.11.018

Jian-He Shi and Huei-Yung Lin, A vision system for traffic sign detection and recognition, IEEE 26th International Symposium on Industrial Electronics (ISIE) 19-21 June 2017, Edinburgh, UK, pp. 1596 – 1601.
https://doi.org/10.1109/isie.2017.8001485

S. Escalera et al. Traffic-Sign Recognition Systems. Springer Briefs in Computer Science, Pages 1-95, 2011.

Md. Abdul Alim Sheikh, Alok Kole and Tanmoy Maity, Traffic sign detection and classification using colour feature and neural network, International Conference on Intelligent Control Power and Instrumentation (ICICPI), 21-23 October. 2016, Kolkata, India, pp.307-311.
https://doi.org/10.1109/icicpi.2016.7859723

Han Huang and Ling-Ying Hou, Speed Limit Sign Detection Based on Gaussian Color Model and Template Matching, International Conference on Vision, Image and Signal Processing (ICVISP), 22-24 September 2017, Osaka, Japan, pp.118 – 122.
https://doi.org/10.1109/icvisp.2017.30

Dip Nandi, A.F.M. Saifuddin Saif, Prottoy Paul, Kazi Md. Zubair, Seemanta Ahmed Shubho, Traffic Sign Detection based on Color Segmentation of Obscure Image Candidates: A Comprehensive Study, International Journal of Modern Education and Computer Science(IJMECS), Vol.10, No.6, Pages 35-46, 2018.
https://doi.org/10.5815/ijmecs.2018.06.05

U.Zakir, A.N.J.Leonce and E.A.Edirisinghe, Road Sign Segmentation Based on Color Spaces: A Comparative Study, 11th IASTED International Conference Computer Graphics and Imaging (CGIM 2010) February, 2010 Innsbruck, Austria.
https://doi.org/10.2316/p.2010.679-061

Fabien Moutarde, Alexandre Bargeton, Anne Herbin and Lowik Chanussot, Robust on-vehicle real-time visual detection of American and European speed limit signs with a modular Traffic Signs Recognition system, IEEE Intelligent Vehicles Symposium (IV’2007), Jun 2007, Istanbul, Turkey, pp. 1122 – 1126.
https://doi.org/10.1109/ivs.2007.4290268

Wei Liu, Jin Lv, Haihua Gao, Bobo Duan, Huai Yuan and Hong Zhao, An Efficient Real-time Speed Limit Signs Recognition Based on Rotation Invariant Feature, IEEE Intelligent Vehicles Symposium Baden, Germany, June 5-9, 2011, pp. 1000-1005.
https://doi.org/10.1109/ivs.2011.5940428

Tao Zhang, Jingqin Lv and Jie Yang, Road sign detection based on visual saliency and shape analysis. 20th IEEE International Conference on Image Processing , Melbourne 2013, pp. 3667 – 3670.
https://doi.org/10.1109/icip.2013.6738756

Min Shi, Haifeng Wu and Hasan Fleyeh, Support vector machines for traffic signs recongnition, IEEE International Joint Conference on Neural Networks, 1-8 June 2008 Hong Kong, China.
https://doi.org/10.1109/ijcnn.2008.4634347

Yea-Shuan Huang and Yun-Shin Lee, Detection and recognition of speed limit signs, International Computer Symposium (ICS), 16-18 December 2010, Tainan, Taiwan, pp. 107-112.

Wei Liu, Yonghua Wu, Jin Lv, Huai Yuan and Hong Zhao, U.S. speed limit sign detection and recognition from image sequences, 12th International Conference on Control Automation Robotics & Vision (ICARCV), 5-7 December 2012, Guangzhou, China , pp. 1437 – 1442.
https://doi.org/10.1109/icarcv.2012.6485388

K.A. Ishak, M.M. Sani and NM. Tahir, A Speed limit Sign Recognition System Using Artificial Neural Network, 4th Student Conference on Research and Development, 27-28 June 2006, Selangor, Malaysia, pp. 127 – 131.
https://doi.org/10.1109/scored.2006.4339324

Sergio Eduardo Perez-Perez, Sheila Esmeralda Gonzalez-Reyna, Sergio Eduardo Ledesma-Orozco and Juan Gabriel Avina-Cervantes, Principal component analysis for speed limit Traffic Sign Recognition, International Autumn Meeting on Power, Electronics and Computing (ROPEC), 13-15 November 2013, Mexico City, Mexico, pp. 1-5.
https://doi.org/10.1109/ropec.2013.6702716

Tomislav Fištrek and Sven Lončarić, Traffic sign detection and recognition using neural networks and histogram based selection of segmentation method, Proceedings ELMAR 2011, 14-16 September 2011, Zadar, Croatia, pp. 51 – 54.

Hanene Rouabeh, Chokri Abdelmoula and Mohamed Masmoudi, An Improved Red Color Segmentation Algorithm as Part of an Intelligent Speed Limit Sign Detection, 13th International Conference on Applied Computing Mannheim, Germany 2016, pp. 131-138.

Hanene Rouabeh, Chokri Abdelmoula and Mohamed Masmoudi, Performance Evaluation of Decision Tree and Neural Network Techniques for Road Scene Image Classification Task, International Image Processing Applications and Systems Conference, 5-7 November 2014, Tunisia, pp. 1-6.
https://doi.org/10.1109/ipas.2014.7043274

Hanene Rouabeh, Chokri Abdelmoula and Mohamed Masmoudi, VHDL based Hardware Architecture of a High Performance Image Edge Detection Algorithm, International Journal of Computer Applications (0975 – 8887) Volume 91 – No.12,Pages 37-43, 2014.
https://doi.org/10.5120/15935-5208

Hanene Rouabeh, Chokri Abdelmoula and Mohamed Masmoudi, A New Efficient Connected Component Labeling Algorithm and its VHDL Circuit, 28th International Conference on Microelectronics, Cairo, Egypt 2016, pp. 105-108.
https://doi.org/10.1109/icm.2016.7847920

[Young-Jin Cha, Kisung You and Wooram Choi, Vision-based detection of loosened bolts using the Hough transform and support vector machines, Automation in Construction, Volume 71, Part 2, November 2016, Pages 181-188.
https://doi.org/10.1016/j.autcon.2016.06.008

Miguel Ángel García-Garrido, Miguel Ángel Sotelo, and Ernesto MartínGorostiza, Fast Road Sign Detection Using Hough Transform for Assisted Driving of Road Vehicles, In: Moreno Díaz R., Pichler F., Quesada Arencibia A. (eds) Computer Aided Systems Theory – EUROCAST 2005. Lecture Notes in Computer Science, vol 3643. Springer, Berlin, Heidelberg, Pages 543 – 548.
https://doi.org/10.1007/11556985_71

A. Adam, C. Ioannidis, Automatic Road-Sign Detection and Classification Based on Support Vector machines and Hog Descriptors, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume II-5, 2014.
https://doi.org/10.5194/isprsannals-ii-5-1-2014

Hanene Rouabeh, Chokri Abdelmoula and Mohamed Masmoudi, A Novel Neural Network Based Method Developed for Digit Recognition Applied to Automatic Speed Sign Recognition, International Journal of Advanced Computer Science and Applications(IJACSA), Vol 7, No 2, Pages 287-292, 2016.
https://doi.org/10.14569/ijacsa.2016.070240

Pahlevan, L., Rezaeepazhand, J., Semi-Active Cabin Suspension of Agricultural Vehicles Using ER Mounts, (2018) International Journal on Engineering Applications (IREA), 6 (6), pp. 196-201.
https://doi.org/10.15866/irea.v6i6.16997

Marrugo Cardenas, N., Amaya Hurtado, D., Ramos Sandoval, O., Comparison of Multi-Class Methods of Features Extraction and Classification to Recognize EEGs Related with the Imagination of Two Vowels, (2018) International Journal on Communications Antenna and Propagation (IRECAP), 8 (5), pp. 398-405.
https://doi.org/10.15866/irecap.v8i5.12709

El Badlaoui, O., Maazouzi, A., Hammouch, A., Cepstral Features Extraction for Heart Sounds Classification, (2018) International Review of Electrical Engineering (IREE), 13 (5), pp. 421-427.
https://doi.org/10.15866/iree.v13i5.14965

Djelaila, S., Berrached, N., Boudraa, A., Taleb Ahmed, A., Chalabi, Z., Mode by Mode Classification of Congestive Heart Failure from Long Term HRV Analysis, (2016) International Review of Electrical Engineering (IREE), 11 (6), pp. 663-672.
https://doi.org/10.15866/iree.v11i6.10332

Refbacks

There are currently no refbacks.

Username
Password
Remember me