Open Access Open Access  Restricted Access Subscription or Fee Access

Face Completion Using Semantic Segmentation and Geometric Features


(*) Corresponding author


Authors' affiliations


DOI: https://doi.org/10.15866/ireaco.v11i6.15738

Abstract


This paper presents the development of an algorithm focused on face completion implemented by means of two techniques: the first one is semantic segmentation, responsible of the detection of the parts of the face, for which it is proposed to use a SegNet, where in its training and subsequent fine-tuning, an accuracy of 97.51% in the segmentation of the categories of interest is reached (mouth, eyes, face and background). The second one is represented by the geometric features, whose function is the location of the missing parts of the face, in which 3 cases are established, depending on which part of the face is removed, so different relationships of the characteristics of the face are set to strengthen the development in terms of variable face sizes. With the union of these two techniques, it is possible to implement an algorithm that is sufficiently robust to perform face completion, achieving successful results in reconstructed faces, even with a low sensitivity to tilt, rotation and face size.
Copyright © 2018 Praise Worthy Prize - All rights reserved.

Keywords


Semantic Segmentation; Face Parts Detection; Face Completion; Geometric Features; SegNet

Full Text:

PDF


References


P. Viola, and M. J. Jones, Robust real-time face detection, International journal of computer vision, Vol. 57(2): 137-154, 2004.
https://doi.org/10.1023/b:visi.0000013087.49260.fb

M. Castrillón, O. Déniz, D. Hernández, J. Lorenzo, A comparison of face and facial feature detectors based on the Viola–Jones general object detection framework, Machine Vision and Applications, Vol. 22(3): 481-494, 2011.
https://doi.org/10.1007/s00138-010-0250-7

Y. LeCun, Y. Bengio, G. Hinton, Deep learning, Nature, Vol. 521(7553): 436-444, 2015.
https://doi.org/10.1038/nature14539

M. D. Zeiler, and R. Fergus, Visualizing and understanding convolutional networks, European conference on computer vision, Springer, Cham, pp. 818-833, 2014.
https://doi.org/10.1007/978-3-319-10590-1_53

Z. Liu, P. Luo, X. Wang,and X. Tang, Deep learning face attributes in the wild, Proceedings of the IEEE International Conference on Computer Vision, pp. 3730-3738, 2015.
https://doi.org/10.1109/iccv.2015.425

R. Girshick, J. Donahue, T. Darrell, and J. Malik, Rich feature hierarchies for accurate object detection and semantic segmentation, Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 580-587, 2014.
https://doi.org/10.1109/cvpr.2014.81

J. Chen, T. Zhou, H. Yang, and F. Fang, Cortical dynamics underlying face completion in human visual system, Journal of Neuroscience, Vol. 30(49): 16692-16698, 2010.
https://doi.org/10.1523/jneurosci.3578-10.2010

Y. Deng, Q. Dai, and Z. Zhang, Graph Laplace for occluded face completion and recognition, IEEE Transactions on Image Processing, vol. 20(8): 2329-2338, 2011.
https://doi.org/10.1109/tip.2011.2109729

A.Tewari, et al. MoFA: Model-Based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction, 2017 IEEE International Conference on Computer Vision (ICCV), pp. 3735-3744, 2017.
https://doi.org/10.1109/iccv.2017.401

E. Richardson, M. Sela, and R. Kimmel, 3D face reconstruction by learning from synthetic data, 2016 Fourth International Conference on3D Vision (3DV), pp. 460-469, 2016.
https://doi.org/10.1109/3dv.2016.56

A. S. Jackson, A. Bulat, V. Argyriou, G. Tzimiropoulos, Large pose 3D face reconstruction from a single image via direct volumetric CNN regression, 2017 IEEE International Conference on Computer Vision (ICCV), pp. 1031-1039, 2017.
https://doi.org/10.1109/iccv.2017.117

A. Radford, L. Metz, and S. Chintala, Unsupervised representation learning with deep convolutional generative adversarial networks, arXiv preprint arXiv:1511.06434, 2015.

S. Basak, Image Completion using Deep Convolutional Generative Adversarial Nets, Consulted on May 25, 2018, [Online]. Available at:
https://github.com/saikatbsk/ImageCompletion-DCGAN

Y. Li, S. Liu, J. Yang, and M. H. Yang, Generative Face Completion, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5892-5900, 2017.
https://doi.org/10.1109/cvpr.2017.624

L. Song, J. Cao, L. Song, Y. Hu, and R. He, Geometry-Aware Face Completion and Editing, arXiv preprint arXiv:1809.02967, 2018.

K. Simonyan,and A. Zisserman, Very deep convolutional networks for large-scale image recognition, arXiv preprint arXiv:1409.1556, 2014.

V. Badrinarayanan, A. Kendall, and R. Cipolla, Segnet: A deep convolutional encoder-decoder architecture for image segmentation, IEEE transactions on pattern analysis and machine intelligence, vol. 39(12): 2481-2495, 2017.
https://doi.org/10.1109/tpami.2016.2644615

M. Tanaka, R. Kamio, and M. Okutomi, Seamless image cloning by a closed form solution of a modified poisson problem, SIGGRAPH Asia 2012 Posters, ACM, pp. 15, 2012.
https://doi.org/10.1145/2407156.2407173

M. Sonka, V. Hlavac, and R. Boyle, Image processing, analysis, and machine vision (Cengage Learning, 2014).

M. Tanaka, Face Parts Detection. Consulted on May 26, 2018, [Online], Available at: https://la.mathworks.com/matlabcentral/fileexchange/36855-face-parts-detection

Labed, K., Fizazi, H., Mahi, H., Application of Cuckoo Search Algorithm for Image Segmentation, (2017) International Review of Aerospace Engineering (IREASE), 10 (3), pp. 154-159.
https://doi.org/10.15866/irease.v10i3.11894

Lakshmi, M., Prasad, S., Rahman, M., Efficient Speckle Noise Reduction Techniques for Synthetic Aperture Radars in Remote Sensing Applications, (2016) International Review of Aerospace Engineering (IREASE), 9 (4), pp. 114-122.
https://doi.org/10.15866/irease.v9i4.10367

Bodade, R., Dixit, S., Vein Pattern Decomposition (VPD) Method: a Novel Approach to Build Practical Palm Vein Based Person Authentication System, (2017) International Journal on Communications Antenna and Propagation (IRECAP), 7 (6), pp. 516-520.
https://doi.org/10.15866/irecap.v7i6.13610


Refbacks

  • There are currently no refbacks.


Please send any question about this web site to info@praiseworthyprize.com
Copyright © 2005-2024 Praise Worthy Prize