Skip to main content
SpringerLink
Log in

Efficient Hybrid Descriptor for Face Verification in the Wild Using the Deep Learning Approach

  • Published:
Optical Memory and Neural Networks Aims and scope Submit manuscript

Abstract

In this work, we propose a novel model-based on a new Deep Hybrid Descriptor learning called DeepGLBSIF (Gabor Local Binarized Statistical Image Feature) for effective extraction and over-complete features in multilayer hierarchy. The typology of our methodology is the same as that of Convolutional Neural Network (CNN) which is one of the intensively-applied deep learning architectures. This field was developed due to: (i) end-to-end learning of the process utilizing a convolutional neural network (CNN), and (ii) the presence of very wide training databases. Our method allows improving the use of the interactions between global and local features for the model, which allowed providing effective and discriminating representations. In our study, the trainable kernels were substituted by our hybrid descriptor GLBSIF. Thus, the developed DeepGLBSIF architecture was efficiently and simply constructed and learned for Face Verification in the Wild. Finally, the classification process was carried out by applying distance measure Cosine and Support Vector Machine (SVM). Our experiments were performed on three large, real-world face datasets: LFW, PubFig and VGGface2. Experimental results demonstrate that our DeepGLBSIF approach provided competitive performance, compared to the others presented in state-of-the-art based on the LFW dataset for facial verification. A public CASIA-WebFace database was utilized in the training step of the introduced approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.

Similar content being viewed by others

REFERENCES

  1. Huang, G.B., Jones, M.J., and Learned-Miller, E., LFW results using a combined Nowak plus MERL recognizer, Faces in Real-Life Images Workshop in European Conference on Computer Vision (ECCV), 2008.

  2. Guillaumin, M., Verbeek, J., and Schmid, C., Is that you? Metric learning approaches for face identification, International Conference on Computer Vision (ICCV), 2009.

  3. Wolf, L., Hassner, T., and Taigman, Y., Similarity scores based on background samples, Asian Conference on Computer Vision (ACCV), 2009.

  4. Pinto, N. and Cox, D., Beyond simple features: A large-scale feature search approach to unconstrained face recognition, International Conference on Automatic Face and Gesture Recognition (FG), 2011.

  5. Ameur, B., Masmoudi, S., Derbel, A.G., and Hamida, A.B., Fusing Gabor and LBP feature sets for KNN and SRC-based face recognition, IEEE 2nd International Conference on Advanced Technologies for Signal and Image Processing (ATSIP), 2016, pp. 453–458.

  6. Ameur, B., Belahcene, M., Masmoudi, S., Derbel, A.G., and Hamida, A.B., A new GLBSIF descriptor for face recognition in the uncontrolled environments, IEEE International Conference on Advanced Technologies for Signal and Image Processing (ATSIP), 2017, pp. 1–6.

  7. Kannala, J. and Rahtu, E., BSIF: Binarized statistical image features, IEEE 21st International Conference on Pattern Recognition (ICPR), 2012, pp. 1363–1366.

  8. Li Deng and Dong Yu, Deep learning: Methods and applications, Found. Trends Signal Process., 2014, vol. 7, nos. 3–4, pp. 197–387.

    Article  MathSciNet  Google Scholar 

  9. Hinton, G.E., Osindero, S., and Teh, Y.-W., A fast learning algorithm for deep belief nets, Neural Comput., 2006, vol. 18, no. 7, pp. 1527–1554.

    Article  MathSciNet  Google Scholar 

  10. Bengio, Y., Courville, A., and Vincent, P., Representation learning: A review and new perspectives, IEEE Trans. Pattern Anal. Mach. Intell., 2013, vol. 35, no. 8, pp. 1798–1828.

    Article  Google Scholar 

  11. Taigman, Y., Yang, M., Ranzato, M., and Wolf, L., Deepface: Closing the gap to human-level performance in face verification, IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, 2014, pp. 1701–1708.

  12. Schroff, F., Kalenichenko, D., and Philbin, J., Facenet: A unified embedding for face recognition and clustering, IEEE International Conference on Computer Vision Workshops, Santiago, 2015, pp. 815–823.

  13. Amos, B., Ludwiczuk, B., and Satyanarayanan, M., OpenFace: A General-Purpose Face Recognition Library with Mobile Applications, Technical Report CMU-CS-16-118, CMU School of Computer Science, 2016.

  14. Yi, D., Lei, Z., Liao, S., and Li, S.Z., Learning face representation from scratch, arXiv preprint arXiv:1411.7923, 2014.

  15. Parkhi, O.M., Vedaldi, A., Zisserman, A., et al., Deep face recognition, Br. Mach. Vision Assoc., 2015, vol. 1, no. 3, p. 6.

    Google Scholar 

  16. Huang, G.B., Lee, H., and Learned-Miller, E., Learning hierarchical representations for face verification with convolutional deep belief networks, Computer Vision and Pattern Recognition (CVPR), 2012.

    Google Scholar 

  17. Cai, X., Wang, C., Xiao, B., Chen, X., and Zhou, J., Deep nonlinear metric learning with independent subspace analysis for face verification, ACM Conference on Multimedia, 2012, pp. 749–752.

  18. Junlin Hu, Jiwen Lu, and Yap-Peng Tan, Discriminative deep metric learning for face verification in the wild, Computer Vision and Pattern Recognition (CVPR), 2014.

    Google Scholar 

  19. Sun, Y., Liang, D., Wang, X., and Tang, X., Deepid3: Face recognition with very deep neural networks, arXiv preprint arXiv:1502.00873, 2015.

  20. Liu, W., Wen, Y., Yu, Z., and Yang, M., Large-margin softmax loss for convolutional neural networks, International Conference on Machine Learning, 2016, pp. 507–516.

  21. Liu, W., Wen, Y., Yu, Z., Li, M., Raj, B., and Song, L., Sphereface: Deep hypersphere embedding for face recognition, Computer Vision and Pattern Recognition (CVPR), 2017, vol. 1.

    Google Scholar 

  22. Wang, F., Liu, W., Liu, H., and Cheng, J., Additive margin softmax for face verification, arXiv preprint arXiv:1801.05599, 2018.

  23. Wang, H., Wang, Y., Zhou, Z., Ji, X., Li, Z., Gong, D., Zhou, J., and Liu, W., Cosface: Large margin cosine loss for deep face recognition, arXiv preprint arXiv:1801.09414, 2018.

  24. Xiangyu Zhu, Zhen Lei, Junjie Yan, Dong Yi, and Stan Z. Li, High-fidelity pose and expression normalization for face recognition in the wild, Computer Vision and Pattern Recognition (CVPR), 2015.

    Google Scholar 

  25. Lu Jiwen, Hu Junlin, and Tan Yap-Peng, Discriminative deep metric learning for face and kinship verification, IEEE Trans. Image Process., 2017, vol. 26, no. 9, p. 4269–4282.

    Article  MathSciNet  Google Scholar 

  26. Ameur, B., Mebarka, B., Sabeur, M., and Hamida, A.B., Weighted PCA-EFMNet: A deep learning network for face verification in the wild, IEEE 4th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP), 2018, pp. 1–6.

  27. Ting Liu, Zhen Lei, Jun Wan, et al., Dfdnet: Discriminant face descriptor network for facial age estimation, Chinese Conference on Biometric Recognition, Cham, 2015, pp. 649–658.

  28. Zhao, W. and Du, S., Spectral-spatial feature extraction for hyperspectral image classification: A dimension reduction and deep learning approach, IEEE Trans. Geosci. Remote Sens., 2016, vol. 54, no. 8, pp. 4544–4554.

    Article  Google Scholar 

  29. Ng Cong Jie and Teoh Andrew Beng Jin, DCTNet: A simple learning-free approach for face recognition, Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2015 Asia-Pacific, IEEE, 2015, pp. 761–768.

  30. Huang, G., Mattar, M., Berg, T., and Learned-Miller, E., Labeled faces in the wild: A database for studying face recognition in unconstrained environments, Workshop on Faces in ’Real-Life’ Images: Detection, Alignment, and Recognition, 2008.

  31. Wolf, L., Hassner, T., and Taigman, Y., Effective face recognition by combining multiple descriptors and learned background statistics”, IEEE Trans. Pattern Anal. Mach. Intell., 2011, vol. 33, no. 10, pp. 1978–1990.

    Article  Google Scholar 

  32. Ouamane, A., Bengherabi, M., Hadid, A., and Cheriet, M., Side-information based exponential discriminant analysis for face verification in the wild, Biometrics in the Wild, Automatic Face and Gesture Recognition Workshop, 2015.

  33. Hassner, T., Harel, S., Paz, E., and Enbar, R., Effective face frontalization in unconstrained images, Computer Vision and Pattern Recognition (CVPR), 2015.

    Google Scholar 

  34. Juefei-Xu, F., Luu, K., and Savvides, M., Spartans: Single-sample periocular-based alignment-robust recognition technique applied to non-frontal scenarios, Image Process., 2015, vol. 24, no. 12.

  35. Yiming Ying and Peng Li, Distance metric learning with eigenvalue optimization, J. Mach. Learn. Res., 2012, vol. 13, no. 1, pp. 1–26.

    MathSciNet  MATH  Google Scholar 

  36. Wen, Y., Zhang, K., Li, Z., and Qiao, Y., A discriminative feature learning approach for deep face recognition, European Conference on Computer Vision (ECCV), 2016.

  37. Sun, Y., Wang, X., and Tang, X., Deeply learned face representations are sparse, selective, and robust, Computer Vision and Pattern Recognition (CVPR), 2015.

    Google Scholar 

  38. Liu, J., Deng, Y., and Huang, C., Targeting ultimate accuracy: Face recognition via deep embedding, arXiv preprint arXiv:1506.07310, 2015.

  39. Ding, C. and Tao, D., Robust face recognition via multimodal deep face representation, IEEE TMM, 2015, vol. 17, no. 11, pp. 2049–2058.

    Google Scholar 

  40. Chen, J.-C., Patel, V.M., and Chellappa, R., Unconstrained face verification using deep CNN features, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), 2016, pp. 1–9.

  41. Sun, Y., Wang, X., and Tang, X., Deep learning face representation from predicting 10,000 classes, IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, 2014, pp. 1891–1898.

  42. Chen, D., Cao, X., Wen, F., and Sun, J., Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification, IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, 2013, pp. 3025–3032.

  43. Lei, Z., Pietikäinen, M., and Li, S.Z., Learning discriminant face descriptor, IEEE Trans. Pattern Anal. Mach. Intell., 2014, vol. 36, no 2, pp. 289–302.

    Article  Google Scholar 

  44. Sun Yi, Wang Xiaogang, and Tang Xiaoou, Hybrid deep learning for face verification, Proceedings of the IEEE International Conference on Computer Vision, 2013, pp. 1489–1496.

  45. Zhu Zhenyao, Luo Ping, Wang Xiaogang, and Xiaoou Tang, Recover canonical-view faces in the wild with deep neural networks, arXiv preprint arXiv:1404.3543, 2014.

Download references

Author information

Authors and Affiliations

  1. ATMS Advanced Technologies for Medicine and Signals, National Engineering School of Sfax (ENIS), Sfax University, Sfax, Tunisia

    Bilel Ameur, Sabeur Masmoudi & Ahmed Ben Hamida

  2. National Engineering School of Gabes (ENIG), Gabes University, Gabes, Tunisia

    Bilel Ameur

  3. Laboratory of Identification, Command, Control and Communication, Faculty of Science and Technology Mohamed Khider University Biskra, Biskra, Algeria

    Mebarka Belahcene

Authors
  1. Bilel Ameur
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mebarka Belahcene
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sabeur Masmoudi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ahmed Ben Hamida
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bilel Ameur.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bilel Ameur, Belahcene, M., Masmoudi, S. et al. Efficient Hybrid Descriptor for Face Verification in the Wild Using the Deep Learning Approach. Opt. Mem. Neural Networks 28, 151–164 (2019). https://doi.org/10.3103/S1060992X19030020

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.3103/S1060992X19030020

Keywords:

Search

Navigation