Skip to main content
SpringerLink
Log in

Facial expression recognition using digital signature feature descriptor

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Facial feature extraction is the most crucial part for efficient representation of facial images. For facial expression recognition, efficiency of recognition mainly depends on discriminative nature of features that describe optical changes of facial expressions. Facial expressions are very dynamic in nature. The dynamics of facial muscle changes is required to be captured and encoded accurately. Facial expressions are contractions and expansions of facial muscles which results in high-frequency edges on different part of facial image. A novel feature extraction framework called digital signature based on high-frequency edges in combination with LBP histogram features is developed, and the proposed methodology is used for facial expression recognition (FER). Digital signature descriptor of facial dynamic is obtained by projecting edge pixels vertically and horizontally. Digital signature uniquely and completely describes the facial expressions. Support vector method classifier is used to classify six basic expressions based on one-against-all strategy of classification. The validity of proposed algorithm is tested on standard widely used Cohn–Kanade Facial Expression Database (CKFED), Taiwanese Facial Expression Database (TFED) and Japanese Female Facial Expression databases (JFED). Experimental results show that the efficiency of expression recognition of proposed novel technique is 96.25% on CKFED which is higher than other existing methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Ngoc T.N.: An efficient LBP-based descriptor for real-time object detection. In: IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA) (2014)

  2. Michaud, T., Gassia, V., Belhaouari, L.: Facial dynamics and emotional expressions in facial aging treatments. J. Cosmet Dermatol. 14, 9–21 (2014)

    Article  Google Scholar 

  3. Happy, S.L., Patnaik, P., Routray, A., Rajlakshmi, G.: The Indian spontaneous expression database for emotion recognitiion. IEEE Trans. Affect. Comput. 8(1), 131–142 (2017)

    Article  Google Scholar 

  4. Moore, S., Bowden, R.: Local binary pattern for multi view facial expression recognition. Comput. Vis. Image Underst. J. 115, 541–558 (2011)

    Article  Google Scholar 

  5. Cheng, J., Chen, Z., Chi, Z., Hong, F.: Facial expression recognition in video with multiple feature fusion. IEEE Trans. Affect. Comput. 9(1), 38–50 (2016)

    Article  Google Scholar 

  6. Sun, Z., Zheng-Peng, H., Wang, M., Zhao, S.-H.: Discriminative feature learning based pixel Difference representation for facial expression recognition. IET Comput. Vis. 11(8), 675–682 (2017)

    Article  Google Scholar 

  7. Lee, S.H., Ro, Y.M.: Partial matching of facial expression sequence using over-complete transition dictionary for emotion recognition. IEEE Trans. Affect. Comput. 7(4), 389–408 (2016)

    Article  Google Scholar 

  8. Lee, S.H., Plataniotis, K.N., Ro, Y.M.: Intra-class variation reduction using training expression images for sparse representation based facial expression recognition. IEEE Trans. Affect. Comput. 5(3), 340–351 (2014)

    Article  Google Scholar 

  9. Li, Y., Wang, S., Zhao, Y., Ji, Q.: Simultaneous facial feature tracking and facial expression recognition. IEEE Trans. Image Process. 22(7), 2559–2573 (2013)

    Article  Google Scholar 

  10. Zhao, X., Zhang, H., Zhan, X.: Expression recognition by extracting facial features of shapes and textures. J. Comput. Inf. Syst. 11, 3377–3384 (2012)

    Google Scholar 

  11. Sariyanidi, E., Gunes, H., Cavallaro, A.: Learning bases of activity for facial expression recognition. IEEE Trans. Image Process. 26(4), 1965–1978 (2017)

    Article  MathSciNet  Google Scholar 

  12. Xie, W., Shen, L., Jiang, J.: A novel transient wrinkle detection algorithm and its application for expression synthesis. IEEE Trans. Multimed. 19, 279–292 (2016)

    Article  Google Scholar 

  13. Huang, D., Shan, C., Wang, Y., Chen, L.: Local binary patterns and its application to facial image analysis: a survey. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 41(6), 765–781 (2011)

    Article  Google Scholar 

  14. Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended Cohn-Kanade dataset (CK +): a complete expression dataset for action unit and emotion-specified expression (2010)

  15. Chen, L.-F., Yen, Y.-S.: Taiwanese Facial Expression Image Database. Brain Mapping Laboratory, Institute of Brain Science, National Yang-Ming University, National Yang-Ming University (2007)

    Google Scholar 

  16. Lyons, M.J., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding facial expressions with gabor wavelets. In: Third IEEE International Conference on Automatic Face and Gesture Recognition, Nara, Japan, pp. 200–205. IEEE Computer Society (1998)

  17. Khan, S., Chen, L., Yan, H.: Co-clustering to reveal salient facial features for expression recognition. IEEE Trans. Affect. Comput. 9, 1 (2017)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Sardar Patel Institute of Technology, Mumbai, India

    Kiran Talele

  2. AGM Systems Pvt. Ltd, Mumbai, India

    Kushal Tuckley

  3. Electrical Department, IIT Mumbai, Mumbai, India

    Kushal Tuckley

Authors
  1. Kiran Talele
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kushal Tuckley
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kiran Talele.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Talele, K., Tuckley, K. Facial expression recognition using digital signature feature descriptor. SIViP 14, 701–709 (2020). https://doi.org/10.1007/s11760-019-01595-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-019-01595-1

Keywords

Search

Navigation