Skip to main content
SpringerLink
Log in

Two-dimensional Subclass Discriminant Analysis for face recognition

  • Theoretical advances
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

Dimensionality reduction plays a major role in face recognition. Discriminant analysis (DA) and principal component analysis (PCA) are two of the most important approaches in this field. In particular, subclass discriminant analysis (SDA) is a well-known scheme for feature extraction and dimensionality reduction. It is widely used in many high-dimensional data-driven applications, namely face recognition and image retrieval. It is also found to be applicable under various scenarios. However, it has high cost in time and space given the need for an eigendecomposition involving the scatter matrices, known as the singularity problem. This limitation is caused by the high-dimensional space of data, particularly when dimensions exceed the number of observations. Recent advances widely reported that 2D methods with matrix-based representation perform better than the traditional 1D vector-based ones. In this paper, we propose a novel 2D-SDA algorithm to avoid the “curse of dimensionality” and address the singularity issue. The performance of the proposed algorithm is evaluated for face recognition in terms of recognition performance and computational cost. Experiments are conducted on four benchmark face databases and compared to several competitive 1D and 2D methods based on PCA and DA. Results show that 2DSVD achieves the best recognition performance at low dimensions. In particular, 2D-SDA works significantly better on large-sized data sets where intra-class variation is the most important.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Belhumeour PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720

    Article  Google Scholar 

  2. Bouwmans T, Sobral A, Javed S, Jung SK, Zahzah EH (2017) Decomposition into low-rank plus additive matrices for background/foreground separation: a review for a comparative evaluation with a large-scale dataset. Comput Sci Rev 23:1–71

    Article  Google Scholar 

  3. Chen CM, Song JT, Zhang SQ (2011) Face recognition method based on 2DPCA and compressive sensing. Comput Eng 33(22):176–178

    Google Scholar 

  4. Choi Y, Ozawa S, Lee M (2014) Incremental two-dimensional kernel principal component analysis. Neurocomputing 134:280–288

    Article  Google Scholar 

  5. Da-Zheng ZYF (2011) An algorithm of feature extraction of face based on the weighted variation of 2DPCA. J Electron Inf Technol 33(4):769–774

    Article  Google Scholar 

  6. Duda RO, Hart PE, Stork D (2000) Pattern classification. Wiley, Hoboken

    MATH  Google Scholar 

  7. Fisher RA (1936) The use of multiple measurements in taxonomic problems. Ann Eugen 7:179–188

    Article  Google Scholar 

  8. Fukunaga K (1990) Introduction to statistical pattern recognition, 2nd edn. Academic Press, London

    MATH  Google Scholar 

  9. He G, Tang Y, Fang B, Wang PS (2011) Bionic face recognition using Gabor transformation. Int J Pattern Recognit Artif Intell 25(3):391–402

    Article  MathSciNet  Google Scholar 

  10. Kong H, Wang L, Teoh EK, Li X, Wang JG (2005) Generalized 2D principal component analysis for face image representation and recognition. Neural Netw 18(5):585–594

    Article  Google Scholar 

  11. Krzanowski WJ, Jonathan P, McCarthy WV, Thomas MR (1995) Discriminant analysis with singular covariance matrices: methods and applications to spectroscopic data. Appl Stat 27:101–115

    Article  Google Scholar 

  12. Li M, Yuan B (2005) 2D-LDA: a statistical linear discriminant analysis for image matrix. Pattern Recognit Lett 26(5):527–532

    Article  Google Scholar 

  13. Li X, Pang Y, Yuan Y (2010) L1-norm-based 2DPCA. IEEE Trans Syst Man Cybern Part B (Cybern) 40(4):1170–1175

    Article  Google Scholar 

  14. Martínez A, Benavente R (1998) The AR face database. Computer Vision Center, Bellatera

    Google Scholar 

  15. Meng J, Zheng X (2013) Robust sparse 2D principal component analysis for object recognition. Appl Math Inf Sci 7(6):2509–2514

    Article  Google Scholar 

  16. Nakouri H, Limam M (2015) Incremental generalized low rank approximation of matrices for visual learning and recognition. Pattern Recognit Image Anal 25(1):68–72

    Article  Google Scholar 

  17. Nakouri H, El-Aroui MA, Limam M (2017) Robust low-rank approximation of images for background and foreground separation. In: Proceedings of the 18th international conference on parallel and distributed computing, applications and technologies, Taipei, Taiwan, pp 196–203

  18. Phillips PJ, Wechsler H, Huang J, Rauss PJ (1998) The FERET database and evaluation procedure for face-recognition algorithms. Image Vis Comput 16(5):295–306

    Article  Google Scholar 

  19. Peng H, Li B, Ling H, Hu W, Xiong W, Maybank SJ (2017) Salient object detection via structured matrix decomposition. IEEE Trans Pattern Anal Mach Intell 39(4):818–832

    Article  Google Scholar 

  20. Rouabhia C, Tebbikh H (2011) Efficient face recognition based on weighted matrix distance metrics and 2DPCA algorithm. Arch Control Sci 21(2):207–221

    MathSciNet  Google Scholar 

  21. Samaria F, Harter A (1994) Parameterisation of a stochastic model for human face identification. In: Proceedings of the IEEE workshop on applications of computer vision, pp 138–142

  22. Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86

    Article  Google Scholar 

  23. Visani M, Garcia C, Jolion JM (2004) Two-dimensional-oriented linear discriminant analysis for face recognition. In: Proceedings of the international conference on computer vision and graphics, pp 1008–1017

  24. Wahyuningrum RT, Damayanti F (2012) Efficient kernel-based two-dimensional principal component analysis for smile stages recognition. Telkomnika 10(1):113–118

    Article  Google Scholar 

  25. Wang Q, Qin Z, Nie F, Yuan Y (2017) Convolutional 2D LDA for nonlinear dimensionality reduction. In: Proceedings of the 26th international joint conference on artificial intelligence, pp 2929–2935

  26. Xiao X, Zhou Y (2019) Two-dimensional quaternion PCA and sparse PCA. IEEE Trans Neural Netw Learn Syst 30(7):2028–2042

    Article  Google Scholar 

  27. Yang J, Zhang D, Frangi AF, Yan J (2004) Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans Pattern Anal Mach Intell 26(1):131–137

    Article  Google Scholar 

  28. Ye J (2005) Generalized low rank approximations of matrices. Mach Learn 61(1):167–191

    Article  Google Scholar 

  29. Zare A, Ozdemir A, Iwen MA, Aviyente S (2018) Extension of PCA to higher order data structures: an introduction to tensors. Tensor Decompos Tensor PCA 106(8):1341–1358

    Google Scholar 

  30. Zhang Y, Qi MX, Shang L (2012) Palmprint recognition based on two-dimensional gabor wavelet transform and two-dimensional principal component analysis. In: Advanced intelligent computing. Springer, Berlin, pp 405–411

  31. Zhang H, Wu QMJ, Chow TWS, Zhao M (2012) A two-dimensional neighborhood preserving projection for appearance based face recognition. Pattern Recognit 45(5):1866–1876

    Article  Google Scholar 

  32. Zhang QR (2014) Two-dimensional parameter principal component analysis for face recognition. Adv Mater Res 971–973:1838–1842

    Article  Google Scholar 

  33. Zheng WS, Lai JH, Li SZ (2008) 1D-LDA vs. 2D-LDA: when is vector-based linear discriminant analysis better than matrix-based? Pattern Recognit 41(7):2156–2172

    Article  Google Scholar 

  34. Zheng H, Pan L (2012) An improved block 2DPCA face recognition algorithm with L1-norm. Adv Mater Res 1639(457):1077–1082

    Article  Google Scholar 

  35. Zhao M, Jia Z, Cai Y, Chen X, Gong D (2019) Advanced variations of two-dimensional principal component analysis for face recognition. Preprint submitted to Elsevier

  36. Zhu M, Martinez AM (2006) Subclass discriminant analysis. IEEE Trans Pattern Anal Mach Intell 27(8):1274–1286

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institut Supérieur de Gestion, LARODEC, Université de Tunis, Tunis, Tunisia

    Haïfa Nakouri

  2. Ecole Supérieure de l’Economie Numérique, Université de la Manouba, Manouba, Tunisia

    Haïfa Nakouri

Authors
  1. Haïfa Nakouri
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Haïfa Nakouri.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nakouri, H. Two-dimensional Subclass Discriminant Analysis for face recognition. Pattern Anal Applic 24, 109–117 (2021). https://doi.org/10.1007/s10044-020-00905-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10044-020-00905-5

Keywords

Search

Navigation