Skip to main content
Log in

Quaternion Matrix Optimization: Motivation and Analysis

  • Published:
Journal of Optimization Theory and Applications Aims and scope Submit manuscript

Abstract

The class of quaternion matrix optimization (QMO) problems, with quaternion matrices as decision variables, has been widely used in color image processing and other engineering areas in recent years. However, optimization theory for QMO is far from adequate. The main objective of this paper is to provide necessary theoretical foundations on optimality analysis, in order to enrich the contents of optimization theory and to pave way for the design of efficient numerical algorithms as well. We achieve this goal by conducting a thorough study on the first-order and second-order (sub)differentiation of real-valued functions in quaternion matrices, with a newly introduced operation called R-product as the key tool for our calculus. Combining with the classical optimization theory, we establish the first-order and the second-order optimality analysis for QMO. Particular treatments on convex functions, the \(\ell _0\)-norm and the rank function in quaternion matrices are tailored for a sparse low rank QMO model, arising from color image denoising, to establish its optimality conditions via stationarity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Data Availability Statement

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Attouch, H., Bolte, J., Svaiter, B.F.: Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods. Math. Program. 137, 91–129 (2013)

    Article  MathSciNet  Google Scholar 

  2. Beck, A., Eldar, Y.C.: Sparsity constrained nonlinear optimization: optimality conditions and algorithms. SIAM J. Optim. 23, 1480–1509 (2013)

    Article  MathSciNet  Google Scholar 

  3. Bertsekas, D.: Nonlinear Programming, \(2\)nd edition. Athena Scientific, Belmont, MA (1999)

    Google Scholar 

  4. Chen, Y., Qi, L., Zhang, X., Xu, Y.: A low rank quaternion decomposition algorithm and its application in color image inpainting, arXiv:2009.12203, (2020)

  5. Chen, Y., Xiao, X., Zhou, Y.: Low-rank quaternion approximation for color image processing. IEEE Trans. Image Process. 29, 1057–7149 (2019)

    MathSciNet  Google Scholar 

  6. Clarke, F.H.: Optimization and Nonsmooth Analysis. Wiley, Newyork (1983)

    MATH  Google Scholar 

  7. Hiriart-Urruty, J.-B., Le, H.Y.: From Eckart and Young approximation to Moreau envelopes and vice versa. RAIRO Oper. Res. 47, 299–310 (2013)

  8. Hiriart-Urruty, J.-B., Le, H.Y.: A varitational approach of the rank function. TOP 21, 207–240 (2013)

    Article  MathSciNet  Google Scholar 

  9. Jia, Z., Ng, M.K., Song, G.: Robust quaternion matrix completion with applications to image inpaiting. Numer. Linear Algebra Appl. 26, e2245 (2019)

  10. Le, H.Y.: Generalized subdifferentials of the rank function. Optim. Lett. 7, 731–743 (2013)

    Article  MathSciNet  Google Scholar 

  11. Le Bihan, N., Sangwine, S.J.: Quaternion principal component analysis of color images. IEEE Int. Conf. Image Process. 1, 809–812 (2003)

    Google Scholar 

  12. Li, X., Xie, N., Song, W.: Optimality conditions for rank-constrained matrix optimzation. J. Oper. Res. Soc. China 7, 285–301 (2019)

  13. Lu, Z., Zhang, Y., Li, X.: Penalty decomposition methods for rank minimization. Optim. Method Softw. 30, 531–558 (2015)

  14. Mandic, D.P., Jahanchahi, C., Took, C.C.: A quaternion gradient operator and its applications. IEEE Signal Process. Lett. 18, 47–50 (2011)

    Article  Google Scholar 

  15. Mordukhovich, B.S.: Variational Analysis and Generalized Differention I: Basis Theory. Springer, Berlin (2006)

    Book  Google Scholar 

  16. Rockafellar, T.R., Wets, R.J.B.: Variational Analysis. Springer, Berlin (2009)

    MATH  Google Scholar 

  17. Sangwine, S.J.: Fourier transforms of colour images using quaternion or hypercomplex, numbers. Electron. Lett. 32, 1979–1980 (1996)

    Article  Google Scholar 

  18. Sangwine, S.J., Le Bihan, N.: Quaternion singular value decomposition based on bidiagonalization to a real or complex matrix using quaternion Householder transformations. Appl. Math. Comput. 182, 727–738 (2006)

    MathSciNet  MATH  Google Scholar 

  19. Xiao, X., Zhou, Y.: Two-dimensional quaternion pca and sparse PCA. IEEE Trans. Neural Netw. Learn. Syst. 30, 2028–2042 (2018)

  20. Xu, D., Jahanchahi, C., Took, C.C., Mandic, D.P.: Enabling quaternion derivatives: the generalized HR calculus. Roy. Soc. Open Sci. 2, 150255 (2015)

  21. Xu, Y., Yu, L., Xu, H., Zhang, H., Nguyen, T.: Vector sparse representation of color image using quaternion matrix analysis. IEEE Trans. Image Process. 24, 1315–1329 (2015)

    Article  MathSciNet  Google Scholar 

  22. Wei, M., Li, Y., Zhang, F., Zhao, J.: Quaternion matrix computations. Nova Science Publisher, New York (2018)

    Google Scholar 

  23. Zeng, R., Wu, J., Shao, Z., Chen, Y., Chen, B., Senhadji, L., Su, H.: Color image classification via quaternion principal component analysis network. Neurocomputing 216, 416–428 (2016)

    Article  Google Scholar 

  24. Zhang, F.: Quaternions and matrices of quaternions. Linear Algebra Appl. 251, 21–57 (1997)

    Article  MathSciNet  Google Scholar 

  25. Zhou, S., Xiu, N., Qi, H.: Global and quadratic convergence of Newton hard-thresholding pursuit. J. Machine Learn. Res. 22, 1–45 (2021)

    MathSciNet  MATH  Google Scholar 

  26. Zou, C., Kou, K.I., Wang, Y.: Quarernion collaborative and sparse representation with application to color face recognition. IEEE Trans. Image Process. 25, 3287–3302 (2016)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Liqun Qi.

Additional information

Communicated by Boris S. Mordukhovich.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Ziyan Luo’s work was supported by NSFC (Grant No. 11771038) and Beijing Natural Science Foundation (Grant No. Z190002).Qing-Wen Wang’s work was supported by NSFC (Grant No. 11971294). Xinzhen Zhang’s work was supported by NSFC (Grant No. 11871369). Dedicated to Professor Franco Giannessi on the occasion of his 85th Birthday.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Qi, L., Luo, Z., Wang, QW. et al. Quaternion Matrix Optimization: Motivation and Analysis. J Optim Theory Appl 193, 621–648 (2022). https://doi.org/10.1007/s10957-021-01906-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10957-021-01906-y

Keywords

Navigation