Abstract
The class of quaternion matrix optimization (QMO) problems, with quaternion matrices as decision variables, has been widely used in color image processing and other engineering areas in recent years. However, optimization theory for QMO is far from adequate. The main objective of this paper is to provide necessary theoretical foundations on optimality analysis, in order to enrich the contents of optimization theory and to pave way for the design of efficient numerical algorithms as well. We achieve this goal by conducting a thorough study on the first-order and second-order (sub)differentiation of real-valued functions in quaternion matrices, with a newly introduced operation called R-product as the key tool for our calculus. Combining with the classical optimization theory, we establish the first-order and the second-order optimality analysis for QMO. Particular treatments on convex functions, the \(\ell _0\)-norm and the rank function in quaternion matrices are tailored for a sparse low rank QMO model, arising from color image denoising, to establish its optimality conditions via stationarity.
Similar content being viewed by others
Data Availability Statement
The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.
References
Attouch, H., Bolte, J., Svaiter, B.F.: Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods. Math. Program. 137, 91–129 (2013)
Beck, A., Eldar, Y.C.: Sparsity constrained nonlinear optimization: optimality conditions and algorithms. SIAM J. Optim. 23, 1480–1509 (2013)
Bertsekas, D.: Nonlinear Programming, \(2\)nd edition. Athena Scientific, Belmont, MA (1999)
Chen, Y., Qi, L., Zhang, X., Xu, Y.: A low rank quaternion decomposition algorithm and its application in color image inpainting, arXiv:2009.12203, (2020)
Chen, Y., Xiao, X., Zhou, Y.: Low-rank quaternion approximation for color image processing. IEEE Trans. Image Process. 29, 1057–7149 (2019)
Clarke, F.H.: Optimization and Nonsmooth Analysis. Wiley, Newyork (1983)
Hiriart-Urruty, J.-B., Le, H.Y.: From Eckart and Young approximation to Moreau envelopes and vice versa. RAIRO Oper. Res. 47, 299–310 (2013)
Hiriart-Urruty, J.-B., Le, H.Y.: A varitational approach of the rank function. TOP 21, 207–240 (2013)
Jia, Z., Ng, M.K., Song, G.: Robust quaternion matrix completion with applications to image inpaiting. Numer. Linear Algebra Appl. 26, e2245 (2019)
Le, H.Y.: Generalized subdifferentials of the rank function. Optim. Lett. 7, 731–743 (2013)
Le Bihan, N., Sangwine, S.J.: Quaternion principal component analysis of color images. IEEE Int. Conf. Image Process. 1, 809–812 (2003)
Li, X., Xie, N., Song, W.: Optimality conditions for rank-constrained matrix optimzation. J. Oper. Res. Soc. China 7, 285–301 (2019)
Lu, Z., Zhang, Y., Li, X.: Penalty decomposition methods for rank minimization. Optim. Method Softw. 30, 531–558 (2015)
Mandic, D.P., Jahanchahi, C., Took, C.C.: A quaternion gradient operator and its applications. IEEE Signal Process. Lett. 18, 47–50 (2011)
Mordukhovich, B.S.: Variational Analysis and Generalized Differention I: Basis Theory. Springer, Berlin (2006)
Rockafellar, T.R., Wets, R.J.B.: Variational Analysis. Springer, Berlin (2009)
Sangwine, S.J.: Fourier transforms of colour images using quaternion or hypercomplex, numbers. Electron. Lett. 32, 1979–1980 (1996)
Sangwine, S.J., Le Bihan, N.: Quaternion singular value decomposition based on bidiagonalization to a real or complex matrix using quaternion Householder transformations. Appl. Math. Comput. 182, 727–738 (2006)
Xiao, X., Zhou, Y.: Two-dimensional quaternion pca and sparse PCA. IEEE Trans. Neural Netw. Learn. Syst. 30, 2028–2042 (2018)
Xu, D., Jahanchahi, C., Took, C.C., Mandic, D.P.: Enabling quaternion derivatives: the generalized HR calculus. Roy. Soc. Open Sci. 2, 150255 (2015)
Xu, Y., Yu, L., Xu, H., Zhang, H., Nguyen, T.: Vector sparse representation of color image using quaternion matrix analysis. IEEE Trans. Image Process. 24, 1315–1329 (2015)
Wei, M., Li, Y., Zhang, F., Zhao, J.: Quaternion matrix computations. Nova Science Publisher, New York (2018)
Zeng, R., Wu, J., Shao, Z., Chen, Y., Chen, B., Senhadji, L., Su, H.: Color image classification via quaternion principal component analysis network. Neurocomputing 216, 416–428 (2016)
Zhang, F.: Quaternions and matrices of quaternions. Linear Algebra Appl. 251, 21–57 (1997)
Zhou, S., Xiu, N., Qi, H.: Global and quadratic convergence of Newton hard-thresholding pursuit. J. Machine Learn. Res. 22, 1–45 (2021)
Zou, C., Kou, K.I., Wang, Y.: Quarernion collaborative and sparse representation with application to color face recognition. IEEE Trans. Image Process. 25, 3287–3302 (2016)
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Boris S. Mordukhovich.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Ziyan Luo’s work was supported by NSFC (Grant No. 11771038) and Beijing Natural Science Foundation (Grant No. Z190002).Qing-Wen Wang’s work was supported by NSFC (Grant No. 11971294). Xinzhen Zhang’s work was supported by NSFC (Grant No. 11871369). Dedicated to Professor Franco Giannessi on the occasion of his 85th Birthday.
Rights and permissions
About this article
Cite this article
Qi, L., Luo, Z., Wang, QW. et al. Quaternion Matrix Optimization: Motivation and Analysis. J Optim Theory Appl 193, 621–648 (2022). https://doi.org/10.1007/s10957-021-01906-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-021-01906-y