Abstract
Image restoration problem is often solved by minimizing a cost function which consists of data-fidelity terms and regularization terms. Half-quadratic regularization has the advantage that it can preserve image details well in the recovered images. In this paper, we consider solving the image restoration model which involves multiplicative half-quadratic regularization term. Newton method is employed to solve the nonlinear system of equations resulted from the optimization problem for image restoration. At each Newton iteration step, a linear system of equations with symmetric positive definite coefficient matrix arises. The preconditioned conjugate gradient method with the proposed modified block SSOR (symmetric successive over-relaxation) preconditioner is applied to solve this linear system of equations. The condition number of the preconditioned matrix is estimated and numerical experiments are also implemented for image restoration. Both theoretical and numerical results show that the modified block SSOR preconditioned PCG methods can greatly improve the computation efficiency when solving the multiplicative half-quadratic regularized image restoration problem.
Similar content being viewed by others
References
Allain, M., Idier, J., Goussard, Y.: On global and local convergence of half-quadratic algorithms. IEEE Trans. Image Process. 15, 1130–1142 (2006)
Axelsson, O.: Iterative Solution Methods. Cambridge University Press, Cambridge (1994)
Axelsson, O., Gustafsson, I.: Preconditioning and two-level multigrid methods of arbitrary degree of approximation. Math. Comput. 40, 219–242 (1983)
Bai, Z.-Z.: A class of modified block SSOR preconditioners for symmetric positive definite systems of linear equations. Adv. Comput. Math. 10, 169–186 (1999)
Bai, Z.-Z.: Modified block SSOR preconditioners for symmetric positive definite linear systems. Ann. Oper. Res. 103, 263–282 (2001)
Bai, Z.-Z.: Parallel Iterative Methods for Large-Scale Systems of Algebraic Equations. Ph. D. Thesis. Shanghai University of Science and Technology. Shanghai. June (1993) (In Chinese)
Bai, Z.-Z.: A class of hybrid algebraic multilevel preconditioning methods. Appl. Numer. Math. 19, 389–399 (1996)
Bai, Z.-Z.: Parallel hybrid algebraic multilevel iterative methods. Linear Algebra Appl. 267, 281–315 (1997)
Bai, Z.-Z., Huang, Y.-M., Ng, M.K.: Block-triangular preconditioners for systems arising from edge-preserving image restoration. J. Comput. Math. 28, 848–863 (2010)
Bai, Z.-Z., Huang, Y.-M., Ng, M.K., Yang, X.: Preconditioned iterative methods for algebraic systems from multiplicative half-quadratic regularization image restorations. Numer. Math. Theor. Methods Appl. 3, 461–474 (2010)
Bai, Z.-Z., Wang, D.-R.: A class of new hybrid algebraic multilevel preconditioning methods. Linear Algebra Appl. 260, 223–255 (1997)
Banham, M.R., Katsaggelos, A.K.: Digital image restoration. IEEE Signal Proc. Mag. 14, 24–41 (1997)
Chan, R.H., Chan, T.F., Wong, C.K.: Cosine transform based preconditioners for total variation deblurring. IEEE Trans. Image Process. 8, 1472–1478 (1999)
Charbonnier, P., Blanc-Féraud, L., Aubert, G., Barlaud, M.: Two deterministic half-quadratic regularization algorithms for computed imaging. In: Proceedings of 1994 IEEE ICIP. 2, 168–172 (1994)
Charbonnier, P., Blanc-Féraud, L., Aubert, G., Barlaud, M.: Deterministic edge-preserving regularization in computed imaging. IEEE Trans. Image Process. 6, 298–311 (1997)
Geman, D., Reynolds, G.: Constrained restoration and the recovery of discontinuities. IEEE Trans. Pattern Anal. Mach. Intell. 14, 367–383 (1992)
Geman, D., Yang, C.: Nonlinear image recovery with half-quadratic regularization. IEEE Trans. Image Process. 4, 932–946 (1995)
Golub, G.H., Van Loan, C.F.: Matrix Computations, 3rd edn. The Johns Hopkins University Press, Baltimore (1996)
Hansen, P.C., Nagy, J.G., O’Leary, D.P.: Deblurring Images: Matrices, Spectra, and Filtering. SIAM, Philadelphia (2006)
Huang, Y.-M., Lu, D.-Y.: A preconditioned conjugate gradient method for multiplicative half-quadratic image restoration. Appl. Math. Comput. 219, 6556–6564 (2013)
Idier, J.: Convex half-quadratic criteria and interacting auxiliary variables for image restoration. IEEE Trans. Image Process. 10, 1001–1009 (2001)
Ng, M.K.: Iterative Methods for Toeplitz Systems. Oxford University Press, New York (2004)
Ng, M.K., Chan, R.H., Tang, W.-C.: A fast algorithm for deblurring models with Neumann boundary conditions. SIAM J. Sci. Comput. 21, 851–866 (1999)
Nikolova, M., Ng, M.K.: Fast image reconstruction algorithms combining half-quadratic regularization and preconditioning. In: Proceedings of 2001 IEEE ICIP. 1, 277–280 (2001)
Nikolova, M., Ng, M.K.: Comparison of the main forms of half-quadratic regularization. In: Proceedings of 2002 IEEE ICIP. 1, 349–352 (2002)
Nikolova, M., Ng, M.K.: Analysis of half-quadratic minimization methods for signal and image recovery. SIAM J. Sci. Comput. 27, 937–966 (2005)
Ortega, J.M.: Introduction to Parallel and Vector Solution of Linear Systems. Plenum Press, New York (1988)
Wang, D.-R., Bai, Z.-Z.: Parallel multilevel iterative methods. Linear Algebra Appl. 250, 317–347 (1997)
Acknowledgements
This work is supported by the National Natural Science Foundation of China Nos. 11971215 and 11971214, the Key Laboratory of Applied Mathematics and Complex Systems of Lanzhou University, MOE-LCSM, School of Mathematics and Statistics, Hunan Normal University, Changsha, Hunan 410081, P. R. China.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhao, PP., Huang, YM. Conjugate gradient method preconditioned with modified block SSOR iteration for multiplicative half-quadratic image restoration. Calcolo 57, 31 (2020). https://doi.org/10.1007/s10092-020-00379-1
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10092-020-00379-1