Skip to main content
Log in

Conjugate gradient method preconditioned with modified block SSOR iteration for multiplicative half-quadratic image restoration

  • Published:
Calcolo Aims and scope Submit manuscript

Abstract

Image restoration problem is often solved by minimizing a cost function which consists of data-fidelity terms and regularization terms. Half-quadratic regularization has the advantage that it can preserve image details well in the recovered images. In this paper, we consider solving the image restoration model which involves multiplicative half-quadratic regularization term. Newton method is employed to solve the nonlinear system of equations resulted from the optimization problem for image restoration. At each Newton iteration step, a linear system of equations with symmetric positive definite coefficient matrix arises. The preconditioned conjugate gradient method with the proposed modified block SSOR (symmetric successive over-relaxation) preconditioner is applied to solve this linear system of equations. The condition number of the preconditioned matrix is estimated and numerical experiments are also implemented for image restoration. Both theoretical and numerical results show that the modified block SSOR preconditioned PCG methods can greatly improve the computation efficiency when solving the multiplicative half-quadratic regularized image restoration problem.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Allain, M., Idier, J., Goussard, Y.: On global and local convergence of half-quadratic algorithms. IEEE Trans. Image Process. 15, 1130–1142 (2006)

    Article  Google Scholar 

  2. Axelsson, O.: Iterative Solution Methods. Cambridge University Press, Cambridge (1994)

    Book  Google Scholar 

  3. Axelsson, O., Gustafsson, I.: Preconditioning and two-level multigrid methods of arbitrary degree of approximation. Math. Comput. 40, 219–242 (1983)

    Article  MathSciNet  Google Scholar 

  4. Bai, Z.-Z.: A class of modified block SSOR preconditioners for symmetric positive definite systems of linear equations. Adv. Comput. Math. 10, 169–186 (1999)

    Article  MathSciNet  Google Scholar 

  5. Bai, Z.-Z.: Modified block SSOR preconditioners for symmetric positive definite linear systems. Ann. Oper. Res. 103, 263–282 (2001)

    Article  MathSciNet  Google Scholar 

  6. Bai, Z.-Z.: Parallel Iterative Methods for Large-Scale Systems of Algebraic Equations. Ph. D. Thesis. Shanghai University of Science and Technology. Shanghai. June (1993) (In Chinese)

  7. Bai, Z.-Z.: A class of hybrid algebraic multilevel preconditioning methods. Appl. Numer. Math. 19, 389–399 (1996)

    Article  MathSciNet  Google Scholar 

  8. Bai, Z.-Z.: Parallel hybrid algebraic multilevel iterative methods. Linear Algebra Appl. 267, 281–315 (1997)

    Article  MathSciNet  Google Scholar 

  9. Bai, Z.-Z., Huang, Y.-M., Ng, M.K.: Block-triangular preconditioners for systems arising from edge-preserving image restoration. J. Comput. Math. 28, 848–863 (2010)

    Article  MathSciNet  Google Scholar 

  10. Bai, Z.-Z., Huang, Y.-M., Ng, M.K., Yang, X.: Preconditioned iterative methods for algebraic systems from multiplicative half-quadratic regularization image restorations. Numer. Math. Theor. Methods Appl. 3, 461–474 (2010)

    Article  MathSciNet  Google Scholar 

  11. Bai, Z.-Z., Wang, D.-R.: A class of new hybrid algebraic multilevel preconditioning methods. Linear Algebra Appl. 260, 223–255 (1997)

    Article  MathSciNet  Google Scholar 

  12. Banham, M.R., Katsaggelos, A.K.: Digital image restoration. IEEE Signal Proc. Mag. 14, 24–41 (1997)

    Article  Google Scholar 

  13. Chan, R.H., Chan, T.F., Wong, C.K.: Cosine transform based preconditioners for total variation deblurring. IEEE Trans. Image Process. 8, 1472–1478 (1999)

    Article  Google Scholar 

  14. Charbonnier, P., Blanc-Féraud, L., Aubert, G., Barlaud, M.: Two deterministic half-quadratic regularization algorithms for computed imaging. In: Proceedings of 1994 IEEE ICIP. 2, 168–172 (1994)

  15. Charbonnier, P., Blanc-Féraud, L., Aubert, G., Barlaud, M.: Deterministic edge-preserving regularization in computed imaging. IEEE Trans. Image Process. 6, 298–311 (1997)

    Article  Google Scholar 

  16. Geman, D., Reynolds, G.: Constrained restoration and the recovery of discontinuities. IEEE Trans. Pattern Anal. Mach. Intell. 14, 367–383 (1992)

    Article  Google Scholar 

  17. Geman, D., Yang, C.: Nonlinear image recovery with half-quadratic regularization. IEEE Trans. Image Process. 4, 932–946 (1995)

    Article  Google Scholar 

  18. Golub, G.H., Van Loan, C.F.: Matrix Computations, 3rd edn. The Johns Hopkins University Press, Baltimore (1996)

    MATH  Google Scholar 

  19. Hansen, P.C., Nagy, J.G., O’Leary, D.P.: Deblurring Images: Matrices, Spectra, and Filtering. SIAM, Philadelphia (2006)

    Book  Google Scholar 

  20. Huang, Y.-M., Lu, D.-Y.: A preconditioned conjugate gradient method for multiplicative half-quadratic image restoration. Appl. Math. Comput. 219, 6556–6564 (2013)

    MathSciNet  MATH  Google Scholar 

  21. Idier, J.: Convex half-quadratic criteria and interacting auxiliary variables for image restoration. IEEE Trans. Image Process. 10, 1001–1009 (2001)

    Article  MathSciNet  Google Scholar 

  22. Ng, M.K.: Iterative Methods for Toeplitz Systems. Oxford University Press, New York (2004)

    MATH  Google Scholar 

  23. Ng, M.K., Chan, R.H., Tang, W.-C.: A fast algorithm for deblurring models with Neumann boundary conditions. SIAM J. Sci. Comput. 21, 851–866 (1999)

    Article  MathSciNet  Google Scholar 

  24. Nikolova, M., Ng, M.K.: Fast image reconstruction algorithms combining half-quadratic regularization and preconditioning. In: Proceedings of 2001 IEEE ICIP. 1, 277–280 (2001)

  25. Nikolova, M., Ng, M.K.: Comparison of the main forms of half-quadratic regularization. In: Proceedings of 2002 IEEE ICIP. 1, 349–352 (2002)

  26. Nikolova, M., Ng, M.K.: Analysis of half-quadratic minimization methods for signal and image recovery. SIAM J. Sci. Comput. 27, 937–966 (2005)

    Article  MathSciNet  Google Scholar 

  27. Ortega, J.M.: Introduction to Parallel and Vector Solution of Linear Systems. Plenum Press, New York (1988)

    Book  Google Scholar 

  28. Wang, D.-R., Bai, Z.-Z.: Parallel multilevel iterative methods. Linear Algebra Appl. 250, 317–347 (1997)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

This work is supported by the National Natural Science Foundation of China Nos. 11971215 and 11971214, the Key Laboratory of Applied Mathematics and Complex Systems of Lanzhou University, MOE-LCSM, School of Mathematics and Statistics, Hunan Normal University, Changsha, Hunan 410081, P. R. China.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yu-Mei Huang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, PP., Huang, YM. Conjugate gradient method preconditioned with modified block SSOR iteration for multiplicative half-quadratic image restoration. Calcolo 57, 31 (2020). https://doi.org/10.1007/s10092-020-00379-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10092-020-00379-1

Keywords

Mathematics Subject Classification

Navigation