Skip to main content
Log in

A variational level set model with closed-form solution for bimodal image segmentation

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this work, we present a variational level set model with closed–form solution via combining with the fuzzy clustering method for robust and efficient image segmentation. For the designed energy functional, the two region parameters are first quickly pre–computed by means of the fuzzy c–means method and then embedded into a variational binary level set framework. Unlike the traditional variational level set models and optimization algorithms, our proposed model could directly obtain an exact closed–form solution of the level set function without using any iterative calculations and it is thus the globally optimal solution. Furthermore, we investigate the closed–form formula and achieve a significant property of the solution. As a byproduct, the manual initialization of the level set function and the sophisticated setting of time step in the process of numerical implementation are completely eliminated and thus leads to more robust segmentation results. Numerical experiments on both synthetic and real images verify the theoretical analysis of the proposed model and confirm the segmentation performance of the proposed method in terms of efficiency, accuracy and insensitiveness to parameters tuning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Bezdek J C, Ehrlich R, Full W (1984) FCM: The Fuzzy c–means clustering algorithm. Comput Geosci 10(2-3):191–203

    Article  Google Scholar 

  2. Bresson X, Esedoglu S, Vandergheynst P, Osher S (2007) Fast global minimization of the active contour/snake model. J Math Imaging Vis 28:151–167

    Article  MathSciNet  Google Scholar 

  3. Brown E, Chan T, Bresson X (2012) Completely convex formulation of the Chan–Vese image segmentation model. Int J Comput Vis 98(1):103–121

    Article  MathSciNet  Google Scholar 

  4. Chan T, Vese L Active contours without edges. IEEE Trans. Image Process 10(2):266–277

  5. Chan T, Esedoglu S, Nikolova M (2006) Algorithm for finding global minimizers of image segmentation and denoising models. SIMA J Appl Math 66 (5):1632–1648

    Article  MathSciNet  Google Scholar 

  6. Dong X, Shen J, Shao L et al (2015) Sub–Markov random walk for image segmentation. IEEE Trans Image Process 25(2):516–527

  7. Dong X, Shen J, Shao L et al (2015) Interactive cosegmentation using global and local energy optimization. IEEE Trans Image Process 24(11):3966–3977

  8. Fang J, Liu H, Liu J et al (2020) Fuzzy region–based active contour driven by global and local fitting energy for image segmentation. Appl Soft Comput:106982

  9. Felzenszwalb P F, Huttenlocher D P (2004) Efficient Graph-Based image segmentation. Int J Comput Vis 59(2):167–181

    Article  Google Scholar 

  10. Gong M, Tian D, Su L, Jiao L (2015) An efficient bi–convex fuzzy variational image segmentation method. Inform Sci 293(1):351–369

    Article  Google Scholar 

  11. Jin R, Weng G (2019) Active contour model based on improved fuzzy c–means algorithm and adaptive functions. Comput Math Appl 78(111):3678–3691

    Article  MathSciNet  Google Scholar 

  12. Kass M, Witkin A, Terzopoulos D (1988) Snakes: active contour models. Int J Comput Vis 1:321–331

    Article  Google Scholar 

  13. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Proc Adv Neural Inf Process Syst 1097–1105

  14. Lee S, Seo J (2006) Level set-based bimodal segmentation with stationary global minimum. IEEE Trans Image Process 15:2843–2852

    Article  MathSciNet  Google Scholar 

  15. Li C, Kao C, Gore J, Ding Z (2008) Minimization of region–scalable fitting energy for image segmentation. IEEE Trans Image Process 17 (10):1940–1949

    Article  MathSciNet  Google Scholar 

  16. Li C, Huang R, Ding Z, et al. (2011) A level set method for image segmentation in the presence of intensity inhomogeneities with application to MRI. IEEE Trans Image Process 20(7):2007–2016

    Article  MathSciNet  Google Scholar 

  17. Li Y, Kim J (2012) An unconditionally stable numerical method for bimodal image segmentation. Appl Math Comput 219:3083–3090

    MathSciNet  MATH  Google Scholar 

  18. Liang Y, Shen J, Dong X et al (2016) Video supervoxels using partially absorbing random walks. IEEE Trans Circ Syst Video Technol 26(5):928–938

  19. Liang Y, Shen J (2019) Local semantic siamese networks for fast tracking. IEEE Trans Image Process 29:3351–3364

  20. Lie J, Lysaker M, Tai X C (2006) A binary level set model and some applications for Mumford–Shah image segmentation. IEEE Trans Image Process 15 (5):1171–1181

    Article  Google Scholar 

  21. Liu Y, He C, Gao P, Wu Y, et al. (2019) A binary level set variational model with l1 data term for image segmentation. Signal Process 155:193–201

    Article  Google Scholar 

  22. Liu J, Sun S, Chen Y (2019) A novel region–based active contour model based on kernel function for image segmentation. Multimed Tools Appl 78:33659–33677

    Article  Google Scholar 

  23. Lu X, Wang W, Ma C et al (2019) See more, know more: Unsupervised video object segmentation with co-attention siamese networks. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) 3623–3632

  24. Lu X, Wang W, Shen J et al (2020) Learning Video Object Segmentation from Unlabeled Videos. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 8960–8970

  25. Macqueen J (1967)) Some methods for classification and analysis of multivariate observations. in Fifth Berkeley Symposium on Mathematical Statistics and Probability. The University of California, Berkeley

  26. Mondal A, Ghosh S, Ghosh A (2016) Robust global and local fuzzy energy based active contour for image segmentation. Appl Soft Comput 47:191–215

  27. Mumford D, Shah J (1989) Optimal approximation by piecewise smooth functionals and associated variational problems. Commun. Pure Appl. Math. 42 (5):577–685

    Article  Google Scholar 

  28. Osher S, Sethian J (1988) Fronts propagating with curvature dependent speed: algorithms based on Hamilton–Jacobi formulation. J Comput Phys 79:12–49

    Article  MathSciNet  Google Scholar 

  29. Peng J, Shen J, Li X (2016) High–order energies for stereo segmentation. IEEE Trans Cybern 46(7):1616–1627

  30. Shen J, Peng J, Shao L (2018) Submodular trajectories for better motion segmentation in videos. IEEE Trans Image Process 27(6):2688–2700

  31. Shen J, Dong X, Peng J et al (2019) Submodular function optimization for motion clustering and image segmentation. IEEE Trans Neural Netw Learn Syst 30(9):2637–2649

  32. Shen J, Hao X, Liang Z et al (2016) Real–time superpixel segmentation by DBSCAN clustering algorithm. IEEE Trans Image Process 25(12):5933–5942

  33. Shen J, Du Y, Wang W et al (2014) Lazy random walks for superpixel segmentation. IEEE Trans Image Process 23(4):1451–1462

  34. Shen J, Du Y, Li X (2014) Interactive segmentation using constrained Laplacian optimization. IEEE Trans Circ Syst Video Technol 24(7):1088–1100

  35. Shen J, Peng J, Dong X et al (2017) Higher order energies for image segmentation. IEEE Trans Image Process 26(10):4911–4922

  36. Venkatesh Y V, Rishikesh N (2000) Self–organizing neural networks based on spatial isomorphism for active contour modeling. Pattern Recogn 33 (7):1239–1250

    Article  Google Scholar 

  37. Wang Y, He C (2013) An adaptive level set evolution equation for contour extraction. Appl Math Comput 219(24):11420–11429

    MathSciNet  MATH  Google Scholar 

  38. Wen W, He C, Zhang Y, Fang Z (2017) A novel method for image segmentation using reaction–diffusion model. Multidim Syst Sign Process 28(2):657–677

    Article  Google Scholar 

  39. Wu Y, Liu X, Zhou D, Liu Y (2019) Adaptive active contour model driven by image data field for image segmentation with flexible initialization. Multimed Tools Appl 78:33633–33658

  40. Wu Y, He C (2015) A convex variational level set model for image segmentation. Signal Process 106:123–133

    Article  Google Scholar 

  41. Wu Y, Li M, Zhang Q, Liu Y (2018) A Retinex modulated piecewise constant variational model for image segmentation and bias correction. Appl Math Modelx 54:697–709

    Article  MathSciNet  Google Scholar 

  42. Wang W, Shen J, Shao L (2017) Video salient object detection via fully convolutional networks. IEEE Trans Image Process 27(1):38–49

  43. Wang W, Shen J (2017) Deep visual attention prediction. IEEE Trans Image Process 27(5):2368–2378

  44. Wang W, Lu X, Shen J et al (2019) Zero–shot video object segmentation via attentive graph neural networks. Proceedings of the IEEE international conference on computer vision (ICCV) 9236–9245

  45. Zhang K, Zhang L, Song H, Zhou W (2010) Active contours with selective local or global segmentation: a new formulation and level set method. Image Vis Comput 28(4):668–676

    Article  Google Scholar 

  46. Zhang H, Tang L, He C (2019) A variational level set model for multiscale image segmentation. Inform Sci 493:152–175

    Article  MathSciNet  Google Scholar 

  47. Zhu J, Zeng Y, Xu H et al (2020) Maximum a posterior based level set approach for image segmentation with intensity inhomogeneity. Signal Process:107896

Download references

Acknowledgments

The authors gratefully thank the editors and the anonymous reviewers for their valuable comments and helpful suggestions. This work was supported in part by the National Natural Science Foundation of China under Grant No. 61901292, the Natural Science Foundation of Shanxi Province, China under Grant No. 201801D221186 and Grant No. 201901D211080.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yongfei Wu.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix A

Appendix A

Proof of Theorem 1

Proof

m,n > 0 with m + n = 1. For given \({\phi _{1}}, {\phi _{2}} \in {L^{2}}\left ({\varOmega } \right )\) and ϕ1ϕ2, we have

$$ \begin{array}{@{}rcl@{}} {\left( {m{\phi_{1}} + n{\phi_{2}} + 1} \right)^{2}} &=& {\left( {m\left( {{\phi_{1}} + 1} \right) + n\left( {{\phi_{2}} + 1} \right)} \right)^{2}} \\ &=& {m^{2}}{\left( {{\phi_{1}} + 1} \right)^{2}} + {n^{2}}{\left( {{\phi_{2}} + 1} \right)^{2}} + 2mn\left( {{\phi_{1}} + 1} \right)\left( {{\phi_{2}} + 1} \right) \\ &<& {m^{2}}{\left( {{\phi_{1}} + 1} \right)^{2}} + {n^{2}}{\left( {{\phi_{2}} + 1} \right)^{2}} + mn\left( {{{\left( {{\phi_{1}} + 1} \right)}^{2}} + {{\left( {{\phi_{2}} + 1} \right)}^{2}}} \right) \\ &=& m\left( {m + n} \right){\left( {{\phi_{1}} + 1} \right)^{2}} + n\left( {n + m} \right){\left( {{\phi_{2}} + 1} \right)^{2}} \\ &=& m{\left( {{\phi_{1}} + 1} \right)^{2}} + n{\left( {{\phi_{2}} + 1} \right)^{2}}. \end{array} $$
(20)

Analogous with (20), we obtain

$$ \begin{array}{@{}rcl@{}} {\left( {m{\phi_{1}} + n{\phi_{2}} - 1} \right)^{2}}& =& {\left( {m\left( {{\phi_{1}} - 1} \right) + n\left( {{\phi_{2}} - 1} \right)} \right)^{2}} \\ &<& m{\left( {{\phi_{1}} - 1} \right)^{2}} + n{\left( {{\phi_{2}} - 1} \right)^{2}}. \end{array} $$
(21)

combining (20) and (21), we get the relation

$$ E\left( {m{\phi_{1}} + n{\phi_{2}}} \right) < mE\left( {{\phi_{1}}} \right) + nE\left( {{\phi_{2}}} \right). $$

Hence, \(E\left (\phi \right )\) is strictly convex in \({L^{2}}\left ({\varOmega } \right )\). The proof is completed. □

Proof of Theorem 2

Proof

According to Theorem 1, we know that the proposed energy functional (13) has unique global minimum ϕ. Therefore, we from the expression (16) can directly derive the following relation:

$$ {\lambda_{1}}{\left( {I - {m_{1}}} \right)^{2}}\left( {{\phi^{*}} + 1} \right) + {\lambda_{2}}{\left( {I - {m_{2}}} \right)^{2}}\left( {{\phi^{*}} - 1} \right) = 0. $$
(22)

Then we get the closed–form solution by explicitly solving the (22) as follows:

$$ {\phi^{*}} = - \frac{{{\lambda_{1}}{{\left( {I - {m_{1}}} \right)}^{2}} - {\lambda_{2}}{{\left( {I - {m_{2}}} \right)}^{2}}}}{{{\lambda_{1}}{{\left( {I - {m_{1}}} \right)}^{2}} + {\lambda_{2}}{{\left( {I - {m_{2}}} \right)}^{2}}}}. $$
(23)

At the meantime, we can obtain the following relation

$$ \begin{array}{@{}rcl@{}} \left| {{\phi^{*}}} \right| &=& \left| { - \frac{{{\lambda_{1}}{{\left( {I - {m_{1}}} \right)}^{2}} - {\lambda_{2}}{{\left( {I - {m_{2}}} \right)}^{2}}}}{{{\lambda_{1}}{{\left( {I - {m_{1}}} \right)}^{2}} + {\lambda_{2}}{{\left( {I - {m_{2}}} \right)}^{2}}}}} \right| \\ &\le & \frac{{{\lambda_{1}}\left| {{{\left( {I - {m_{1}}} \right)}^{2}}} \right| + {\lambda_{2}}\left| {{{\left( {I - {m_{2}}} \right)}^{2}}} \right|}}{{{\lambda_{1}}\left| {{{\left( {I - {m_{1}}} \right)}^{2}}} \right| + {\lambda_{2}}\left| {{{\left( {I - {m_{2}}} \right)}^{2}}} \right|}} \\ &= & 1. \end{array} $$
(24)

This completes the proof. □

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wu, Y., Liu, X., Gao, P. et al. A variational level set model with closed-form solution for bimodal image segmentation. Multimed Tools Appl 80, 25943–25963 (2021). https://doi.org/10.1007/s11042-021-10926-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10926-9

Keywords

Navigation