Abstract
Purpose
The morphological characteristics of retinal vessels are vital for the early diagnosis of pathological diseases such as diabetes and hypertension. However, the low contrast and complex morphology pose a challenge to automatic retinal vessel segmentation. To extract precise semantic features, more convolution and pooling operations are adopted, but some structural information is potentially ignored.
Methods
In the paper, we propose a novel lightweight pyramid network (LPN) fusing multi-scale features with spatial attention mechanism to preserve the structure information of retinal vessels. The pyramid hierarchy model is constructed to generate multi-scale representations, and its semantic features are strengthened with the introduction of the attention mechanism. The combination of multi-scale features contributes to its accurate prediction.
Results
The LPN is evaluated on benchmark datasets DRIVE, STARE and CHASE, and the results indicate its state-of-the-art performance (e.g., ACC of 97.09\(\%\)/97.49\(\%\)/97.48\(\%\), AUC of 98.79\(\%\)/99.01\(\%\)/98.91\(\%\) on the DRIVE, STARE and CHASE datasets, respectively). The robustness and generalization ability of the LPN are further proved in cross-training experiment.
Conclusion
The visualization experiment reveals the semantic gap between various scales of the pyramid and verifies the effectiveness of the attention mechanism, which provide a potential basis for the pyramid hierarchy model in multi-scale vessel segmentation task. Furthermore, the number of model parameters is greatly reduced.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Wong TY, Klein R, Klein BE, Tielsch JM, Hubbard L, Nieto F (2001) Retinal microvascular abnormalities and their relationship with hypertension, cardiovascular disease, and mortality. Surv phthal 46(1):59–80
Nguyen TT, Wong TY (2009) Retinal vascular changes and diabetic retinopathy. Current Diabet Rep 9(4):277–283
Figueiredo IN, Moura S, Neves JS, Pinto L, Kumar S, Oliveira CM, Ramos JD (2016) Automated retina identification based on multiscale elastic registration. Comput Biol Med 79:130–143. https://doi.org/10.1016/j.compbiomed.2016.09.019
Martínez-Pérez ME, Hughes AD, Stanton AV, Thom SA, Bharath AA, Parker KH (1999) Retinal blood vessel segmentation by means of scale-space analysis and region growing. In: Medical Image Computing and Computer-Assisted Intervention—MICCAI’99, pp 90–97
Al-Diri B, Hunter A, Steel D (2009) An active contour model for segmenting and measuring retinal vessels. IEEE Trans Med Imag 28(9):1488–1497
Mendonca AM, Campilho A (2006) Segmentation of retinal blood vessels by combining the detection of centerlines and morphological reconstruction. IEEE Trans Med Imag 25(9):1200–1213
Lupascu CA, Tegolo D, Trucco E (2010) Fabc: Retinal vessel segmentation using adaboost. IEEE Trans Inf Technol Biomed 14(5):1267–1274
Orlando JI, Blaschko M (2014) Learning fully-connected crfs for blood vessel segmentation in retinal images. Med Image Comput Comput Assist Intervent ICCAI 2014:634–641
Liskowski P, Krawiec K (2016) Segmenting retinal blood vessels with deep neural networks. IEEE Trans Med Imag 35(11):2369–2380
Li Q, Feng B, Xie L, Liang P, Zhang H, Wang T (2016) A cross-modality learning approach for vessel segmentation in retinal images. IEEE Trans Med Imag 35(1):109–118
Fu H, Xu Y, Lin S, Kee Wong DW, Liu J (2016) Deepvessel: Retinal vessel segmentation via deep learning and conditional random field. Med Image Comput Comput Assist Intervent ICCAI 2016:132–139
Wu Y, Xia Y, Song Y, Zhang D, Liu D, Zhang C, Cai W (2019) Vessel-net: Retinal vessel segmentation under multi-path supervision. Med Image Comput Comput Assist Intervent ICCAI 2019:264–272
Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. Med Image Comput Comput Assist Intervent ICCAI 2015:234–241
Zhang S, Fu H, Yan Y, Zhang Y, Wu Q, Yang M, Tan M, Xu Y (2019) Attention guided network for retinal image segmentation. Med Image Comput Comput Assist Intervent ICCAI 2019:797–805
Jin Q, Meng Z, Pham TD, Chen Q, Wei L, Su R (2018) Dunet: A deformable network for retinal vessel segmentation. arXiv:1811.01206v1
Chen L, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2018) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFS. IEEE Trans Pattern Anal Mach Intell 40(4):834–848. https://doi.org/10.1109/TPAMI.2017.2699184
Gu Z, Cheng J, Fu H, Zhou K, Hao H, Zhao Y, Zhang T, Gao S, Liu J (2019) Ce-net: Context encoder network for 2d medical image segmentation. IEEE Trans Med Imag 38(10):2281–2292. https://doi.org/10.1109/TMI.2019.2903562
Wang W, Zhong J, Wu H, Wen Z, Qin J (2020) Rvseg-net: An efficient feature pyramid cascade network for retinal vessel segmentation. In: Medical Image Computing and Computer Assisted Intervention—MICCAI 2020
Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, Berg AC (2016) Ssd: Single shot multibox detector. ECCV 2016:21–37
Lin T, Dollár P, Girshick R, He K, Hariharan B, Belongie S (2017) Feature pyramid networks for object detection. CVPR 2017:936–944
Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: CVPR 2017:2261–2269
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. CVPR 2016:770–778
Staal J, Abramoff MD, Niemeijer M, Viergever MA, van Ginneken B (2004) Ridge-based vessel segmentation in color images of the retina. IEEE Trans Med Imag 23(4):501–509
Hoover AD, Kouznetsova V, Goldbaum M (2000) Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response. IEEE Trans Med Imag 19(3):203–210
Owen CG, Rudnicka AR, Mullen R, Barman SA, Monekosso D, Whincup PH, Ng J, Paterson C (2009) Measuring retinal vessel tortuosity in 10-year-old children: validation of the computer-assisted image analysis of the retina (caiar) program. Invest Ophthal Visual Sci 50(5):2004–2010
Setiawan AW, Mengko TR, Santoso OS, Suksmono AB (2013) Color retinal image enhancement using clahe. In: International Conference on ICT for Smart Society, pp 1–3
Wu Y, Xia Y, Song Y, Zhang Y, Cai W (2018) Multiscale network followed network model for retinal vessel segmentation. Med Image Comput Comput Assist Intervent MICCAI 2018:119–126
Tharwat A (2020) Classification assessment methods. Appl Comput Inf
Yan Z, Yang X, Cheng K (2018) Joint segment-level and pixel-wise losses for deep learning based retinal vessel segmentation. IEEE Trans Biomed Eng 65(9):1912–1923
Fraz MM, Remagnino P, Hoppe A, Uyyanonvara B, Rudnicka AR, Owen CG, Barman SA (2012) An ensemble classification-based approach applied to retinal blood vessel segmentation. IEEE Trans Biomed Eng 59(9):2538–2548
Funding
This work was supported by the National Key Scientific Instrument and Equipment Development Projects of China No. 81527802.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare no conflict of interest.
Ethical approval
This article does not contain any studies with human participants performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Tan, T., Wang, Z., Du, H. et al. Lightweight pyramid network with spatial attention mechanism for accurate retinal vessel segmentation. Int J CARS 16, 673–682 (2021). https://doi.org/10.1007/s11548-021-02344-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11548-021-02344-x