Skip to main content
Log in

Application of an attention U-Net incorporating transfer learning for optic disc and cup segmentation

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Optic disc (OD) and optic cup (OC) regional parameters are of utmost importance in the early diagnosis of glaucoma. Improving the accuracy of OD/OC segmentation results and parameter extraction in colour fundus images plays a very important role in early glaucoma screening. To improve the accuracy and inference speed of fundus image segmentation, an algorithm for fundus image segmentation based on an attention U-Net with transfer learning is proposed in this paper. First, an attention gate was added between the encoder and decoder of U-Net to focus on the target areas, thus forming the architecture of the attention U-Net. Then, after the network had been trained on the DRIONS-DB dataset to partially obtain the weights of the encoder, it was trained on the Drishti-GS dataset to further modify the weights. Finally, the trained attention U-Net model incorporating transfer learning was used to segment fundus images. OD/OC extraction using this method shows obvious advantages in model parameter quantity and inference time compared with existing algorithms, the parameter quantity is much smaller than that of existing algorithms, and the model inference time is 0.33 s, representing a reduction of more than 50%. The proposed method can be applied to a fundus image dataset with only a small number of labels. Whilst offering fast OD/OC segmentation, it also guarantees a relatively high segmentation accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Calkins, D.J., Pekny, M., Cooper, M.L., Benowitz, L.I., Calkins, D., Cooper, M., Crowston, J.G., Huberman, A.D., Johnson, E.C., Lu, R.: The challenge of regenerative therapies for the optic nerve in glaucoma. Exp. Eye Res. 157, 28–33 (2017)

    Article  Google Scholar 

  2. Medeiros, F.A., Vizzeri, G., Zangwill, L.M., Alencar, L.M., Sample, P.A., Weinreb, R.N.: Comparison of retinal nerve fiber layer and optic disc imaging for diagnosing glaucoma in patients suspected of having the disease. Ophthalmology 115(8), 1340–1346 (2008)

    Article  Google Scholar 

  3. Kumar, J.R.H., Pediredla, A.K., Seelamantula, C.S.: Active discs for automated optic disc segmentation. In: IEEE Global Conference on Signal and Information Processing, pp. 225–229 (2015)

  4. Issac, A., Parthasarthi, M., Dutta, M.K.: An adaptive threshold based algorithm for optic disc and cup segmentation in fundus images. In: International Conference on Signal Processing, pp. 143–147 (2015)

  5. Gao, Y., Yu, X., Wu, C., Zhou, W., Wang, X., Chu, H.: Accurate and efficient segmentation of optic disc and optic cup in retinal images integrating multi-view information. IEEE Access 7, 148183–148197 (2019)

    Article  Google Scholar 

  6. Ayub, J., Ahmad, J., Muhammad, J., Aziz, L., Ayub, S., Akram, U., Basit, I.: Glaucoma detection through optic disc and cup segmentation using K-mean clustering. In: International Conference Computing Electronic and Electrical Engineering, pp. 143–147 (2016)

  7. Pathan, S., Kumar, P., Pai, R., Bhandary, S.V.: Automated detection of optic disc contours in fundus images using decision tree classifier. Biocybern. Biomed. Eng. 40(1), 52–64 (2020)

    Article  Google Scholar 

  8. Lim, G., Cheng, Y., Hsu, W., Lee, M.L.: Integrated optic disc and cup segmentation with deep learning. In: International Conference on Tools with Artificial Intelligence, pp. 162–169 (2015)

  9. Sevastopolsky, A.: Optic disc and cup segmentation methods for glaucoma detection with modification of U-Net convolutional neural network. Pattern Recogn. Image Anal. 27(3), 618–624 (2017)

    Article  Google Scholar 

  10. Shankaranarayana, S.M., Ram, K., Mitra, K., Sivaprakasam, M.: Joint optic disc and cup segmentation using fully convolutional and adversarial networks. In: Fetal, Infant and Ophthalmic Medical Image Analysis, pp. 168–176. Springer International Publishing (2017)

  11. Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv:1511.06434 (2016)

  12. Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)

  13. Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015, pp. 234–241. Springer International Publishing (2015)

  14. Shen, D., Wu, G., Suk, H.I.: Deep learning in medical image analysis. Annu. Rev. Biomed. Eng. 19(1), 221–248 (2017)

    Article  Google Scholar 

  15. Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M.C.H., Heinrich, M.P., Misawa, K., Mori, K., Mcdonagh, S., Hammerla, N., Kainz, B.: Attention U-Net: learning where to look for the pancreas. arXiv:1804.03999 (2018)

  16. Iglovikov, V.I., Shvets, A.: TernausNet: U-Net with VGG11 encoder pre-trained on ImageNet for image segmentation. arXiv:1801.05746 (2018)

  17. Carmona, E.J., Rincon, M., Garciafeijoo, J., Martinezdelacasa, J.M.: Identification of the optic nerve head with genetic algorithms. Artif. Intell. Med. 43(3), 243–259 (2008)

    Article  Google Scholar 

  18. Sivaswamy, J., Krishnadas, S.R., Joshi, G.D., Jain, M., Tabish, A.U.S.: Drishti-GS: retinal image dataset for optic nerve head (ONH) segmentation. In: 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI), pp. 53–56 (2014)

  19. Tabassum, M., Khan, T.M., Arsalan, M., Naqvi, S.S., Mirza, J.: CDED-Net: Joint segmentation of optic disc and optic cup for glaucoma screening. IEEE Access PP (99) (2020)

  20. Zilly, J., Buhmann, J.M., Mahapatra, D.: Glaucoma detection using entropy sampling and ensemble learning for automatic optic cup and disc segmentation. Comput. Med. Imaging Graph. 55, 28–41 (2017)

    Article  Google Scholar 

  21. Gu, Z., Cheng, J., Fu, H., Zhou, K., Hao, H., Zhao, Y., Zhang, T., Gao, S., Liu, J.: CE-Net: context encoder network for 2D medical image segmentation. IEEE Trans. Med. Imaging 38(10), 2281–2292 (2019)

    Article  Google Scholar 

  22. Albander, B., Williams, B.M., Alnuaimy, W., Altaee, M.A., Pratt, H., Zheng, Y.: Dense fully convolutional segmentation of the optic disc and cup in colour fundus for glaucoma diagnosis. Symmetry 10(4), 87 (2018)

    Article  Google Scholar 

  23. Yu, S., Xiao, D., Frost, S., Kanagasingam, Y.: Robust optic disc and cup segmentation with deep learning for glaucoma detection. Comput. Med. Imaging Graph. 74, 61–71 (2019)

    Article  Google Scholar 

  24. Xu, Y., Lu, S., Li, H., Li, R.: Mixed maximum loss design for optic disc and optic cup segmentation with deep learning from imbalanced samples. Sensors 19(20), 4401 (2019)

    Article  Google Scholar 

  25. Bhatkalkar, B., Reddy, D., Prabhu, S., Bhandary, S.: Improving the performance of convolutional neural network for the segmentation of optic disc in fundus images using attention gates and conditional random fields. IEEE Access PP(99), 1-1 (2020)

    Google Scholar 

Download references

Acknowledgements

Funding was provided by North Minzu University Scientific Research Projects (Major projects No. 2019KJ37), National Natural Science Foundation of China (No. 61861001), “Tian Cheng Hui Zhi” innovation & education fund of Chinese Ministry of Education (No. 2018A01016), Postgraduate Innovation Project of North Minzu University (No. YCX20111), Ningxia Technology Innovative Team of advanced intelligent perception & control, the Key Laboratory of Intelligent Perception Control at North Minzu University, Natural Science Foundation of Ningxia (No. 2020AAC03220).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Haicheng Wei.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (JPEG 6861 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, X., Wang, S., Zhao, J. et al. Application of an attention U-Net incorporating transfer learning for optic disc and cup segmentation. SIViP 15, 913–921 (2021). https://doi.org/10.1007/s11760-020-01815-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-020-01815-z

Keywords

Navigation