Skip to main content
SpringerLink
Log in

Overlapping region reconstruction in nuclei image segmentation

  • Original article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

Automatic screening systems play an increasingly important role in the diagnosis of pathologists. Image measurement and classification are the key techniques of automatic screening systems, which directly determine the performance. The distortion in grey and texture after overlapping nuclei segmentation seriously degrades the DNA content measurement and nuclei classification. In order to solve this problem, this paper presents a new method to reconstruct the pixels in overlapping regions based on the GMM-UBM (Gaussian mixture model–universal background model). In this method, a large amount of data are first used to train a GMM (named UBM). Then, the GMM of each nucleus is derived by maximizing a posteriori adaptation with the UBM and the normal grey value of this nucleus. The grey values are randomly generated by the GMM and filled to the overlapping region, with the offset to fine-tuning the Gaussian components. Finally, the image inpainting algorithm is used to repair the connected region. Experimental results show that this method can effectively recover the nucleus features, such as texture, grey and optical density, and improve the accuracy of nucleus measurement and classification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Song, J., Xiao, L., Lian, Z.: Boundary-to-Marker Evidence-Controlled Segmentation and MDL-Based Contour Inference for Overlapping Nuclei. IEEE J. Biomed. Health Inf. 21(2), 451–464 (2017)

    Article  Google Scholar 

  2. Zhang, W., Li, H.: Automated segmentation of overlapped nuclei using concave point detection and segment grouping. Pattern Recogn. 71, 349–360 (2017)

    Article  Google Scholar 

  3. Zhao, J., Xie, Y.N., et al.: Segmentation of Overlapping Cervical Nuclei Based on The Identification. J. China Univ. Posts Telecommun 25(5), 83–92 (2018)

    Google Scholar 

  4. Liao, M., Zhao, Yq, Zeng, Yz, et al.: Automatic segmentation for cell images based on support vector machine and ellipse fitting. J. Zhejiang Univ. Eng. Sci. 51(4), 722–728 (2017)

    Google Scholar 

  5. Zhang, F., Wang, G., Teodoro, Y., Liang, D., Brat and J. Kong. Automated level set segmentation of histopathologic cells with sparse shape prior support and dynamic occlusion constraint[C]. In: 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), Melbourne, 2017, 718–722

  6. Yu, S., Lu, Y., Molloy, D.: A dynamic-shape-prior guided snake model with application in visually tracking dense cell populations. IEEE Trans. Image Process. 28(3), 1513–1527 (2019)

    Article  MathSciNet  Google Scholar 

  7. Tareef, A., Song, Y., Huang, H., Wang, Y., Feng, D., Chen, M., Cai, W.: Optimizing the cervix cytological examination based on deep learning and dynamic shape modeling [J]. Neurocomputing 248, 28–40 (2017)

    Article  Google Scholar 

  8. Song, Y., Tan, E.L., Jiang, X., et al.: Accurate cervical cell segmentation from overlapping clumps in pap smear images. IEEE Trans. Med. Imaging 36(1), 288–300 (2017)

    Article  Google Scholar 

  9. Sandeep, P., Jacob, T.: Single Image Super Resolution using a Joint GMM Method. IEEE Trans. Image Process. 25(9), 4233–4244 (2016)

    MathSciNet  MATH  Google Scholar 

  10. Bertalmio M, Sapiro G, Caselles V, et al. Image inpainting. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques. 2000: pp. 417–424

  11. Shen, J., Chan, T.F.: Mathematical Models for Local Nontexture Inpaintings [J]. SIAM Journal on Applied Mathematics 62(3), 1019–1043 (2002)

    Article  MathSciNet  Google Scholar 

  12. Chan, T.F., Shen, J.: Nontexture inpainting by curvature-driven diffusions. J. Vis. Commun. Image Represent. 12(4), 436–449 (2001)

    Article  Google Scholar 

  13. Criminisi, A., Pérez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. Image Process IEEE Trans. 13(9), 1200–1212 (2004)

    Article  Google Scholar 

  14. Barnes, C., Shechtman, E., Finkelstein, A., et al.: PatchMatch: a randomized correspondence algorithm for structural image editing. ACM Transactions on Graphics (ToG). ACM, 2009, 28(3): 24

  15. Guo, Q., Gao, S., Zhang, X., Yin, Y., Zhang, C.: Patch-based image inpainting via two stage low rank approximation. IEEE Trans. Vis. Comp. Gr. 24(6), 2023–2036 (2017)

    Article  Google Scholar 

  16. Liu, J., Yang, S., Fang, Y., Guo, Z.: Structure-guided image inpainting using homography transformation. IEEE Trans. Multimed. 20(12), 3252–3265 (2018)

    Article  Google Scholar 

  17. Yan, Z., Li, X., Li, M., Zuo, W., Shan, S.: Shift-net: image inpainting via deep feature rearrangement. In: Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 1-17

  18. Pathak, D., Krahenbuhl, P., Donahue, J., et al.: Context encoders: Feature learning by inpainting. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016, pp. 2536–2544

  19. Cai, N., Su, Z., Lin, Z., Wang, H., Yang, Z., Ling, B.W.-K.: Blind inpainting using the fully convolutional neural network. Vis. Comput. 33(2), 249–261 (2017)

    Article  Google Scholar 

  20. Yang, C., Lu, X., Lin, Z., et al. High-resolution image inpainting using multi-scale neural patch synthesis. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2017, pp. 6721–6729

  21. Yu, J., Lin, Z., Yang J, et al. Generative image inpainting with contextual attention. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2018 pp. 5505–5514

  22. Ulyanov, D., Vedaldi, A., Lempitsky, V.: Deep Image Prior. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2018, pp. 9446–9454

  23. Reynolds, D.A., Quatieri, T.F., Dunn, R.B.: Speaker verification using adapted Gaussian mixture models. Digital Signal Process. 10(1–3), 19–41 (2000)

    Article  Google Scholar 

  24. Telea, A.: An image inpainting technique based on the fast marching method. J. Gr. Tools 9(1), 23–34 (2004)

    Article  Google Scholar 

  25. Guillemot, C., Meur, O.L.: Image inpainting: overview and recent advances. IEEE Signal Process. Mag. 31(1), 127–144 (2013)

    Article  Google Scholar 

  26. Hueber, T., Girin, L., Alameda-Pineda, X., et al.: Speaker-adaptive acoustic-articulatory inversion using cascaded gaussian mixture regression. IEEE/ACM Trans. Audio Speech Language Process. 23(12), 2246–2259 (2015)

    Article  Google Scholar 

  27. Rodriguez, M., Orrite, C., Medrano, C., et al.: One-shot learning of human activity with an MAP adapted GMM and Simplex-HMM. IEEE Trans. Cybern. 47(7), 1769–1780 (2016)

    Article  Google Scholar 

Download references

Acknowledgements

This research is partly supported by The National Natural Science Foundation of China (61673142), the Foundation of Education Department of Heilongjiang Province (12511096), Natural Science Foundation of HeiLongjiang Province of China (F2017013), Natural Science Foundation of HeiLongjiang Province of China (JJ2019JQ0013), University Nursing Program for Young Scholars with Creative Talents in Heilongjiang Province(UNPYSCT-2016034), Outstanding Youth Talent Foundation of Harbin of China (2017RAYXJ013), and the Research Fund for the Doctoral Program of Higher Education of China (20132303120003) and the Science Funds for the Young Innovative Talents of HUST (20152).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Harbin University of Science and Technology, No.52 Xuefu Road, Harbin, 150080, China

    Jing Zhao, Yining Xie, Lei Tang & Yongjun He

Authors
  1. Jing Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yining Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lei Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yongjun He
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yongjun He.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, J., Xie, Y., Tang, L. et al. Overlapping region reconstruction in nuclei image segmentation. Vis Comput 37, 1623–1635 (2021). https://doi.org/10.1007/s00371-020-01926-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-020-01926-1

Keywords

Search

Navigation