Skip to main content
SpringerLink
Log in

X-ray image super-resolution reconstruction based on a multiple distillation feedback network

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

The super-resolution reconstruction of X-ray images is one of the hot issues in the field of medical imaging. Due to the limitations of X-ray machines, the acquired images often have some problems, such as blurred details, unclear edges and low contrast, which seriously affect doctors’ interpretations of X-ray images. In view of the above problems, an X-ray image super-resolution reconstruction method based on a multiple distillation feedback network is proposed. In the feature extraction stage, the shallow features of X-ray images are extracted through 3 × 3 and 1 × 1 convolutional layers, and a multiple distillation feedback module is designed, which iteratively upsamples and downsamples to fully extract the texture details of X-ray images. Subpixel convolution is used to improve the resolution and the residual convolution is used to predict the corresponding residual image. In the image reconstruction stage, the residual image is fused with the transposed convolution upsampled image, and the Laplacian pyramid structure is used to progressively reconstruct high-resolution X-ray images. The experimental results show that the proposed method can suppress noise and reduce artifacts. Its peak signal-to-noise ratio (PSNR), structural similarity (SSIM) and information fidelity criteria (IFC) were all higher than those of the comparison methods, and its subjective visual was better.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Huda W, Abrahams RB (2015) X-ray-based medical imaging and resolution. Am J Roentgenol 204(4):393–397

    Article  Google Scholar 

  2. Batz M, Eichenseer A, Seiler J, Hybird JM (2015) super-resolution combining example-based single-image and interpolation-based multi-image reconstruction approaches. IEEE Int Conf Image Process (ICIP), pp 58–62. https://doi.org/10.1109/ICIP.2015.7350759

  3. Stark H, Oskoui P (1989) High-resolution image recovery from image-plane arrays, using convex projections. J Opt Soc Am A Opt Image Sci Vis 6(11):1715–1726

    Article  Google Scholar 

  4. Freeman WT, Jones TR, Pasztor EC (2002) Example-based super-resolution. IEEE Comput Graph Appl 22(2):56–65

    Article  Google Scholar 

  5. Zhang K, Zuo W, Zhang L (2018) Learning a single convolutional super-resolution network for multiple degradations. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Salt Lake City, UT, pp 3262–3271. https://doi.org/10.1109/CVPR.2018.00344

  6. Li X, Orchard MT (2001) New edge-directed interpolation. IEEE Trans Image Process 10(10):1521–1527

    Article  Google Scholar 

  7. Stark H, Oskoui P (1989) High-resolution image recovery from image-plane arrays, using convex projection. JOSAA 6(11):1715–1726

    Article  Google Scholar 

  8. Baker S, Kanade T (2002) Limits on super-resolution and how to break them. IEEE Trans Pattern Anal Mach Intell 24(9):1167–1183

    Article  Google Scholar 

  9. Anwar S, Khan S, Barnes N (2019) A deep journey into super-resolution: a survey. arXiv preprint arXiv:1904.07523. https://doi.org/10.1145/3390462

  10. Liu QM, Jia RS, Zhao CY (2019) Face super-resolution reconstruction based on self-attention residual network. IEEE Access 8:4110–4121

    Article  Google Scholar 

  11. Timofte R, De Smet V, Van Gool L (2013) Anchored neighborhood regression for fast example-based super-resolution. In: IEEE International Conference on Computer Vision. Sydney, NSW, pp 1920–1927. https://doi.org/10.1109/ICCV.2013.241

  12. Yang J, Wright J, Huang TS (2010) Image super-resolution via sparse representation. IEEE Trans Image Process 19(11):2861–2873

    Article  MathSciNet  Google Scholar 

  13. Dong C, Loy C, He K (2014) Learning a deep convolutional network for image super-resolution. In: European Conference on Computer Vision, vol 8692. Springer, Cham, pp 184–199. https://doi.org/10.1007/978-3-319-10593-2_13

  14. Kim J, Lee K J, Lee M (2016) Accurate image super-resolution using very deep convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV, pp 1646–1654. https://doi.org/10.1109/CVPR.2016.182

  15. Ledig C, Theis L, Huszar F (2017) Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu, HI, pp 105–114. https://doi.org/10.1109/CVPR.2017.19

  16. Xu L, Zeng X, Huang Z, Li W (2020) Low-dose chest X-ray image super-resolution using generative adversarial nets with spectral normalization. Biomed Signal Process Contro 55:101600

    Article  Google Scholar 

  17. You C, Li G, Yi Z (2020) CT super-resolution GAN constrained by the identical, residual, and cycle learning ensemble (GAN-CIRCLE). IEEE Trans Med Imaging 39(1):188–203

    Article  Google Scholar 

  18. Yan Z, Li J, Lu Y (2015) Super resolution in CT. Int J Imaging Syst Technol 25(1):92–101

    Article  Google Scholar 

  19. Wang Y, Rahman SS, Arns CH (2018) Super resolution reconstruction of μ -CT image of rock sample using neighbour embedding algorithm. Physica A Statal Mech Its Appl 493:177–188

    Article  Google Scholar 

  20. Woo S, Park J, Lee JY, Kweon IS (2018) CBAM: Convolutional block attention module. In: Ferrari V, Hebert M, Sminchisescu C, Weiss Y (eds) Computer Vision – ECCV 2018. ECCV 2018. Lecture Notes in Computer Science, vol 11211. Springer, Cham, pp 3–19. https://doi.org/10.1007/978-3-030-01234-2_1

  21. Lai W, Huang J, Ahuja N (2017) Deep laplacian pyramid networks for fast and accurate super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). Honolulu, HI, pp 624–632. https://doi.org/10.1109/CVPR.2017.618

  22. Yang Q, Pingkun Y, Yanbo Z (2018) Low-dose CT image denoising using a generative adversarial network with Wasserstein distance and perceptual loss. IEEE Trans Med Imaging 37(6):1348–1357

    Article  Google Scholar 

  23. Fang L, Wang Z, Chen Z (2020) 3D shape reconstruction of lumbar vertebra from two X-ray images and a CT model. IEEE/CAA J Automat Sin 7:1124–1133

    Article  MathSciNet  Google Scholar 

  24. Dong C, Loy C, Tang X (2016) Accelerating the Super-Resolution Convolutional Neural Network. In European Conference on Computer Vision  (ECCV), pp 391–407. https://doi.org/10.1007/978-3-319-46475-6_25

  25. Shi W, Caballero J, Huszar F (2016) Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Las Vegas, NV, pp 1874–1883. https://doi.org/10.1109/CVPR.2016.207

  26. Kim J, Lee J, Lee K (2016) Deeply-recursive convolutional network for image super—resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV, pp 1637–1645. https://doi.org/10.1109/CVPR.2016.181

  27. Carreira J, Agrawal P, Fragkiadaki K (2016) Human pose estimation with iterative error feedback. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV, 4733–4742. https://doi.org/10.1109/CVPR.2016.512

  28. Shrivastava A, Gupta A (2016) Contextual priming and feedback for faster R-CNN. In: European Conference on Computer Vision(ECCV), pp 330–348. https://doi.org/10.1007/978-3-319-46448-0_20

  29. Haris M, Shakhnarovich G, Ukita N (2018) Deep back-projection networks for super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Salt Lake City, UT, pp 1664–1673. https://doi.org/10.1109/CVPR.2018.00179

  30. Zhang Y, Li K, Li K (2018) Image super-resolution using very deep residual channel attention networks. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 286–301. https://doi.org/10.1007/978-3-030-01234-2_18

  31. Hui Z, Gao X, Yang Y (2019) Lightweight image super-resolution with information multi-distillation network. In: Proceedings of the 27th ACM International Conference on Multimedia. New York, NY, pp 2024–2032. https://doi.org/10.1145/3343031.3351084

  32. Lai WS, Huang JB, Ahuja N (2018) Fast and accurate image super-resolution with deep laplacian pyramid networks. IEEE Trans Pattern Anal Mach Intell 41(11):2599–2613

    Article  Google Scholar 

  33. He K, Zhang X, Ren S (2015) Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV). Santiago, pp 1026–1034. https://doi.org/10.1109/ICCV.2015.123

  34. Wang X, Peng Y, Lu L (2017) ChestX-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu, HI, pp 3462–3471. https://doi.org/10.1109/CVPR.2017.369

  35. Kermany DS, Goldbaum M, Cai W (2018) Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172(5):1122–1131

    Article  Google Scholar 

  36. Sheikh HR, Bovik AC, De Veciana G (2005) An information fidelity criterion for image quality assessment using natural scene statistics. IEEE Trans Image Process 14(12):2117–2128

    Article  Google Scholar 

  37. Mittal A, Soundararajan R, Bovik AC (2012) Making a “completely blind” image quality analyzer. IEEE Signal Process Lett 20(3):209–212

    Article  Google Scholar 

  38. Lim B, Son S, Kim H (2017) Enhanced deep residual networks for single image super-resolution. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops (CPRW). Honolulu, HI, pp 1132–1140. https://doi.org/10.1109/CVPRW.2017.151

  39. Muqeet A, Iqbal M, Bae S (2019) HRAN: Hybrid residual attention network for single image super resolution. In: IEEE Access, vol 7, pp 137020–137029. https://doi.org/10.1109/ACCESS.2019.2942346

Download references

Acknowledgments

The authors are grateful for the collaborative funding support from the Natural Science Foundation of Shandong Province, China (ZR2018MEE008).

Author information

Authors and Affiliations

  1. College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao, 266590, China

    Yan-Bin Du, Rui-Sheng Jia, Zhe Cui, Jin-Tao Yu, Hong-Mei Sun & Yong-Guo Zheng

  2. Shandong Province Key Laboratory of Wisdom Mine Information Technology, Shandong University of Science and Technology, Qingdao, 266590, China

    Rui-Sheng Jia, Hong-Mei Sun & Yong-Guo Zheng

Authors
  1. Yan-Bin Du
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rui-Sheng Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhe Cui
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jin-Tao Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hong-Mei Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yong-Guo Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Rui-Sheng Jia or Yong-Guo Zheng.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Du, YB., Jia, RS., Cui, Z. et al. X-ray image super-resolution reconstruction based on a multiple distillation feedback network. Appl Intell 51, 5081–5094 (2021). https://doi.org/10.1007/s10489-020-02123-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-020-02123-2

Keywords

Search

Navigation