Skip to main content
SpringerLink
Log in

Bayesian Segmentation of Hip and Thigh Muscles in Metal Artifact-Contaminated CT Using Convolutional Neural Network-Enhanced Normalized Metal Artifact Reduction

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

In total hip arthroplasty, analysis of postoperative medical images is important to evaluate surgical outcome. Since Computed Tomography (CT) is most prevalent modality in orthopedic surgery, we aimed at the analysis of CT image. In this work, we focus on the metal artifact in postoperative CT caused by the metallic implant, which reduces the accuracy of segmentation especially in the vicinity of the implant. Our goal was to develop an automated segmentation method of the bones and muscles in the postoperative CT images. We propose a method that combines Normalized Metal Artifact Reduction (NMAR), which is one of the state-of-the-art metal artifact reduction methods, and a Convolutional Neural Network-based segmentation using two U-net architectures. The first U-net refines the result of NMAR and the Bayesian muscle segmentation is performed by the second U-net. We conducted experiments using simulated images of 20 patients and real images of three patients to evaluate the segmentation accuracy of 19 muscles. In simulation study, the proposed method showed statistically significant improvement (p < 0.05) in the average symmetric surface distance (ASD) metric for 12 muscles out of 19 muscles and the average ASD of all muscles from 1.46 ± 0.904 mm (mean ± std. over all patients) to 1.30 ± 0.775 mm over our previous method. Addition to this, the high correlation ratio between segmentation accuracy and the estimated uncertainty was found. The real image study using the manual trace of gluteus maximus and medius muscles showed ASD of 1.89 ± 0.553 mm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8

Similar content being viewed by others

References

  1. Ronneberger, O., Fischer, P., & Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. In International conference on medical image computing and computer-assisted intervention (pp. 234–241).

    Google Scholar 

  2. Lee, H., Troschel, F. M., Tajmir, S., Fuchs, G., Mario, J., Fintelmann, F. J., & Do, S. (2017). Pixel-level deep segmentation: artificial intelligence quantifies muscle on computed tomography for body morphometric analysis. Journal of Digital Imaging, 30(4), 487–498.

    Article  Google Scholar 

  3. Dabiri, S., Popuri, K., Feliciano, E. M. C., Caan, B. J., Baracos, V. E., & Beg, M. F. (2019). Muscle segmentation in axial computed tomography (CT) images at the lumbar (L3) and thoracic (T4) levels for body composition analysis. Computerized Medical Imaging and Graphics, 75, 47–55.

    Article  Google Scholar 

  4. Weston, A. D., Korfiatis, P., Kline, T. L., Philbrick, K. A., Kostandy, P., Sakinis, T., et al. (2018). Automated abdominal segmentation of CT scans for body composition analysis using deep learning. Radiology, 290(3), 669–679.

    Article  Google Scholar 

  5. Hiasa, Y., Otake, Y., Takao, M., Ogawa, T., Sugano, N., & Sato, Y. (2019). Automated muscle segmentation from clinical CT using Bayesian U-net for personalized musculoskeletal Modeling. IEEE Transactions on Medical Imaging.

  6. Meyer, E., Raupach, R., Lell, M., Schmidt, B., & Kachelrieß, M. (2010). Normalized metal artifact reduction (NMAR) in computed tomography. Medical Physics, 37(10), 5482–5493.

    Article  Google Scholar 

  7. Gjesteby, L., Shan, H., Yang, Q., Xi, Y., Claus, B., Jin, Y., et al. (2018). Deep neural network for CT metal Artifact reduction with a perceptual loss function. In Proceedings of the fifth international conference on image formation in X-ray computed tomography (pp. 439–443).

    Google Scholar 

  8. Sakamoto, M., Hiasa, Y., Otake, Y., Takao, M., Suzuki, Y., Sugano, N., & Sato, Y. (2019). Automated segmentation of hip and thigh muscles in metal artifact contaminated CT using CNN. In International Forum on Medical Imaging in Asia 2019. International Society for Optics and Photonics, 11050, 110500.

  9. Otake, Y., Sakamoto, M., Hiasa, Y., Takao, M., Suzuki Y., Sugano N., Sato, Y. (2019). Musculoskeletal modeling from a metal artifact contaminated CT for post-operative assessment of total hip arthroplasty. In International Workshop and Challenge on Computational Methods and Clinical Applications in Musculoskeletal Imaging (in press).

  10. Meyer, E., Raupach, R., Lell, M., Schmidt, B., & Kachelrieß, M. (2012). Frequency split metal artifact reduction (FSMAR) in computed tomography. Medical Physics, 39(4), 1904–1916.

    Article  Google Scholar 

  11. Zhang, Y., & Yu, H. (2018). Convolutional neural network based metal artifact reduction in X-ray computed tomography. IEEE Transactions on Medical Imaging, 37(6), 1370–1381.

    Article  Google Scholar 

  12. Herman, G. T. (1979). Correction for beam hardening in computed tomography. Physics in Medicine & Biology, 24(1), 81.

    Article  Google Scholar 

  13. Kyriakou, Y., Meyer, E., Prell, D., & Kachelrieß, M. (2010). Empirical beam hardening correction (EBHC) for CT. Medical Physics, 37(10), 5179–5187.

    Article  Google Scholar 

  14. Berger, M., XCOM: photon cross sections database. http://www.nist.gov/pml/data/xcom/index.cfm. .

  15. Simens Healthineers. Simulation of x-ray spectra. https://www.oem-xray-components.siemens.com/x-ray-spectra-simulation. .

  16. Glorot, X., & Bengio, Y. (2010). Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the thirteenth international conference on artificial intelligence and statistics (pp. 249-256).

  17. Kingma, D. P., & Ba, J. (2014). Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.

  18. Ogawa, T., Takao, M., Otake, Y., Yokota, F., Hamada, H., Sakai, T., Sato, Y., & Sugano, N. (2019). Validation study of the CT-based cross-sectional evaluation of muscular atrophy and fatty degeneration around the pelvis and the femur. Journal of Orthopaedic Science (in press).

  19. Styner. M., Lee. J., Chin. B., Chin. M., Commowick. O., Tran. H. et al. (2008). 3D segmentation in the clinic: A grand challenge ii: Ms lesion segmentation. Midas Journal, 2008, 1–6.

  20. Wu, D., Kim, K., Dong, B., & Li, Q. (2017). End-to-end abnormality detection in medical imaging. arXiv preprint arXiv:1711.02074. (version 1, https://arxiv.org/abs/1711.02074v1)

  21. Shrivastava, A., Pfister, T., Tuzel, O., Susskind, J., Wang, W., & Webb, R. (2017). Learning from simulated and unsupervised images through adversarial training. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2107–2116.

Download references

Acknowledgements

This work was partly supported by KAKENHI 19H01176 and 26108004.

Author information

Authors and Affiliations

  1. Graduate School of Science and Technology, Nara Institute of Science and Technology, 8916-5, Takayamacho, Ikoma, 630-0192, Japan

    Mitsuki Sakamoto, Yuta Hiasa, Yoshito Otake, Yuki Suzuki & Yoshinobu Sato

  2. Graduate School of Medicine, Osaka University, 2-2 Yamadaoka, Suita, 565-0871, Japan

    Masaki Takao & Nobuhiko Sugano

Authors
  1. Mitsuki Sakamoto
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuta Hiasa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yoshito Otake
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Masaki Takao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yuki Suzuki
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Nobuhiko Sugano
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Yoshinobu Sato
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mitsuki Sakamoto.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

Table 1 Segmentation accuracy of individual muscles for 20 patients in a simulation experiment. Blue indicates higher accuracy and lower variance. Note that each metric was calculated using both affected and unaffected side.
Full size table

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sakamoto, M., Hiasa, Y., Otake, Y. et al. Bayesian Segmentation of Hip and Thigh Muscles in Metal Artifact-Contaminated CT Using Convolutional Neural Network-Enhanced Normalized Metal Artifact Reduction. J Sign Process Syst 92, 335–344 (2020). https://doi.org/10.1007/s11265-019-01507-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-019-01507-z

Keywords

Search

Navigation