Skip to main content
SpringerLink
Log in

A coarse-to-fine registration method for three-dimensional MR images

  • Original Article
  • Published:
Medical & Biological Engineering & Computing Aims and scope Submit manuscript

Abstract

Three-dimensional (3D) multimodal magnetic resonance (MR) image registration aims to align similar things in different MR images spatially. Such a technology is useful in auxiliary disease diagnosis and surgical treatment. However, inconsistent intensity correspondence and large initial displacement contribute to the difficulty in registering multimodal MR volumes. A coarse-to-fine method is proposed in this study for pairwise 3D MR image rigid registration. Firstly, the proposed method extracts image feature points to form unregistered point sets and performs coarse registration based on point set registration to reduce the initial displacements of offset images effectively. Then, this method calculates a grey histogram based on voxels in the adaptive region of interest and further improves registration accuracy by maximizing mutual information of coarse-registered images. Some representative registration methods are compared on the basis of three MR image datasets to evaluate the performance of the proposed method. Experimental results show that the proposed method improved more in registration success rate and accuracy compared with conventional registration methods, especially when initial displacements are large.

Graphical abstract

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Attia M, Slama Y (2017) Efficient initial guess determination based on 3D point cloud projection for ICP algorithms. In 2017 International Conference on High Performance Computing & Simulation (Hpcs), IEEE, pp 807–814

  2. Banerjee J, Sun Y, Klink C, Gahrmann R, Niessen WJ, Moelker A, van Walsum T (2019) Multiple-correlation similarity for block-matching based fast CT to ultrasound registration in liver interventions. Med Image Anal 53:132–141. https://doi.org/10.1016/j.media.2019.02.003

    Article  PubMed  Google Scholar 

  3. Baumann F, Ehlers A, Rosenhahn B, Liao J (2016) Recognizing human actions using novel space-time volume binary patterns. Neurocomputing 173:54–63

    Article  Google Scholar 

  4. Bodensteiner C, Huebner W, Juengling K, Mueller J, Arens M (2010) Local multi-modal image matching based on self-similarity. In IEEE International Conference on Image Processing

  5. Cover TM, Thomas JA (2012) Elements of information theory. John Wiley & Sons

  6. Cun X, Pun CM, Gao H (2018) Applying stochastic second-order entropy images to multi-modal image registration. Signal Processing Image Communication 65:201–209

    Article  Google Scholar 

  7. Glodeck D, Hesser J, Zheng L (2018) Potential of metric homotopy between intensity and geometry information for multi-modal 3D registration. Z Med Phys S0939388917301435

  8. Hui L, Du P, Zhao W, Zhang L, Sun H (2010) Image registration based on corner detection and affine transformation. In

  9. Kahaki SMM, Nordin MJ, Ashtari AH, Zahra SJ (2016) Invariant feature matching for image registration application based on new dissimilarity of spatial features. PLoS One 11(3):e0149710

    Article  Google Scholar 

  10. Kim J, Fessler AJ (2004) Intensity-based image registration using robust correlation coefficients. IEEE Trans Med Imaging 23:1430–1444. https://doi.org/10.1109/TMI.2004.835313

    Article  PubMed  Google Scholar 

  11. Kwok T-H (2018) DNSS: dual-normal-space sampling for 3-D ICP registration. IEEE Trans Autom Sci Eng 16(1):241–252

    Article  Google Scholar 

  12. Luo W, Hao X, Xu C, Cui Y, Xia Y, Fan Q, et al. (2017) Coarse-to-fine registration for infrared and visible images of power grid. In 2017 4th International Conference on Systems and Informatics (ICSAI), IEEE, pp 1181–1185

  13. Maes F, Collignon A, Vandermeulen D, Marchal G, Suetens P (1997) Multimodality image registration by maximization of mutual information. IEEE Trans Med Imaging 16(2):187–198

    Article  CAS  Google Scholar 

  14. Maintz JA, van den Elsen PA, Viergever MA (1996) Comparison of edge-based and ridge-based registration of CT and MR brain images. Med Image Anal 1(2):151–161

    Article  CAS  Google Scholar 

  15. Marc-Michel DM, Heimann T, Sermesant M, Pennec X (2017) Medical image computing and computer assisted intervention − MICCAI 2017. Lect Notes Comput Sci. https://doi.org/10.1007/978-3-319-66182-7

  16. Meng C, Wang Q, Guan S, Sun K, Liu B (2019) 2D-3D registration with weighted local mutual information in vascular interventions

  17. El Sayed Hussein Jomaa M, Colominas MA, Jrad N, Van Bogaert P, Humeau-Heurtier A (2019) A new mutual information measure to estimate functional connectivity: Preliminary study

  18. Orchard J, Mann R (2009) Registering a multisensor ensemble of images. IEEE Trans Image Process 19(5):1236–1247

    Article  Google Scholar 

  19. Palanivel DA, Natarajan S, Gopalakrishnan S (2019) Mutifractals based multimodal 3D image registration. Biomedical Signal Processing and Control 47:126–136

    Article  Google Scholar 

  20. Viswanathan R, Bingham A, Raghav S, Arjunan SP, Jelfs B, Kempster P, et al. (2019) Normalized mutual information of phonetic sound to distinguish the speech of Parkinson’s disease

  21. Ramos-Llorden G, Arnold J, Van Steenkiste G, Jeurissen B, Vanhevel F, Van Audekerke J et al (2016) A unified maximum likelihood framework for simultaneous motion and $ T_ {1} $ estimation in quantitative MR $ T_ {1} $ mapping. IEEE Trans Med Imaging 36(2):433–446

    Article  Google Scholar 

  22. Rister B, Horowitz MA, Rubin DL (2017) Volumetric image registration from invariant keypoints. IEEE Trans Image Process 26(10):4900–4910

    Article  Google Scholar 

  23. Shen L, Huang X, Fan C, Li Y (2018) Enhanced mutual information-based medical image registration using a hybrid optimisation technique. Electron Lett 54(15):926–928

    Article  Google Scholar 

  24. Tang S, Cong W, Yang J, Fu T, Song H, Ai D, Wang Y (2018a) Local statistical deformation models for deformable image registration. Neurocomputing 303:1–10. https://doi.org/10.1016/j.neucom.2018.03.039

    Article  Google Scholar 

  25. Tang Z, Yap PT, Shen D (2018b) A new multi-atlas registration framework for multimodal pathological images using conventional monomodal normal atlases. IEEE Trans Image Process 28:2293–2304. https://doi.org/10.1109/TIP.2018.2884563

    Article  Google Scholar 

  26. Van den Elsen PA, Maintz JA, Pol E-J, Viergever MA (1995) Automatic registration of CT and MR brain images using correlation of geometrical features. IEEE Trans Med Imaging 14(2):384–396

    Article  Google Scholar 

  27. Viola P, Wells WM III (1997) Alignment by maximization of mutual information. Int J Comput Vis 24(2):137–154

    Article  Google Scholar 

  28. Wang C, Goatman KA, Boardman JP, Beveridge EL, Newby DE, Semple SI (2019) Distance oriented particle swarm optimizer for brain image registration. IEEE Access 7:56016–56027. https://doi.org/10.1109/access.2019.2907769

    Article  Google Scholar 

  29. West J, Fitzpatrick JM, Wang MY, Dawant BM, Maurer CR Jr, Kessler RM, Maciunas RJ, Barillot C, Lemoine D, Collignon A, Maes F, Suetens P, Vandermeulen D, van den Elsen PA, Napel S, Sumanaweera TS, Harkness B, Hemler PF, Hill DLG, Hawkes DJ, Studholme C, Maintz JBA, Viergever MA, Malandain G, Pennec X, Noz ME, Maguire GQ Jr, Pollack M, Pelizzari CA, Robb RA, Hanson D, Woods RP (1997) Comparison and evaluation of retrospective intermodality brain image registration techniques. J Comput Assist Tomogr 21(4):554–568

    Article  CAS  Google Scholar 

  30. Woo J, Stone M, Prince JL (2014) Multimodal registration via mutual information incorporating geometric and spatial context. IEEE Trans Image Process 24(2):757–769

    Article  Google Scholar 

  31. Wu J, Tang X (2019) A large deformation diffeomorphic framework for fast brain image registration via parallel computing and optimization. Neuroinformatics:1–16

  32. Xiaogang D, Jianwu D, Yangping W, Xinguo L, Sha L (2013) An algorithm multi-resolution medical image registration based on firefly algorithm and Powell. In 2013 Third International Conference on Intelligent System Design and Engineering Applications, IEEE, pp 274–277

  33. Yang J, Li H, Campbell D, Jia Y (2016) Go-ICP: a globally optimal solution to 3D ICP point-set registration. IEEE Transactions on Pattern Analysis & Machine Intelligence 38(11):2241–2254

    Article  Google Scholar 

  34. Yelampalli PKR, Nayak J, Gaidhane VH (2017) Medical image rigid registration using a novel binary feature descriptor and modified affine transform. IET Image Process 12(3):337–344

    Article  Google Scholar 

  35. Yuan C, Yu X, Luo Z (2016) 3D point cloud matching based on principal component analysis and iterative closest point algorithm. In 2016 International Conference on Audio, Language and Image Processing (ICALIP), IEEE, pp 404–408

  36. Zhou X, Zhu J, Liu K-Y, Sabatini BL, Wong ST (2006) Mutual information-based feature selection in studying perturbation of dendritic structure caused by TSC2 inactivation. Neuroinformatics 4(1):81–94

    Article  Google Scholar 

  37. Zouqi M, Samarabandu J, Zhou Y (2010) Multi-modal image registration using line features and mutual information. In 2010 IEEE International Conference on Image Processing, IEEE, pp 129–132

  38. Gong M, Zhao S, Jiao L, Tian D, Wang, S (2013) A novel coarse-to-fine scheme for automatic image registration based on SIFT and mutual information. IEEE Transactions on Geoscience and Remote Sensing 52(7):4328–4338

Download references

Acknowledgements

The authors would like to thank BraTs, the project team of RIRE and Henan Provincial People’s Hospital for providing the datasets.

Funding

This work was supported by “New generation information technology” innovation project and Universities key scientific research project of Education Department of Henan Province (2018A03003, 21A520042), Science and technology research project of Henan province (172102210003), the Startup Research Fund of Zhengzhou University (Grant F0001297).

Author information

Authors and Affiliations

  1. School of Software Academy, Zhengzhou University, Zhengzhou, 450000, China

    Cuixia Li, Yuanyuan Zhou, Yinghao Li & Shanshan Yang

Authors
  1. Cuixia Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuanyuan Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yinghao Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shanshan Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yinghao Li.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, C., Zhou, Y., Li, Y. et al. A coarse-to-fine registration method for three-dimensional MR images. Med Biol Eng Comput 59, 457–469 (2021). https://doi.org/10.1007/s11517-021-02317-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11517-021-02317-x

Keywords

Search

Navigation