Skip to main content
Log in

Joint training of two-channel deep neural network for brain tumor classification

  • OriginalPaper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Brain tumor recognition is a challenging task, and accurate diagnosis increases the chance of patient survival. In this article, we propose a two-channel deep neural network architecture for tumor classification that is more generalizable. Initially, local feature representations are extracted from convolution blocks of InceptionResNetV2 and Xception networks and are vectorized using proposed pooling-based techniques. An attention mechanism is proposed that allows more focus on tumor regions and less focus on non-tumor regions which eventually helps to differentiate the type of tumor present in the images. The proposed two-channel model allows joint training of two sets of tumor image representations in an end-to-end manner to achieve good generalization. Empirical studies on Figshare and BraT’S2018, benchmark datasets, reveal that our approach is superior in terms of generalization and simple in terms of number of layers compared to the existing complex models that follow fine-tuning of deep CNN models. Avoiding too much preprocessing and augmentation techniques, the proposed model sets new state-of-the-art scores on both the brain tumor datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Abiwinanda, N., Hanif, M., Hesaputra, S.T., Handayani, A., Mengko, T.R.: Brain tumor classification using convolutional neural network. In: World Congress on Medical Physics and Biomedical Engineering 2018, pp. 183–189. Springer, Berlin (2019)

  2. Afshar, P., Mohammadi, A., Plataniotis, K.N.: Brain tumor type classification via capsule networks. In: 2018 25th IEEE International Conference on Image Processing (ICIP), pp. 3129–3133. IEEE (2018)

  3. Amin, J., Sharif, M., Yasmin, M., Saba, T., Anjum, M.A., Fernandes, S.L.: A new approach for brain tumor segmentation and classification based on score level fusion using transfer learning. J. Med. Syst. 43(11), 326 (2019)

    Article  Google Scholar 

  4. Arakeri, M.P., Reddy, G.R.M.: Computer-aided diagnosis system for tissue characterization of brain tumor on magnetic resonance images. SIViP 9(2), 409–425 (2015)

    Article  Google Scholar 

  5. Bahadure, N.B., Ray, A.K., Thethi, H.P.: Image analysis for mri based brain tumor detection and feature extraction using biologically inspired BWT and SVM. Int. J. Biomed. Imaging (2017)

  6. Bakas, S., Reyes, M., Jakab, A., Bauer, S., Rempfler, M., Crimi, A., Shinohara, R.T., Berger, C., Ha, S.M., Rozycki, M., et al.: Identifying the best machine learning algorithms for brain tumor segmentation, progression assessment, and overall survival prediction in the brats challenge. arXiv preprint arXiv:1811.02629 (2018)

  7. Bodapati, J.D., Veeranjaneyul, N.: Facial Emotion Recognition Using Deep CNN Based Features. Int J Innovative Techn Exploring Eng (IJITEE), ISSN: 2278–3075, 8(7) (2019)

  8. Bodapati, J.D., Veeranjaneyulu, N., Shaik, N.S., Hakak, S., Bilal, M., Maddikunta, P.K.R., Jo, O.: Blended multi-modal deep convnet features for diabetic retinopathy severity prediction. Electronics 9(6), 914 (2020)

    Article  Google Scholar 

  9. Bodapati Jyostna Devi, V.A., Naralasetti, V.: Brain tumor detection using deep features in the latent space. Ingénierie des Systèmes d’Information 25, 259–265 (2020)

    Article  Google Scholar 

  10. Chen, W., Liu, B., Peng, S., Sun, J., Qiao, X.: S3d-unet: separable 3d u-net for brain tumor segmentation. In: International MICCAI Brainlesion Workshop, pp. 358–368. Springer, Berlin (2018)

  11. Cheng, J.: Brain tumor dataset. https://figshare.com/articles/braintumordataset/1512427. Accessed 10 Mar 2020

  12. Cheng, J., Huang, W., Cao, S., Yang, R., Yang, W., Yun, Z., Wang, Z., Feng, Q.: Enhanced performance of brain tumor classification via tumor region augmentation and partition. PLoS ONE 10(10), e0140381 (2015)

    Article  Google Scholar 

  13. Cheng, J., Yang, W., Huang, M., Huang, W., Jiang, J., Zhou, Y., Yang, R., Zhao, J., Feng, Y., Feng, Q., et al.: Retrieval of brain tumors by adaptive spatial pooling and fisher vector representation. PLoS ONE 11(6), e0157112 (2016)

    Article  Google Scholar 

  14. Deepak, S., Ameer, P.: Brain tumor classification using deep CNN features via transfer learning. Comput. Biol. Med. 111, 103345 (2019)

    Article  Google Scholar 

  15. Deepika, K., Bodapati, J.D., Srihitha, R.K.: An efficient automatic brain tumor classification using LBP features and SVM-based classifier. In: Proceedings of International Conference on Computational Intelligence and Data Engineering, pp. 163–170. Springer, Berlin (2019)

  16. Devi, B.J., Veeranjaneyulu, N.: Abnormal network traffic detection using support vector data description. In: Proceedings of the 5th International Conference on Frontiers in Intelligent Computing: Theory and Applications, pp. 497–506. Springer, Berlin (2017)

  17. El-Dahshan, E.-S.A., Mohsen, H.M., Revett, K., Salem, A.-B.M.: Computer-aided diagnosis of human brain tumor through MRI: a survey and a new algorithm. Expert Syst. Appl. 41(11), 5526–5545 (2014)

    Article  Google Scholar 

  18. Ismael, M.R., Abdel-Qader, I.: Brain tumor classification via statistical features and back-propagation neural network. In: 2018 IEEE International Conference on Electro/Information Technology (EIT), pp. 252–257. IEEE (2018)

  19. Kharrat, A., Gasmi, K., Messaoud, M.B., Benamrane, N., Abid, M.: A hybrid approach for automatic classification of brain MRI using genetic algorithm and support vector machine. Leonardo J. Sci. 17(1), 71–82 (2010)

    Google Scholar 

  20. Mohsen, H., El-Dahshan, E.-S.A., El-Horbaty, E.-S.M., Salem, A.-B.M.: Classification using deep learning neural networks for brain tumors. Future Comput. Inform. J. 3(1), 68–71 (2018)

    Article  Google Scholar 

  21. Paul, J.S., Plassard, A.J., Landman, B.A., Fabbri, D.: Deep learning for brain tumor classification. In: Medical Imaging 2017: Biomedical Applications in Molecular, Structural, and Functional Imaging, vol. 10137, p. 1013710. International Society for Optics and Photonics (2017)

  22. Rehman, A., Naz, S., Razzak, M.I., Akram, F., Imran, M.: A deep learning-based framework for automatic brain tumors classification using transfer learning. Circuits Syst. Signal Process. 39(2), 757–775 (2020)

    Article  Google Scholar 

  23. Sajjad, M., Khan, S., Muhammad, K., Wu, W., Ullah, A., Baik, S.W.: Multi-grade brain tumor classification using deep CNN with extensive data augmentation. J. Comput. Sci. 30, 174–182 (2019)

    Article  Google Scholar 

  24. Seetha, J., Raja, S.S.: Brain tumor classification using convolutional neural networks. Biomed. Pharmacol. J. 11(3), 1457 (2018)

    Article  Google Scholar 

  25. Sharif, M.I., Li, J.P., Khan, M.A., Saleem, M.A.: Active deep neural network features selection for segmentation and recognition of brain tumors using MRI images. Pattern Recogn. Lett. 129, 181–189 (2020)

    Article  Google Scholar 

  26. Sokolova, M., Lapalme, G.: A systematic analysis of performance measures for classification tasks. Inf. Process. Manag. 45(4), 427–437 (2009)

    Article  Google Scholar 

  27. Swati, Z.N.K., Zhao, Q., Kabir, M., Ali, F., Ali, Z., Ahmed, S., Lu, J.: Brain tumor classification for MR images using transfer learning and fine-tuning. Comput. Med. Imaging Graph. 75, 34–46 (2019)

    Article  Google Scholar 

  28. Swati, Z.N.K., Zhao, Q., Kabir, M., Ali, F., Ali, Z., Ahmed, S., Lu, J.: Content-based brain tumor retrieval for MR images using transfer learning. IEEE Access 7, 17809–17822 (2019)

    Article  Google Scholar 

  29. Talo, M., Baloglu, U.B., Yıldırım, Ö., Acharya, U.R.: Application of deep transfer learning for automated brain abnormality classification using MR images. Cogn. Syst. Res. 54, 176–188 (2019)

    Article  Google Scholar 

  30. Usman, K., Rajpoot, K.: Brain tumor classification from multi-modality MRI using wavelets and machine learning. Pattern Anal. Appl. 20(3), 871–881 (2017)

    Article  MathSciNet  Google Scholar 

  31. Zikic, D., Ioannou, Y., Brown, M., Criminisi, A.: Segmentation of brain tumor tissues with convolutional neural networks. In: Proceedings MICCAI-BRATS, pp. 36–39 (2014)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jyostna Devi Bodapati.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bodapati, J.D., Shaik, N.S., Naralasetti, V. et al. Joint training of two-channel deep neural network for brain tumor classification. SIViP 15, 753–760 (2021). https://doi.org/10.1007/s11760-020-01793-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-020-01793-2

Keywords

Navigation