Skip to main content
SpringerLink
Log in

ROI-based feature learning for efficient true positive prediction using convolutional neural network for lung cancer diagnosis

  • S.I.: Recent Advances in Deep Learning for Medical Image Processing
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Convolutional neural network (CNN) is one of the deep structured algorithms widely applied to analyze the ability to visualize and extract the hidden texture features of image datasets. The study aims to automatically extract the self-learned features using an end-to-end learning CNN and compares the results with the conventional state-of-art and traditional computer-aided diagnosis system’s performance. The architecture consists of eight layers: one input layer, three convolutional layers and three sub-sampling layers intercepted with batch normalization, ReLu and max-pooling for salient feature extraction, and one fully connected layer that uses softmax function connected to 3 neurons as output layer, classifying an input image into one of three classes categorized as nodules \(\ge\) 3 mm as benign (low malignancy nodules), malignant (high malignancy nodules), and nodules < 3 mm and non-nodules \(\ge\) 3 mm combined as non-cancerous. For the input layer, lung nodule CT images are acquired from the Lung Image Database Consortium public repository having 1018 cases. Images are pre-processed to uniquely segment the nodule region of interest (NROI) in correspondence to four radiologists’ annotations and markings describing the coordinates and ground-truth values. A two-dimensional set of re-sampled images of size 52 \(\times\) 52 pixels with random translation, rotation, and scaling corresponding to the NROI are generated as input samples. In addition, generative adversarial networks (GANs) are employed to generate additional images with similar characteristics as pulmonary nodules. CNNs are trained using images generated by GAN and are fine-tuned with actual input samples to differentiate and classify the lung nodules based on the classification strategy. The pre-trained and fine-tuned process upon the trained network’s architecture results in aggregate probability scores for nodule detection reducing false positives. A total of 5188 images with an augmented image data store are used to enhance the performance of the network in the study generating high sensitivity scores with good true positives. Our proposed CNN achieved the classification accuracy of 93.9%, an average specificity of 93%, and an average sensitivity of 93.4% with reduced false positives and evaluated the area under the receiver operating characteristic curve with the highest observed value of 0.934 using the GAN generated images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. American Lung Association Lung Cancer Fact Sheet (2019) https://www.lung.org/lung-health-and-diseases/lung-disease-lookup/lung-cancer/resource-library/lung-cancer-fact-sheet.html

  2. Abbas Q (2017) Segmentation of differential structures on computed tomography images for diagnosis lung-related diseases. Biomed Signal Process Control 33:325–334

    Article  Google Scholar 

  3. Al-Fahoum AS, Jaber EB, Al-Jarrah MA (2014) Automated detection of lung cancer using statistical and morphological image processing techniques. J Biomed Graph Comput 4(2):33

    Google Scholar 

  4. Amer HM, Abou-Chadi FE, Kishk SS, Obayya MI (2018) A computer-aided early detection system of pulmonary nodules in CT scan images. In: Proceedings of the 7th international conference on software and information engineering. ACM, pp 81–86

  5. Arabasadi Z, Alizadehsani R, Roshanzamir M, Moosaei H, Yarifard AA (2017) Computer aided decision making for heart disease detection using hybrid neural network-genetic algorithm. Comput Methods Programs Biomed 141:19–26

    Article  Google Scholar 

  6. Ardila D, Kiraly AP, Bharadwaj S, Choi B, Reicher JJ, Peng L, Tse D, Etemadi M, Ye W, Corrado G et al (2019) End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography. Nat Med 25(6):954

    Article  Google Scholar 

  7. Armato SG III, McLennan G, Bidaut L, McNitt-Gray MF, Meyer CR, Reeves AP, Zhao B, Aberle DR, Henschke CI, Hoffman EA et al (2011) The lung image database consortium (LIDC) and image database resource initiative (IDRI): a completed reference database of lung nodules on CT scans. Med Phys 38(2):915–931

    Article  Google Scholar 

  8. Arulmurugan R, Anandakumar H (2018) Early detection of lung cancer using wavelet feature descriptor and feed forward back propagation neural networks classifier. In: Computational vision and bio inspired computing. Springer, Berlin, pp 103–110

  9. Bhuvaneswari P, Therese AB (2015) Detection of cancer in lung with k-NN classification using genetic algorithm. Proc Mater Sci 10:433–440

    Article  Google Scholar 

  10. Chuquicusma MJ, Hussein S, Burt J, Bagci U (2018) How to fool radiologists with generative adversarial networks? A visual Turing test for lung cancer diagnosis. In: 2018 IEEE 15th international symposium on biomedical imaging (ISBI 2018). IEEE, pp 240–244

  11. Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M et al (2013) The cancer imaging archive (TCIA): maintaining and operating a public information repository. J Digit Imaging 26(6):1045–1057

    Article  Google Scholar 

  12. da Nóbrega RVM, Rebouças Filho PP, Rodrigues MB, da Silva SP, Júnior CMD, de Albuquerque VHC (2018) Lung nodule malignancy classification in chest computed tomography images using transfer learning and convolutional neural networks. Neural Comput Appl. https://doi.org/10.1007/s00521-018-3895-1

    Article  Google Scholar 

  13. de Carvalho Filho AO, Silva AC, de Paiva AC, Nunes RA, Gattass M (2018) Classification of patterns of benignity and malignancy based on CT using topology-based phylogenetic diversity index and convolutional neural network. Pattern Recognit 81:200–212

    Article  Google Scholar 

  14. El-Sherbiny B, Nabil N, El-Naby S.H, Emad Y, Ayman N, Mohiy T, AbdelRaouf A (2018) BLB (brain/lung cancer detection and segmentation and breast dense calculation). In: Deep and representation learning (IWDRL), 2018 first international workshop on. IEEE, pp 41–47

  15. Fernandes SL, Gurupur VP, Lin H, Martis RJ (2017) A novel fusion approach for early lung cancer detection using computer aided diagnosis techniques. J Med Imaging Health Inf 7(8):1841–1850

    Article  Google Scholar 

  16. Firmino M, Morais AH, Mendoça RM, Dantas MR, Hekis HR, Valentim R (2014) Computer-aided detection system for lung cancer in computed tomography scans: review and future prospects. Biomed Eng Online 13(1):41

    Article  Google Scholar 

  17. Ghosh S, Dubey SK (2013) Comparative analysis of k-means and fuzzy c-means algorithms. Int J Adv Comput Sci Appl 4(4):35–39

    Google Scholar 

  18. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems, pp 2672–2680

  19. Han H, Li L, Han F, Song B, Moore W, Liang Z (2015) Fast and adaptive detection of pulmonary nodules in thoracic CT images using a hierarchical vector quantization scheme. IEEE J Biomed Health Inf 19(2):648–659

    Article  Google Scholar 

  20. Hansell DM, Bankier AA, MacMahon H, McLoud TC, Muller NL, Remy J (2008) Fleischner society: glossary of terms for thoracic imaging. Radiology 246(3):697–722

    Article  Google Scholar 

  21. Hochhegger B, Zanon M, Altmayer S, Pacini GS, Balbinot F, Francisco MZ, Dalla Costa R, Watte G, Santos MK, Barros MC et al (2018) Advances in imaging and automated quantification of malignant pulmonary diseases: a state-of-the-art review. Lung 196(6):633–642

    Article  Google Scholar 

  22. Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141

  23. Hyvärinen A, Oja E (2000) Independent component analysis: algorithms and applications. Neural Netw 13(4–5):411–430

    Article  Google Scholar 

  24. Jacobs C, van Rikxoort EM, Murphy K, Prokop M, Schaefer-Prokop CM, van Ginneken B (2016) Computer-aided detection of pulmonary nodules: a comparative study using the public LIDC/IDRI database. Eur Radiol 26(7):2139–2147

    Article  Google Scholar 

  25. Javaid M, Javid M, Rehman MZU, Shah SIA (2016) A novel approach to CAD system for the detection of lung nodules in CT images. Comput Methods Programs Biomed 135:125–139

    Article  Google Scholar 

  26. Kalpana V, Rajini G (2016) Segmentation of lung lesion nodules using dicom with structuring elements and noise—a comparative study. In: Electrical, computer and electronics engineering (UPCON), 2016 IEEE Uttar Pradesh Section international conference on. IEEE, pp 252–257

  27. Kaul C, Manandhar S, Pears N (2019) Focusnet: an attention-based fully convolutional network for medical image segmentation. arXiv preprint arXiv:1902.03091

  28. Korkmaz S.A, Akçiçek A, Bínol H, Korkmaz M.F (2017) Recognition of the stomach cancer images with probabilistic hog feature vector histograms by using hog features. In: Intelligent systems and informatics (SISY), 2017 IEEE 15th international symposium on. IEEE, pp 000339–000342

  29. Kuruvilla J, Gunavathi K (2014) Lung cancer classification using neural networks for CT images. Comput Methods Programs Biomed 113(1):202–209

    Article  Google Scholar 

  30. Lampert TA, Stumpf A, Gançarski P (2016) An empirical study into annotator agreement, ground truth estimation, and algorithm evaluation. IEEE Trans Image Process 25(6):2557–2572

    Article  MathSciNet  MATH  Google Scholar 

  31. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324

    Article  Google Scholar 

  32. Li C, Zhu G, Wu X, Wang Y (2018) False-positive reduction on lung nodules detection in chest radiographs by ensemble of convolutional neural networks. IEEE Access 6:16060–16067

    Article  Google Scholar 

  33. Lindsay W, Wang J, Sachs N, Barbosa E, Gee J (2018) Transfer learning approach to predict biopsy-confirmed malignancy of lung nodules from imaging data: a pilot study. In: Image analysis for moving organ, breast, and thoracic images. Springer, Berlin, pp 295–301

  34. Lu L, Yapeng L, Hongyuan Z (2018) Benign and malignant solitary pulmonary nodules classification based on CNN and SVM. In: Proceedings of the international conference on machine vision and applications. ACM, pp 46–50

  35. Makaju S, Prasad P, Alsadoon A, Singh A, Elchouemi A (2018) Lung cancer detection using CT scan images. Proc Comput Sci 125:107–114

    Article  Google Scholar 

  36. Manikandan T, Bharathi N (2016) A survey on computer-aided diagnosis systems for lung cancer detection. Int Res J Eng Technol 3(5):1562–70

    Google Scholar 

  37. Masood A, Sheng B, Li P, Hou X, Wei X, Qin J, Feng D (2018) Computer-assisted decision support system in pulmonary cancer detection and stage classification on CT images. J Biomed Inf 79:117–128

    Article  Google Scholar 

  38. Nguyen T, Khosravi A, Creighton D, Nahavandi S (2015) Classification of healthcare data using genetic fuzzy logic system and wavelets. Expert Syst Appl 42(4):2184–2197

    Article  Google Scholar 

  39. Nishio M, Sugiyama O, Yakami M, Ueno S, Kubo T, Kuroda T, Togashi K (2018) Computer-aided diagnosis of lung nodule classification between benign nodule, primary lung cancer, and metastatic lung cancer at different image size using deep convolutional neural network with transfer learning. PLoS ONE 13(7):e0200721

    Article  Google Scholar 

  40. Obayya M, Ghandour M (2015) Lung cancer classification using curvelet transform and neural network with radial basis function. Int J Comput Appl 120(13):33–37

    Google Scholar 

  41. Orozco HM, Villegas OOV, Sánchez VGC, Domínguez HdJO, Alfaro MdJN (2015) Automated system for lung nodules classification based on wavelet feature descriptor and support vector machine. Biomed Eng Online 14(1):9

    Article  Google Scholar 

  42. Ozekes S, Osman O (2010) Computerized lung nodule detection using 3D feature extraction and learning based algorithms. J Med Syst 34(2):185–194

    Article  Google Scholar 

  43. Rastegari M, Ordonez V, Redmon J, Farhadi A (2016) Xnor-net: imagenet classification using binary convolutional neural networks. In: European conference on computer vision. Springer, Berlin, pp 525–542

  44. Roth HR, Lu L, Liu J, Yao J, Seff A, Cherry K, Kim L, Summers RM (2015) Improving computer-aided detection using convolutional neural networks and random view aggregation. IEEE Trans Med Imaging 35(5):1170–1181

    Article  Google Scholar 

  45. Roth HR, Lu L, Liu J, Yao J, Seff A, Cherry K, Kim L, Summers RM (2016) Improving computer-aided detection using convolutional neural networks and random view aggregation. IEEE Trans Med Imaging 35(5):1170–1181

    Article  Google Scholar 

  46. Saad M.N, Muda Z, Ashaari N.S, Hamid H.A (2014) Image segmentation for lung region in chest X-ray images using edge detection and morphology. In: Control system, computing and engineering (ICCSCE), 2014 IEEE international conference on. IEEE, pp 46–51

  47. Serj M.F, Lavi B, Hoff G, Valls D.P (2018) A deep convolutional neural network for lung cancer diagnostic. arXiv preprint arXiv:1804.08170

  48. Setio AAA, Ciompi F, Litjens G, Gerke P, Jacobs C, Van Riel SJ, Wille MMW, Naqibullah M, Sánchez CI, van Ginneken B (2016) Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging 35(5):1160–1169

    Article  Google Scholar 

  49. Shen W, Zhou M, Yang F, Yu D, Dong D, Yang C, Zang Y, Tian J (2017) Multi-crop convolutional neural networks for lung nodule malignancy suspiciousness classification. Pattern Recognit 61:663–673

    Article  Google Scholar 

  50. Shi Z, Hao H, Zhao M, Feng Y, He L, Wang Y, Suzuki K (2019) A deep cnn based transfer learning method for false positive reduction. Multimed Tools Appl 78(1):1017–1033

    Article  Google Scholar 

  51. Siegel RL, Miller KD, Jemal A (2018) Cancer statistics. CA Cancer J Clin 68(1):7–30. https://doi.org/10.3322/caac.21442

    Article  Google Scholar 

  52. Sun W, Zheng B, Qian W (2017) Automatic feature learning using multichannel roi based on deep structured algorithms for computerized lung cancer diagnosis. Comput Biol Med 89:530–539

    Article  Google Scholar 

  53. Takahashi R, Kajikawa Y (2017) Computer-aided diagnosis: a survey with bibliometric analysis. Int J Med Inf 101:58–67

    Article  Google Scholar 

  54. Tan J, Huo Y, Liang Z, Li L (2017) Apply convolutional neural network to lung nodule detection: recent progress and challenges. In: International conference on smart health. Springer, Berlin, pp 214–222

  55. Team NLSTR (2011) Reduced lung-cancer mortality with low-dose computed tomographic screening. N Engl J Med 365(5):395–409

  56. Wan S, Lee HC, Huang X, Xu T, Xu T, Zeng X, Zhang Z, Sheikine Y, Connolly JL, Fujimoto JG et al (2017) Integrated local binary pattern texture features for classification of breast tissue imaged by optical coherence microscopy. Med Image Anal 38:104–116

    Article  Google Scholar 

  57. Wikipedia Contributors (2018) Cellular neural network—Wikipedia, the free encyclopedia. https://en.wikipedia.org/w/index.php?title=Cellular_neural_network&oldid=869201596. Accessed 31 Dec 2018

  58. Wikipedia contributors (2018) Deep learning— Wikipedia, the free encyclopedia. https://en.wikipedia.org/w/index.php?title=Deep_learning&oldid=875207371. Accessed 31 Dec 2018

  59. Woźniak M, Połap D, Capizzi G, Sciuto GL, Kośmider L, Frankiewicz K (2018) Small lung nodules detection based on local variance analysis and probabilistic neural network. Comput Methods Programs Biomed 161:173–180

    Article  Google Scholar 

  60. Xie H, Yang D, Sun N, Chen Z, Zhang Y (2019) Automated pulmonary nodule detection in CT images using deep convolutional neural networks. Pattern Recognit 85:109–119

    Article  Google Scholar 

  61. Zeng JY, Ye HH, Yang SX, Jin RC, Huang QL, Wei YC, Huang SG, Wang BQ, Ye JZ, Qin JY (2015) Clinical application of a novel computer-aided detection system based on three-dimensional CT images on pulmonary nodule. International J Clin Exp Med 8(9):16077

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Engineering, Vellore Institute of Technology, Vellore, India

    Supriya Suresh

  2. Institute for Industry and International Programmes, Vellore Institute of Technology, Vellore, India

    Subaji Mohan

Authors
  1. Supriya Suresh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Subaji Mohan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Subaji Mohan.

Ethics declarations

Conflict of interest

The authors have no conflict of interest to report this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Suresh, S., Mohan, S. ROI-based feature learning for efficient true positive prediction using convolutional neural network for lung cancer diagnosis. Neural Comput & Applic 32, 15989–16009 (2020). https://doi.org/10.1007/s00521-020-04787-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-04787-w

Keywords

Search

Navigation