Skip to main content
SpringerLink
Log in

A novel enhanced region proposal network and modified loss function: threat object detection in secure screening using deep learning

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Detection of threat objects concealed in passenger clothing and baggage poses a challenge to aviation security. At present, the detection technology is capable of detecting the presence of threats from the scanned images yet requires the involvement of human in determining what type of threat and where it is located. Deep learning-based object detection technique has not been successfully implemented to detect threats in the security screening processes. This research aims to improve the accuracy and the processing time of threat detection in security screening. Enhanced faster region-based convolutional neural network (faster R-CNN) with improved region proposals is used for better threat localization. The proposed system consists of an improved region proposal network that outputs object’s region proposals with an object score to the detector module to accurately locate the threat in the human body. Furthermore, this system uses a modified loss function that strengthens the classification loss. Results obtained by the proposed model show a 15% improvement in object localization. Therefore, the enhanced faster R-CNN achieves an overall detection accuracy of 0.27 in terms of average precision and reduces the processing time by 0.19 s. The results obtained by the enhanced faster R-CNN for detection accuracy are superior to the state-of-the-art system. Also, this model focuses on localizing the threat and identifying its type, which makes the model suitable for threat detection security screening. Besides, the research also addresses the time consumption issue in detecting the threat object.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Bhattacharyya A, Lind CH, Shirpurkar R (2018) Threat Detection in TSA Scans using AlexNet

  2. Guimaraes A, Tofighi G (2018) Detecting zones and threat on 3D body in security airports using deep learning machine. CoRR. https://doi.org/10.5281/zenodo.1189345

    Article  Google Scholar 

  3. Zhao Z-Q, Zheng P, Xu S-T, Wu X (2018) Object detection with deep learning: a review. CoRR 14(8):3212–3232

    Google Scholar 

  4. Karami E, Shehata M, Smith A (2017) Image identification using SIFT algorithm: performance analysis against different image deformations. arXiv preprint arXiv:1710.02728

  5. Bay H, Tuytelaars T, Van Gool L (2006) SURF: speeded up robust features. In: Leonardis A, Bischof H, Pinz A (eds) Computer vision—ECCV. Springer, Berlin, pp 404–417

    Google Scholar 

  6. Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149

    Article  Google Scholar 

  7. Jaccard N, Rogers TW, Morton EJ, Griffin LD (2017) Detection of concealed cars in complex cargo X-ray imagery using deep learning. J X-ray Sci Technol 25(3):323–339. https://doi.org/10.3233/XST-16199

    Article  Google Scholar 

  8. Jaccard N, Rogers TW, Morton EJ, Griffin LD (2015) Using deep learning on X-ray images to detect threats In: Proceedings Cranfield Defence and Security Doctoral Symposium, 2015, pp 1–12

  9. Akcay S, Kundegorski ME, Willcocks CG, Breckon TP (2018) Using deep convolutional neural network architectures for object classification and detection within X-Ray baggage security imagery. IEEE Trans Inf Forensics Secur 13(9):2203–2215. https://doi.org/10.1109/TIFS.2018.2812196

    Article  Google Scholar 

  10. Akçay S, Kundegorski ME, Devereux M, Breckon TP (2016) Transfer learning using convolutional neural networks for object classification within X-ray baggage security imagery. In: IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA 2016, pp 1057–1061, https://doi.org/10.1109/ICIP.2016.7532519

  11. Svec E, Mery D, Arias M, Riffo V, Saavedra JM, Banerjee S (2017) Modern computer vision techniques for x-ray testing in baggage inspection. IEEE Trans Syst Man Cybern Syst 47(4):682–692

    Article  Google Scholar 

  12. Szegedy C et al (2015) Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp 1–9

  13. Krizhevsky A, Sutskever I, Hinton GE (2017) ImageNet classification with deep convolutional neural networks. Commun ACM 60(6):84–90. https://doi.org/10.1145/3065386

    Article  Google Scholar 

  14. Sánchez J, Perronnin F (2011) High-dimensional signature compression for large-scale image classification. In: Computer Vision and Pattern Recognition (CVPR), 2011: IEEE pp 1665–1672

  15. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, 2012, pp 1097–1105

  16. Riffo V, Mery D (2016) Automated detection of threat objects using adapted implicit shape model. IEEE Trans Syst Man Cybern Syst 46(4):472–482

    Article  Google Scholar 

  17. Riffo V, Flores S, Mery D (2017) Threat objects detection in x-ray images using an active vision approach. J Nondestr Eval 36(3):44. https://doi.org/10.1007/s10921-017-0419-3

    Article  Google Scholar 

  18. Leibe B, Leonardis A, Schiele B (2008) Robust object detection with interleaved categorization and segmentation. Int J Comput Vision 7(1–3):259–289

    Article  Google Scholar 

  19. Caldwell M, Ransley M, Rogers TW, Griffin LD (2017) Transferring x-ray based automated threat detection between scanners with different energies and resolution. Counterterrorism Crime Fight Forensics Surveill Technol 10441:104410F

    Google Scholar 

  20. Rogers TW, Jaccard N, Griffin LD (2017) A deep learning framework for the automated inspection of complex dual-energy x-ray cargo imagery. In: Anomaly Detection and Imaging with X-Rays (ADIX) II, vol 10187, p 101870L, May 2017. https://doi.org/10.3233/XST-16199

  21. Jaccard N, Rogers TW, Griffin DL (2014) Automated detection of cars in transmission X-ray images of freight containers. In: 2014 International Conference on Advanced Video and Signal Based Surveillance (AVSS), 2014: IEEE, pp 387–392

  22. Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2014, pp 580–587

  23. Chen YP, Li Y, Wang G (2018) An enhanced region proposal network for object detection using deep learning method. PloS One 13(9):e0203897. https://doi.org/10.1371/journal.pone.0203897

    Article  Google Scholar 

  24. Maharjan S, Alsadoon A, Prasad PWC, Al-Dalain T, Alsadoon OH (2020) A novel enhanced softmax loss function for brain tumour detection using deep learning. J Neurosci Methods 330:108520. https://doi.org/10.1016/j.jneumeth.2019.108520

    Article  Google Scholar 

  25. Islam A, Zhang Y, Yin D, Camps O, Radke RJ (2018) Correlating Belongings with Passengers in a Simulated Airport Security Checkpoint. In: Proceedings of the 12th International Conference on Distributed Smart Cameras 2018: ACM, p 14

  26. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. CoRR. arXiv:1409.1556

  27. Suhao L, Jinzhao L, Guoquan L, Tong B, Huiqian W, Yu P (2018) Vehicle type detection based on deep learning in traffic scene. Procedia Comput Sci 131:564–572

    Article  Google Scholar 

  28. Girshick R (2015) Fast r-cnn. In: Proceedings of the IEEE International Conference on Computer Vision 2015: The Computer Vision Foundation, pp 1440–1448

  29. Mery D et al (2015) GDXray: The database of X-ray images for nondestructive testing. J Nondestr Eval 34(4):1–12

    Article  Google Scholar 

  30. Start stopwatch timer—MATLAB tic. Mathworks.com. https://www.mathworks.com/help/matlab/ref/tic.html. Accessed 30 January, 2019

  31. "evaluateDetectionPrecision." https://www.mathworks.com/help/vision/ref/evaluatedetectionprecision.html. Accessed 30 January, 2019

Download references

Author information

Authors and Affiliations

  1. School of Computing and Mathematics, Charles Sturt University, Sydney, Australia

    Priscilla Steno, Abeer Alsadoon, P. W. C. Prasad & Thair Al-Dala’in

  2. Department of Islamic Sciences, Al Iraqia University, Baghdad, Iraq

    Omar Hisham Alsadoon

Authors
  1. Priscilla Steno
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abeer Alsadoon
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. P. W. C. Prasad
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Thair Al-Dala’in
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Omar Hisham Alsadoon
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Abeer Alsadoon.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Steno, P., Alsadoon, A., Prasad, P.W.C. et al. A novel enhanced region proposal network and modified loss function: threat object detection in secure screening using deep learning. J Supercomput 77, 3840–3869 (2021). https://doi.org/10.1007/s11227-020-03418-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-020-03418-4

Keywords

Search

Navigation