Skip to main content

Advertisement

SpringerLink
Log in

A deep learning-based driver distraction identification framework over edge cloud

  • S.I. : Data Fusion in the era of Data Science
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Currently, the number of traffic accidents has been increased globally. One of the main reasons for this increase is the distraction of the driver on the road. Distracted driving can cause collisions and cause injury, death, or property damage. New techniques can help to mitigate this problem, and one of the recent approaches is to employ body wearable sensors or camera sensors in the vehicle for real-time monitoring and detection of drivers’ distraction and behaviors, such as cell phone use, talking, eating, drinking, radio tuning, navigation interaction, or even combing hair while driving. However, this type of approach requires not only a powerful training module but also a lightweight module for real-time detection and analyzing the captured data. Data need to be collected from specific wearable or camera sensors in order to detect drivers’ distraction and ensure immediate feedback by the administrator for safe driving. Therefore, in this paper, we propose an effective camera-based framework for real-time identification of drivers’ distraction by using a deep learning approach with edge and cloud computing technologies. More specifically, the framework consists of three modules, including the distraction detection module deployed on edge devices in the vehicle environment, the training module deployed in the cloud environment, and finally the analyzing module implemented in the monitoring environment (administrator side) connected with a telecommunication network. The proposed framework is developed using two deep learning models. The first is a custom deep convolutional neural network (CDCNN) model, and the second one is a visual geometry group-16 (VGG16)-based fine-tuned model. Several experiments are conducted on a public large-scale driver distraction dataset to evaluate the two models. The experimental results show that the accuracy rates were 99.64% for the first model and 99.73% for the second model using a holdout test set of 10%. In addition, the first and second models have achieved accuracy rates of 99.36% and 99.57% using a holdout test set of 30%. The results confirmed the applicability and appropriateness of the adopted deep learning models for designing the proposed driver distraction detection framework.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Esteva A, Robicquet A, Ramsundar B, Kuleshov V, DePristo M, Chou K, Cui C, Corrado G, Thrun S, Dean J (2019) A guide to deep learning in healthcare. Nat Med 25(1):24–29

    Article  Google Scholar 

  2. Wang J, Chen Y, Hao S, Peng X, Hu L (2019) Deep learning for sensor-based activity recognition: a survey. Pattern Recogn Lett 119:3–11

    Article  Google Scholar 

  3. Hossain MS, Muhammad G (2019) Emotion recognition using deep learning approach from audio–visual emotional big data. Information Fusion 49:69–78

    Article  Google Scholar 

  4. Hannun AY, Rajpurkar P, Haghpanahi M, Tison GH, Bourn C, Turakhia MP, Ng AY (2019) Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network. Nat Med 25(1):65

    Article  Google Scholar 

  5. Chowdhury A, Shankaran R, Kavakli M, Haque MM (2018) Sensor applications and physiological features in drivers’ drowsiness detection: a review. IEEE Sens J 18(8):3055–3067

    Article  Google Scholar 

  6. Iranmanesh SM, Mahjoub HN, Kazemi H, Fallah YP (2018) An adaptive forward collision warning framework design based on driver distraction. IEEE Trans Intell Transp Syst 19(12):3925–3934

    Article  Google Scholar 

  7. Riaz F, Khadim S, Rauf R, Ahmad M, Jabbar S, Chaudhry J (2018) A validated fuzzy logic inspired driver distraction evaluation system for road safety using artificial human driver emotion. Comput Netw 143:62–73

    Article  Google Scholar 

  8. Chen M, Tian Y, Fortino G, Zhang J, Humar I (2018) Cognitive internet of vehicles. Comput Commun 120:58–70

    Article  Google Scholar 

  9. Hopkins J, Hawking P (2018) Big data analytics and IoT in logistics: a case study. Int J Logist Manage 29(2):575–591

    Article  Google Scholar 

  10. Bi C, Huang J, Xing G, Jiang L, Liu X, Chen M (2019) Safewatch: a wearable hand motion tracking system for improving driving safety. ACM Trans Cyber Phys Syst 4(1):13

    Google Scholar 

  11. Sultana S, Salon D, Kuby M (2019) Transportation sustainability in the urban context: a comprehensive review. Urban Geography 40(3):279–308

    Article  Google Scholar 

  12. Organization WH (2016) World health statistics 2016: monitoring health for the SDGs sustainable development goals. World Health Organization, Geneva

    Google Scholar 

  13. WHO, “Global health estimates 2015: deaths by cause, age, sex, by country and by region, 2000–2015,” ed: World Health Organization Geneva, 2016

  14. Shape HAVW (2013) Testimony of The Honorable David L. Strickland Administrator National Highway Traffic Safety Administration

  15. J. D. J. R. O. H. F. Lee and ergonomics, Driving safety 1(1):172–218 (2005)

  16. Administration NHTS (2016) Traffic safety facts: research note. DOT HS 812:318

    Google Scholar 

  17. Klauer SG, Guo F, Simons-Morton BG, Ouimet MC, Lee SE, Dingus TA (2014) Distracted driving and risk of road crashes among novice and experienced drivers. N Engl J Med 370(1):54–59

    Article  Google Scholar 

  18. Eraqi HM, Abouelnaga Y, Saad MH, Moustafa MN (2019) Driver distraction identification with an ensemble of convolutional neural networks. J Adv Transp 2019:4125865

    Article  Google Scholar 

  19. Eraqi H, EmadEldin Y, Moustafa M (2016) Reactive collision avoidance using evolutionary neural networks. arXiv:08414

  20. Fernández A, Usamentiaga R, Carús JL, Casado R (2016) Driver distraction using visual-based sensors and algorithms. Sensors 16(11):1805

    Article  Google Scholar 

  21. Artan Y, Bulan O, Loce RP, Paul P (2014) Driver cell phone usage detection from HOV/HOT NIR images. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 225–230

  22. Craye C, Karray F (2015) Driver distraction detection and recognition using RGB-D sensor. arXiv:00250

  23. Zhang X, Zheng N, Wang F, He Y (2011) Visual recognition of driver hand-held cell phone use based on hidden CRF. In: Proceedings of 2011 IEEE international conference on vehicular electronics and safety, pp 248–251: IEEE

  24. Hoang Ngan Le T, Zheng Y, Zhu C, Luu K, Savvides M (2016) Multiple scale faster-rcnn approach to driver’s cell-phone usage and hands on steering wheel detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 46–53

  25. Abouelnaga Y, Eraqi HM, Moustafa MN (2017) Real-time distracted driver posture classification. arXiv:.09498

  26. Baheti B, Gajre S, Talbar S (2018) Detection of distracted driver using convolutional neural network. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 1032–1038

  27. Tamas V, Maties V (2019) Real-time distracted drivers detection using deep learning. Am J Artif Intell 3(1):1–8

    Article  Google Scholar 

  28. Alotaibi M, Alotaibi B (2020) Distracted driver classification using deep learning. Signal Image Video Process 14:617–624

    Article  Google Scholar 

  29. Alamri A, Gumaei A, Al-Rakhami M, Hassan MM, Alhussein M, Fortino G (2020) An effective bio-signal-based driver behavior monitoring system using a generalized deep learning approach. IEEE Access 8:135037–135049

    Article  Google Scholar 

  30. Gumaei A, Sammouda R, Al-Salman AMS, Alsanad A (2018) An improved multispectral palmprint recognition system using autoencoder with regularized extreme learning machine. Comput Intell Neurosci 2018

  31. Gumaei A, Sammouda R, Al-Salman AMS, Alsanad A (2019) Anti-spoofing cloud-based multi-spectral biometric identification system for enterprise security and privacy-preservation. J Parallel Distributed Comput 124:27–40

    Article  Google Scholar 

  32. Gumaei A, Sammouda R, Al-Salman A, Alsanad A (2018) An effective palmprint recognition approach for visible and multispectral sensor images. Sensors 18(5):1575

    Article  Google Scholar 

  33. Gumaei A, Hassan MM, Hassan MR, Alelaiwi A, Fortino G (2019) A hybrid feature extraction method with regularized extreme learning machine for brain tumor classification. IEEE Access 7:36266–36273

    Article  Google Scholar 

  34. Al-Rakhami M, Gumaei A, Alsanad A, Alamri A, Hassan MM (2019) An ensemble learning approach for accurate energy load prediction in residential buildings. IEEE Access 7:48328–48338

    Article  Google Scholar 

  35. Fortino G, Parisi D, Pirrone V, Di Fatta G (2014) BodyCloud: a SaaS approach for community body sensor networks. Future Generat Comput Syst 35:62–79

    Article  Google Scholar 

  36. Hassan MM, Gumaei A, Aloi G, Fortino G, Zhou M (2019) A smartphone-enabled fall detection framework for elderly people in connected home healthcare. IEEE Network 33(6):58–63

    Article  Google Scholar 

  37. Gumaei A, Hassan MM, Alelaiwi A, Alsalman H (2019) A hybrid deep learning model for human activity recognition using multimodal body sensing data. IEEE Access 7:99152–99160

    Article  Google Scholar 

  38. Das N, Ohn-Bar E, Trivedi MM (2015) On performance evaluation of driver hand detection algorithms: challenges, dataset, and metrics. In: 2015 IEEE 18th international conference on intelligent transportation systems, pp 2953–2958: IEEE

  39. Hassan MM, Gumaei A, Alsanad A, Alrubaian M, Fortino G (2020) A hybrid deep learning model for efficient intrusion detection in big data environment. Information Sci 513:386–396

    Article  Google Scholar 

  40. Dahl GE, Sainath TN, Hinton GE (2013) Improving deep neural networks for LVCSR using rectified linear units and dropout. In: 2013 IEEE international conference on acoustics, speech and signal processing, pp 8609-8613: IEEE

  41. Chatfield K, Simonyan K, Vedaldi A, Zisserman A (2014) Return of the devil in the details: delving deep into convolutional nets. arXiv:.09498

  42. State Farm Corporate (2016) State farm distracted driver detection. In: Kaggle.com competition website. https://www.kaggle.com/c/state-farm-distracted-driver-detection. Accessed 30 May 2020

Download references

Acknowledgements

This work was funded by the National Plan for Science, Technology and Innovation (MAARIFAH), King Abdulaziz City for Science and Technology, Kingdom of Saudi Arabia, Award Number (12-BIO2831-02).

Author information

Authors and Affiliations

  1. Information Systems Department, College of Computer and Information Sciences, King Saud University, Riyadh, 11543, Saudi Arabia

    Abdu Gumaei, Mabrook Al-Rakhami & Mohammad Mehedi Hassan

  2. Computer Science Department, Faculty of Applied Science, Taiz University, Taiz, Yemen

    Abdu Gumaei

  3. Software Engineering Department, College of Computer and Information Sciences, King Saud University, Riyadh, 11543, Saudi Arabia

    Atif Alamri

  4. Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh, 11543, Saudi Arabia

    Musaed Alhussein

  5. Green Networking Research Group, Department of Computer Science and Engineering, University of Dhaka, Dhaka, 1000, Bangladesh

    Md. Abdur Razzaque

  6. Department of Informatics, Modeling, Electronics, and Systems, University of Calabria, 87036, Rende, Italy

    Giancarlo Fortino

Authors
  1. Abdu Gumaei
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mabrook Al-Rakhami
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mohammad Mehedi Hassan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Atif Alamri
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Musaed Alhussein
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Md. Abdur Razzaque
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Giancarlo Fortino
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammad Mehedi Hassan.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gumaei, A., Al-Rakhami, M., Hassan, M.M. et al. A deep learning-based driver distraction identification framework over edge cloud. Neural Comput & Applic (2020). https://doi.org/10.1007/s00521-020-05328-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00521-020-05328-1

Keywords

Search

Navigation