Skip to main content
Log in

Research of automatic recognition of car license plates based on deep learning for convergence traffic control system

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

The technology that can recognize the license plates of vehicles in real time and manage them automatically is a key element of building an intelligent transportation system. License plate recognition is the most important technique in vehicle image processing used to identify a vehicle. Object recognition using a camera is greatly influenced by environmental factors in which the camera is installed. When the vehicle image is acquired, the image is distorted due to the tilting of the license plate, reflection of light, lighting effects, rainy weather, and nighttime, so that it is difficult to accurately recognize the license plate. In addition, when the geometric distortion of the license plate image or the degradation of the image quality is intensified, it may be more difficult to automatically recognize the license plate image. Therefore, in this paper, we propose a deep learning–based vehicles’ license plate recognition method to detect license plate and recognize characters accurately in complex and diverse environments. As a deep learning model, the YOLO model can be used to detect robust license plates in a variety of environments and to recognize characters quickly and accurately. It can also be seen that the license plate accurately recognizes the license plate with geometric distortion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Du S, Ibrahim M, Shehata M, Badawy W (2013) Automatic license plate recognition (ALPR): a state-of-the-art review. IEEE Trans Circ Syst Video Technol 23(2):311–325

    Article  Google Scholar 

  2. Robert K (2009) Video-based traffic monitoring at day and night vehicle features detection tracking, 2009 12th International IEEE Conference on Intelligent Transportation Systems. IEEE, pp. 1–6

  3. Naito T, Tsukada T, Yamada K, Kozuka K, Yamamoto S (2000) Robust license plate recognition method for passing vehicles under outside environment. IEEE Trans Veh Technol 49(6):2309–2319

    Article  Google Scholar 

  4. An KH, Lee SW, Han WY, Son JC (2013) Technology trends of self-driving vehicles. ETRI Electron Telecommun Trends 28(4):35–44

    Google Scholar 

  5. Montazoli S, Jung C (2018) License Plate Detection and recognition in unconstrained scenarios, Proceedings of the European Conference on Computer Vision (ECCV). pp580–596, 2018

  6. Anagnostopoulos C, Alexandropoulos T, Boutas S, Loumos V, Kayafas E (2005) A template-guided approach to vehicle surveillance and access control, IEEE Conference on Advanced Video and Signal Based Surveillance, pp.534–539

  7. Zheng D, Zhao Y, Wang J (2005) An efficient method of license plate location. Pattern Recogn Lett 26(15):2431–2438

    Article  Google Scholar 

  8. Lee ER, Kim PK, Kim HJ (1994) Automatic recognition of a car license plate using color image processing. Proc 1st Int Conf Image Process 2:301–305

    Article  Google Scholar 

  9. Taktak R, Dufaut M, Husson R (1994) Road modeling and vehicle detection by using image processing, Proceedings of IEEE International Conference on Systems. Man Cybern 3:2153–2158

    Google Scholar 

  10. Bai H, Zhu J, Liu C (2003) A fast license plate extraction method on complex background, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems. Vol. 2:985–987

    Google Scholar 

  11. Suwa M, Wu Y, Kobayashi M, Kimachi M, Ogata S (2000) A stereo based vehicle detection method under windy conditions In Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No. 00TH8511), pp. 246–248

  12. Yoshimori S, Mitsukure Y (2003) License plate detection system in rainy days, Proceedings 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation. Computational Intelligence in Robotics and Automation for the New Millennium (Cat. No. 03EX694). Vol. 2. IEEE, 2003, pp.972–976

  13. Panahi R, Gholampour I (2017) Accurate detection and recognition of dirty vehicle plate numbers for high-speed applications. IEEE Trans Intell Transp Syst 18(4):767–779

    Article  Google Scholar 

  14. Yuan Y, Zou W, Zhao Y, Wang X, Hu X, Komodakis N (2017) A robust and efficient approach to license plate detection. IEEE Trans Image Process 26(3):1102–1114

    Article  MathSciNet  MATH  Google Scholar 

  15. Azam S, Islam MM (2016) Automatic license plate detection in hazardous condition. J Vis Commun Image Represent 36:172–186

    Article  Google Scholar 

  16. Hsu GS, Ambikapathi A, Chung SL, Su CP (2017) Robust license plate detection in the wild, in 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp.1–6

  17. Wu Y, Liu S, Wang X (2013) License plate location method based on texture and color, 2013 IEEE 4th International Conference on Software Engineering and Service Science. IEEE, pp. 361–364

  18. Musoromy Z, Ramalingam S, Bekooy N (2010) Edge detection comparison for license plate detection, 2010 11th International Conference on Control Automation Robotics & Vision. IEEE 2010:1133–1138

    Google Scholar 

  19. Yang F, Ma Z (2005) Vehicle license plate location based on histogramming and mathematical morphology, Fourth IEEE Workshop on Automatic Identification Advanced Technologies (autoid’05). IEEE 2005:89–94

    Google Scholar 

  20. Babu C, Kennedy N, Nallaperumal K (2008) A license plate localization using morphology and recognition, 2008 Annual IEEE India Conference. Vol. 1. IEEE, 2008, pp.34–39

  21. Gou C, Wang K, Yao Y, Li Z (2016) Vehicle license plate recognition based on extremal regions and restricted boltzmann machines. IEEE Trans Intell Transp Syst 17(4):1096–1107

    Article  Google Scholar 

  22. Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2(2):121–167

    Article  Google Scholar 

  23. Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720

    Article  Google Scholar 

  24. Boser BE, Guyon IM, Vapnik VN (1992) A training algorithm for optimal margin classifier, In Proceedings of the fifth annual workshop on Computational learning theory, pp.144–152

  25. Mazanec J, Melisek M, Oravec M, Pavlovicova J (2008) Support vector machines, PCA and LDA in face recognition. J Electr Eng 59(4):203–209

    Google Scholar 

  26. Redmon J, Divvala S, Girshick R, Farhadi A (2016) You Only Look Once: unified, real-time object detection, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.779–788

  27. Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149

  28. Li H, Shen C (2016) Reading car license plates using deep convolutional neural networks and LSTMS. arXiv preprint arXiv:1601.05610

  29. Montazoli S, Jung C (2017) Real-time Brazilian license plate detection and recognition using deep convolution neural networks, 2017 30th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI). IEEE, pp. 55–62

  30. Rafique MA, Pedrycz W, Jeon M (2017) Vehicle license plate detection using region-based convolutional neural networks. Soft Comput 22(19):6429–6440

    Article  Google Scholar 

  31. Bulan O, Kozitsky V, Ramesh P, Shreve M (2017) Segmentation and annotation-free license plate recognition with deep localization and failure identification. IEEE Trans Intell Transp Syst 18(9):2351–2363

    Article  Google Scholar 

  32. Yonetsu S, Iwanmato Y, Wei Chen Y (2019) Two-stage YOLOv2 for accurate license-plate detection in complex scenes, 2019 IEEE International Conference on Consumer Electronics (ICCE), pp1–4

  33. Redmon J, Farhadi A (2017) YOLO9000: better, faster, stronger, Proceedings of the IEEE conference on computer vision and pattern recognition, pp.7263–7271

  34. Laroca R, Severo E, Zanlorensi LA, Oliveira LS, Gonçalves GR, Schwartz WR, Menotti D (2018) A robust real-time automatic license plate recognition based on the YOLO detector, 2018 International Joint Conference on Neural Networks (IJCNN), pp1–10

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Han-Jin Cho.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ahn, H., Cho, HJ. Research of automatic recognition of car license plates based on deep learning for convergence traffic control system. Pers Ubiquit Comput 27, 1139–1148 (2023). https://doi.org/10.1007/s00779-020-01514-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-020-01514-z

Keywords

Navigation