Abstract
The technology that can recognize the license plates of vehicles in real time and manage them automatically is a key element of building an intelligent transportation system. License plate recognition is the most important technique in vehicle image processing used to identify a vehicle. Object recognition using a camera is greatly influenced by environmental factors in which the camera is installed. When the vehicle image is acquired, the image is distorted due to the tilting of the license plate, reflection of light, lighting effects, rainy weather, and nighttime, so that it is difficult to accurately recognize the license plate. In addition, when the geometric distortion of the license plate image or the degradation of the image quality is intensified, it may be more difficult to automatically recognize the license plate image. Therefore, in this paper, we propose a deep learning–based vehicles’ license plate recognition method to detect license plate and recognize characters accurately in complex and diverse environments. As a deep learning model, the YOLO model can be used to detect robust license plates in a variety of environments and to recognize characters quickly and accurately. It can also be seen that the license plate accurately recognizes the license plate with geometric distortion.
Similar content being viewed by others
References
Du S, Ibrahim M, Shehata M, Badawy W (2013) Automatic license plate recognition (ALPR): a state-of-the-art review. IEEE Trans Circ Syst Video Technol 23(2):311–325
Robert K (2009) Video-based traffic monitoring at day and night vehicle features detection tracking, 2009 12th International IEEE Conference on Intelligent Transportation Systems. IEEE, pp. 1–6
Naito T, Tsukada T, Yamada K, Kozuka K, Yamamoto S (2000) Robust license plate recognition method for passing vehicles under outside environment. IEEE Trans Veh Technol 49(6):2309–2319
An KH, Lee SW, Han WY, Son JC (2013) Technology trends of self-driving vehicles. ETRI Electron Telecommun Trends 28(4):35–44
Montazoli S, Jung C (2018) License Plate Detection and recognition in unconstrained scenarios, Proceedings of the European Conference on Computer Vision (ECCV). pp580–596, 2018
Anagnostopoulos C, Alexandropoulos T, Boutas S, Loumos V, Kayafas E (2005) A template-guided approach to vehicle surveillance and access control, IEEE Conference on Advanced Video and Signal Based Surveillance, pp.534–539
Zheng D, Zhao Y, Wang J (2005) An efficient method of license plate location. Pattern Recogn Lett 26(15):2431–2438
Lee ER, Kim PK, Kim HJ (1994) Automatic recognition of a car license plate using color image processing. Proc 1st Int Conf Image Process 2:301–305
Taktak R, Dufaut M, Husson R (1994) Road modeling and vehicle detection by using image processing, Proceedings of IEEE International Conference on Systems. Man Cybern 3:2153–2158
Bai H, Zhu J, Liu C (2003) A fast license plate extraction method on complex background, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems. Vol. 2:985–987
Suwa M, Wu Y, Kobayashi M, Kimachi M, Ogata S (2000) A stereo based vehicle detection method under windy conditions In Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No. 00TH8511), pp. 246–248
Yoshimori S, Mitsukure Y (2003) License plate detection system in rainy days, Proceedings 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation. Computational Intelligence in Robotics and Automation for the New Millennium (Cat. No. 03EX694). Vol. 2. IEEE, 2003, pp.972–976
Panahi R, Gholampour I (2017) Accurate detection and recognition of dirty vehicle plate numbers for high-speed applications. IEEE Trans Intell Transp Syst 18(4):767–779
Yuan Y, Zou W, Zhao Y, Wang X, Hu X, Komodakis N (2017) A robust and efficient approach to license plate detection. IEEE Trans Image Process 26(3):1102–1114
Azam S, Islam MM (2016) Automatic license plate detection in hazardous condition. J Vis Commun Image Represent 36:172–186
Hsu GS, Ambikapathi A, Chung SL, Su CP (2017) Robust license plate detection in the wild, in 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp.1–6
Wu Y, Liu S, Wang X (2013) License plate location method based on texture and color, 2013 IEEE 4th International Conference on Software Engineering and Service Science. IEEE, pp. 361–364
Musoromy Z, Ramalingam S, Bekooy N (2010) Edge detection comparison for license plate detection, 2010 11th International Conference on Control Automation Robotics & Vision. IEEE 2010:1133–1138
Yang F, Ma Z (2005) Vehicle license plate location based on histogramming and mathematical morphology, Fourth IEEE Workshop on Automatic Identification Advanced Technologies (autoid’05). IEEE 2005:89–94
Babu C, Kennedy N, Nallaperumal K (2008) A license plate localization using morphology and recognition, 2008 Annual IEEE India Conference. Vol. 1. IEEE, 2008, pp.34–39
Gou C, Wang K, Yao Y, Li Z (2016) Vehicle license plate recognition based on extremal regions and restricted boltzmann machines. IEEE Trans Intell Transp Syst 17(4):1096–1107
Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2(2):121–167
Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720
Boser BE, Guyon IM, Vapnik VN (1992) A training algorithm for optimal margin classifier, In Proceedings of the fifth annual workshop on Computational learning theory, pp.144–152
Mazanec J, Melisek M, Oravec M, Pavlovicova J (2008) Support vector machines, PCA and LDA in face recognition. J Electr Eng 59(4):203–209
Redmon J, Divvala S, Girshick R, Farhadi A (2016) You Only Look Once: unified, real-time object detection, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.779–788
Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149
Li H, Shen C (2016) Reading car license plates using deep convolutional neural networks and LSTMS. arXiv preprint arXiv:1601.05610
Montazoli S, Jung C (2017) Real-time Brazilian license plate detection and recognition using deep convolution neural networks, 2017 30th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI). IEEE, pp. 55–62
Rafique MA, Pedrycz W, Jeon M (2017) Vehicle license plate detection using region-based convolutional neural networks. Soft Comput 22(19):6429–6440
Bulan O, Kozitsky V, Ramesh P, Shreve M (2017) Segmentation and annotation-free license plate recognition with deep localization and failure identification. IEEE Trans Intell Transp Syst 18(9):2351–2363
Yonetsu S, Iwanmato Y, Wei Chen Y (2019) Two-stage YOLOv2 for accurate license-plate detection in complex scenes, 2019 IEEE International Conference on Consumer Electronics (ICCE), pp1–4
Redmon J, Farhadi A (2017) YOLO9000: better, faster, stronger, Proceedings of the IEEE conference on computer vision and pattern recognition, pp.7263–7271
Laroca R, Severo E, Zanlorensi LA, Oliveira LS, Gonçalves GR, Schwartz WR, Menotti D (2018) A robust real-time automatic license plate recognition based on the YOLO detector, 2018 International Joint Conference on Neural Networks (IJCNN), pp1–10
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ahn, H., Cho, HJ. Research of automatic recognition of car license plates based on deep learning for convergence traffic control system. Pers Ubiquit Comput 27, 1139–1148 (2023). https://doi.org/10.1007/s00779-020-01514-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00779-020-01514-z