Skip to main content
SpringerLink
Log in

Deep learning-based visual defect-inspection system for reinforced concrete bridge substructure: a case of Thailand’s department of highways

  • Original Paper
  • Published:
Journal of Civil Structural Health Monitoring Aims and scope Submit manuscript

Abstract

Reinforced concrete bridge substructures are one of the most important road components, requiring routine maintenance for road safety. These structures initially require visual inspection to identify and prioritize maintenance processes based on the damage severity deteriorating the structural strength of the bridge. However, owing to the limitations concerning field inspector resources and budget management efficiency, automation technology is introduced to support field inspectors for developing faster defect detection and inspection processes with high accuracy on a large scale. It has advantages in utilizing the limited number of field inspectors more efficiently and preventing the development of defect severity, which requires more time and budget resources for maintenance. This paper describes the complete development of a deep learning-based visual defect-inspection system for reinforced concrete bridge substructures. The system consists of four main components. The first part involves the image acquisition. The second part aims to detect images with defects using a modified ResNet-50 CNN, improved from our previous research. The third part is defect classification, where different types of defects, such as cracking, erosion, honeycomb, scaling, and spalling, are classified using a previous modified ResNet-50. The last part considers the severity prediction using ANN. As a result, the inspection accuracy rate for defect detection, classification accuracy, and severity prediction are 90.4%, 81%, and 78%, respectively. The promising results of this study were acceptable by Thailand’s Department of Highways for practical use. Finally, this study could support Thailand’s Department of Highways and surrounding construction industries as a standard strategy toward digital transformation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Sullivan G (2018) Global digital transformation on the building and construction sector, Forecast to 2025. North America: Frost & Sullivan.

  2. Ismail SA, Bandi S, Maaz ZN (2018) An appraisal into the potential application of big data in the construction industry. Int J Built Environ Sustain. https://doi.org/10.11113/ijbes.v5.n2.274.

  3. McRobbie SG, Wright MA, Chan A (2015) Can technology improve routine visual bridge inspections? Proc Inst Civil Eng. 168:197–207. https://doi.org/10.1680/jbren.12.00022

    Article  Google Scholar 

  4. Global status report on road safety 2018: Summary (2018) World Health Organization.

  5. Brysse D (2010) Non-destructive evaluation of reinforced concrete structures. Woodhead Publishing, Sawston, pp 28–56

    Book  Google Scholar 

  6. Final inspection report of damage and load testing for slab type bridge in the area of Highway Bureau 5 (2008) Khon Kaen Province, Thailand: Thailand Department of Highway.

  7. Hüthwohl P, Lu R and Brilakis I (2011) Challenges of bridge maintenance inspection. In: the 16th international conference on computing in civil and building engineering, Osaka, Japan

  8. Ding Y, Han R, Liu H, et al. Bridge inspection and management system based on smart phone. In: Volume 1: Multifunctional Materials; Mechanics and Behavior of Active Materials; Integrated System Design and Implementation; Structural Health Monitoring. 2016.

  9. Weinstein JC, Sanayei M, Brenner BR (2018) Bridge damage identification using artificial neural networks. J Bridge Eng. https://doi.org/10.1061/(ASCE)BE.1943-5592.0001302

    Article  Google Scholar 

  10. Bilal M, Oyedele LO, Qadir J et al (2016) Big data in the construction industry: a review of present status, opportunities, and future trends. Adv Eng Inform 30:500–521. https://doi.org/10.1016/j.aei.2016.07.001

    Article  Google Scholar 

  11. Abdel-Qader I, Abudayyeh O, Kelly ME (2003) Analysis of edge-detection techniques for crack identification in bridges. J Comput Civil Eng 17:255–263. https://doi.org/10.1061/(ASCE)0887-3801(2003)17:4(255)

    Article  Google Scholar 

  12. Mohan A, Poobal S (2018) Crack detection using image processing: a critical review and analysis. Alexandria Eng J 57:787–798. https://doi.org/10.1016/j.aej.2017.01.020

    Article  Google Scholar 

  13. Moon, HG, & Kim, JH. Intelligent Crack Detection Algorithm on the Concrete Crack Image Using Neural Network. In: 28th International Symposium on Automation and Robotics in Construction (ISARC) Republic of Korea, 2011.

  14. Bu GP, Chanda S, Guan H et al (2015) Crack detection using a texture analysis-based technique for visual bridge inspection. Electron J Struct Eng 14(1):41–48

    Google Scholar 

  15. Kim H, Ahn E, Shin M et al (2018) Crack and noncrack classification from concrete surface images using machine learning. Struct Health Monit 18:725–738. https://doi.org/10.1177/1475921718768747

    Article  Google Scholar 

  16. Wang Z, Xu G, Ding Y et al (2020) A vision-based active learning convolutional neural network model for concrete surface crack detection. Adv Struct Eng 23:2952–2964. https://doi.org/10.1177/1369433220924792

    Article  Google Scholar 

  17. Zhang L, Shen J, Zhu B (2020) A research on an improved Unet-based concrete crack detection algorithm. Struct Health Monit. https://doi.org/10.1177/1475921720940068

    Article  Google Scholar 

  18. Adhikari RS, Moselhi O and Bagchi A (2012) Automated prediction of condition state rating in bridge inspection. ISG*ISARC2012 Full paper proceedings

  19. Kruachottikul P, Cooharojananone N, Phanomchoeng G, et al (2019) Bridge sub structure defect inspection assistance by using deep learning. In: 10th international conference on awareness science and technology (iCAST). https://doi.org/10.1109/ICAwST.2019.8923507

  20. He K, Zhang X, Ren S, et al (2016) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR) Las Vegas, NV

  21. Xin M, Wang Y (2019) Research on image classification model based on deep convolution neural network. EURASIP J Image Video Proc. https://doi.org/10.1186/s13640-019-0417-8

    Article  Google Scholar 

  22. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems. pp. 1097–1105.

  23. Szegedy C et al (2015) Going deeper with convolutions. In: The IEEE conference on computer vision and pattern recognition

  24. Szegedy C et al (2017) Inception-v4, Inception-ResNet and the impact of residual connections on learning. In: The 31st AAAI conference on artificial intelligence

  25. Yosinski J et al. How transferable are features in deep neural networks? In: Advances in Neural Information Processing Systems 2014.

  26. Zhang L et al (2020) Auxiliary training: towards accurate and robust models. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition

  27. Gontijo LR, Yin D, Poole B, et al (2019) Improving robustness without sacrificing accuracy with patch Gaussian augmentation. arXiv:1906.02611.

  28. Canziani A, Paszke A, Culurciello E (2016) An analysis of deep neural network models for practical applications. arXiv:1605.07678.

  29. Chollet F (2020) Keras. https://keras.io. Accessed 5 Aug 2020

  30. Amazon.com I (2020) Amazon Web Service. https://aws.amazon.com/. Accessed 12 Aug 2020.

  31. Agarap, Abien Fred (2018) Deep learning using rectified linear units (relu). arXiv:1803.08375.

Download references

Acknowledgements

The writers would like to thank the Bureau of Road Research and Development of Thailand, Department of Highways, Ministry of Transportation for assisting the required information, image dataset, and knowledge to complete this research. Moreover, we want to express our gratitude to Solitech Innovations and Technologies Co., Ltd., for supporting through the software and hardware used in this research.

Funding

The authors received no financial support for the research, authorship, and/or publication of this article.

Author information

Authors and Affiliations

  1. Technopreneurship and Innovation Management Program, Graduate School, Chulalongkorn University, Bangkok, Thailand

    Pravee Kruachottikul

  2. Department of Mathematics and Computer Science, Faculty of Science, Chulalongkorn University, Bangkok, Thailand

    Nagul Cooharojananone, Kittikul Kovitanggoon & Donnaphat Trakulwaranont

  3. Wireless Communication Research Unit, Department of Mechanical Engineering, Faculty of Engineering, Chulalongkorn University, Bangkok, Thailand

    Gridsada Phanomchoeng

  4. Department of Commerce, Chulalongkorn Business School, Chulalongkorn University, Bangkok, Thailand

    Thira Chavarnakul

Authors
  1. Pravee Kruachottikul
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nagul Cooharojananone
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gridsada Phanomchoeng
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Thira Chavarnakul
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kittikul Kovitanggoon
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Donnaphat Trakulwaranont
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nagul Cooharojananone.

Ethics declarations

Conflict of interest

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kruachottikul, P., Cooharojananone, N., Phanomchoeng, G. et al. Deep learning-based visual defect-inspection system for reinforced concrete bridge substructure: a case of Thailand’s department of highways. J Civil Struct Health Monit 11, 949–965 (2021). https://doi.org/10.1007/s13349-021-00490-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13349-021-00490-z

Keywords

Search

Navigation