Skip to main content
SpringerLink
Log in

A robotics and computer-aided procedure for defect evaluation in bridge inspection

  • Original Paper
  • Published:
Journal of Civil Structural Health Monitoring Aims and scope Submit manuscript

Abstract

Image processing may enhance condition assessment of bridge defects. In this perspective, we propose robotics and computer-aided procedure, which enables quantitative evaluation of defect extension with a specific storage organization, and performed by unmanned aerial vehicle (UAV). The methodology for defect evaluation uses color-based image processing. Data contained in digital images are taken on pre-classified structural elements. A campaign of UAV-based inspections has been performed to evidence the potentiality of the proposed procedure. Recurrent defects, occurring in infrastructure belonging to the Italian National railway system, allow evidencing the main features of the developed image-processing algorithm. The proposed process of damage detection and quantification is discussed with respect to both the level of automation that can be reached in each phase and the robustness of the used image processing adopted procedure.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Phares BM, Rolander DD, Graybeal BA, Washer GA (2001). Reliability of visual bridge inspection. Public Roads 64(5)

  2. Kim H, Sim SH, Cho S (2015) Unmanned Aerial Vehicle (UAV)-powered Concrete Crack Detection based on Digital Image processing. In: Proceedings of the 6th International Conference on Advances in Experimental Structural Engineering, 1–2 August, Urbana-Champaign, Illinois.

  3. Gattulli V, Chiaramonte L (2005) Condition assessment by visual inspection for a bridge management system. Comput Aided Civil Infrastruct Eng 20:95–107

    Article  Google Scholar 

  4. Yeum CM, Dyke SJ (2015) Vision-based automated crack detection for bridge inspection. Comput Aided Civil Infrastruct Eng 30:759–770

    Article  Google Scholar 

  5. Lee S, Kalos N (2015) Bridge inspection practices using non-destructive testing methods. J Civ Eng Manag 21(5):54–665

    Article  Google Scholar 

  6. Izumi Y, Sakagami T, Kubo S, Tamakoshi T (2008) Nondestructive evaluation of fatigue cracks in steel bridges by infrared thermography. In: Proceedings of ASCE 2008 International Orthotropic Bridge Conference, 25–29 August, Sacramento, California

  7. Sakagami T, Izumi Y, Kubo S (2010) Application of infrared thermography to structural integrity evaluation of steel bridges. J Mod Opt 57(18):1738–1746

    Article  MATH  Google Scholar 

  8. Kim H, Lee J, Ahn E, Cho S, Shin M, Sim S (2017) Concrete crack identification using a UAV incorporating hybrid image processing. Sensors 17(9):1–14

    Article  Google Scholar 

  9. Lim RS, La HM (2014) A robotic crack inspection and mapping system for bridge deck maintenance. IEEE Trans Automat Sci Eng 11(2):367–378

    Article  Google Scholar 

  10. Salman M, Baporikar V (2015) Image based detection and inspection of cracks on bridge surface using an autonomous robot. Int J Recent Innov Trends Comput Commun 3(2):23–27

    Google Scholar 

  11. Hirose S, Tsutsumitake H (1992) Disk rover: a wall-climbing robot using permanent magnet disks. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, Raleigh, North Carolina

  12. Figliolini G, Rea P, Conte M (2010) Mechanical Design of a Novel Biped Climbing and Walking Robot. In ROMANSY 2010, 18th CISM-IFToMM Symposium on Robot Design, Dynamics, and Control, pp 199–206

  13. Ottaviano E, Rea P, Castelli G (2014) THROO: a tracked hybrid rover to overpass obstacles. Adv Robot 28(10):683–694

    Article  Google Scholar 

  14. Ottaviano E, Rea P (2013) Design and operation of a 2-DOF leg-wheel hybrid robot. Robotica 31(8):1319–1325

    Article  Google Scholar 

  15. Guo L, Rogers K, Kirkham R (1997) A climbing robot with continuous motion. In: Proceedings of IEEE international conference on robotics and automation, 21–27 April, Albuquerque, New Mexico

  16. Savall J, Avello A, Briones L (1999) Two compact robots for remote inspection of hazardous areas in nuclear power plants. In: Proceedings of IEEE international conference on robotics and automation, Detroit, Michigan.

  17. Hallerman N, Morgentahal G (2014) Visual inspection strategies for large bridges using unmanned aerial vehicles. In: Proceedings of 7th international conference on bridge maintenance, safety, management and life extension, CRC Press, 7–11 July, Shanghai, China

  18. Ottaviano E, Vorotnikov S, Ceccarelli M, Kurenev P (2011) Design improvements and control of a hybrid walking robot. Robot Auton Syst 59:128–141

    Article  Google Scholar 

  19. Rea P, Ottaviano E (2018) Design and development of an inspection robotic system for indoor applications. Robot Comput Integr Manuf 49:143–151

    Article  Google Scholar 

  20. Kang D, Cha YJ (2018) Autonomous UAVs for structural health monitoring using deep learning and an ultrasonic beacon system with geo-tagging. Comput Aided Civ Infrastruct Eng 33(10):885–902

    Article  Google Scholar 

  21. Gattulli V, Ottaviano E, Pelliccio A (2018) Mechatronics in the process of cultural heritage and civil infrastructure management, Chapter in Ottaviano, Pelliccio, Gattulli (eds) Springer, Berlin

  22. Liu YF, Cho S, Spencer BF, Fan J (2014) Automated assessment of cracks on concrete surfaces using adaptive digital image processing. Smart Struct Syst 14:719–741

    Article  Google Scholar 

  23. Chen FC, Jahamshahi MR, Wu RT, Joffe C (2017) A texture-based video processing methodology using bayesian data fusion for autonomous crack detection on metallic surfaces. Comput Aided Civ Infrastruct Eng 32:271–287

    Article  Google Scholar 

  24. Valvona F, Toti J, Gattulli V, Potenza F (2017) Effective seismic strengthening and monitoring of a masonry vault by using Glass Fiber Reinforced Cementitious Matrix with embedded Fiber Bragg Grating sensors. Compos B Eng 113:355–370

    Article  Google Scholar 

  25. Potenza F, Federici F, Lepidi M, Gattulli V, Graziosi F, Colarieti A (2015) Long term structural monitoring of the damaged Basilica S. Maria di Collemaggio through a low-cost wireless sensor network. J Civ Struct Health Monit 5(5):655–676

    Article  Google Scholar 

  26. Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition, CVPR 2001, 8–14 December, Kauai, Hawai

  27. Bay H, Ess A, Tuytelaars T, Van Gool L (2008) Speeded-up robust features (SURF). Comput Vis Image Underst 110(3):346–359

    Article  Google Scholar 

  28. Theo Gevers, Joost van de Weijer, Harro Stokman (2006) Color feature detection. In: Rastislav Lukac, Konstantinos N. Plataniotis (eds) Color image processing: methods and applications, 9, CRC Press, pp. 203–226, 978-0-8493-9774-5

  29. Khan FS, Anwer RM, Van De Weijer J, Bagdanov AD, Vanrell M, Lopez AM (2012) Color attributes for object detection. In: Proceedings of Computer Vision and Pattern Recognition (CVPR), 2012 IEEE, 16–21 June, Providence, Rhode Island

  30. Potenza F, Castelli G, Gattulli V, Ottaviano E (2017) Integrated process of images and acceleration measurements for damage detection. In: Proceedings of 10th international conference on structural dynamics, EURODYN 2017, 10–13 September, Rome, Italy

  31. Khattab D, Ebied HM, Hussien AS, Tolba MF (2014) Color image segmentation based on different color space models using automatic GrabCut. Hindawi Publishing Corporation, The Scientific World Journal, Article ID 126025

  32. Jung H, Lee C, Park G (2017) Fast and non-invasive surface crack detection of press panels using image processing. In: Proceedings of 6th Asia Pacific workshop on structural health monitoring, 6th APWSHM, 7–9 December, Hobart, Australia, Procedia Engineering, 188, 72–79

  33. Wang X, Hänsch R, Ma L, Hellwich O (2014) Comparison of different color spaces for image segmentation using graph-cut. In: Proceedings of the international conference on computer vision theory and applications (VISAPP), 5–8 January, Lisbon, Portugal

  34. Abdel-Qader I, Pashaie-Rad S, Abudayyeh O, Yehia S (2006) PCA-based algorithm for unsupervised bridge crack detection. Adv Eng Softw 37(12):771–778

    Article  Google Scholar 

  35. Fujita Y, Hamamoto Y (2005) A robust automatic crack detection method from noisy concrete surfaces. Mach Vis Appl 22(2):245–254

    Article  Google Scholar 

  36. Saar T, Talvik O (2010) automatic asphalt pavement crack detection and classification using neural networks. In: Proceedings of the 12th Biennial Baltic Electronics Conference, 4–6 October, Tallin, Estonia

  37. Chen Z, Hutchinson TC (2010) Image-based framework for concrete surface crack monitoring and quantification. Adv Civ Eng, Article ID 215295.

  38. Nishikawa T, Yoshida J, Sugiyama T, Fujino Y (2012) Concrete crack detection by multiple sequential image filtering. Comput Aided Civ Infrastruct Eng 27(1):29–47

    Article  Google Scholar 

  39. Jahanshahi MR, Masri SF (2012) Adaptive vision-based crack detection using 3D scene reconstruction for condition assessment of structures. Autom Constr 22:567–576

    Article  Google Scholar 

  40. Cha YJ, Choi W, Büyüköztürk O (2017) Deep learning-based crack damage detection using convolutional neural networks. Comput Aided Civ Infrastruct Eng 32(5):361–378

    Article  Google Scholar 

  41. Cha YJ, Choi W, Suh G, Mahmoudkhani S, Büyüköztürk O (2017) Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types. Comput Aided Civ Infrastruct Eng 33:731–747

    Article  Google Scholar 

  42. Lin YZ, Nie ZH, Ma HW (2017) Structural damage detection with automatic feature-extraction through deep learning. Comput Aided Civ Infrastruct Eng 32(12):1025–1046

    Article  Google Scholar 

  43. Xu Y, Bao Y, Chen J, Zuo W, Li H (2019) Surface fatigue crack identification in steel box girder of bridges by a deep fusion convolutional neural network based on consumer-grade camera images. Struct Health Monit 18(3):653–674

    Article  Google Scholar 

  44. Cruz-Ramırez SR, Mae Y, Arai T, Takubo T, Ohara K (2011) Vision-based hierarchical recognition for dismantling robot applied to interior renewal of buildings. Comput Aided Civ Infrastruct Eng 26(5):336–355

    Article  Google Scholar 

  45. Liu YF, Cho S, Spencer BF, Fan J (2016) Concrete crack assessment using digital image processing and 3D scene reconstruction. J Comput Civ Eng 30:1–19

    Article  Google Scholar 

  46. Chen ZQ, Chen J (2014) Mobile imaging and computing for intelligent structural damage inspection. Hindawi Publishing Corporation, Advances in Civil Engineering, Article ID 483729

  47. Wang C-C, Thorpe C, Thrun S, Hebert M, Durrant-Whyte H (2007) Simultaneous localization, mapping and moving object tracking. Int J Robot Res 26(9):889–916

    Article  Google Scholar 

  48. Ni F, Zhang J, Chen ZQ (2018) Zernike-moment measurement of thin-crack width in images enables by dual-scale deep learning. Comput Aided Civ Infrastruct Eng 34(5):367–384

    Article  Google Scholar 

Download references

Acknowledgements

The research leading to these results has received funding from the Italian Government under Cipe resolution n.135 (Dec. 21, 2012), project INnovating City Planning through Information and Communication Technologies. The results of the steel bridge are part of a project that has received funding from the Research Fund for Coal and Steel under Grant No. 800687.

Author information

Authors and Affiliations

  1. Department of Civil, Construction-Architectural and Environmental Engineering, University of L’Aquila, Via Giovanni Gronchi 18, 67100, L’Aquila, Italy

    Francesco Potenza & Cecilia Rinaldi

  2. Department of Civil and Mechanical Engineering, University of Cassino and Southern Lazio, Via G. Di Biasio 43, 03043, Cassino, Italy

    Erika Ottaviano

  3.  Department of Structural and Geotechnical Engineering, Sapienza University of Rome, Via Eudossiana 18, 00184, Rome, Italy

    Vincenzo Gattulli

Authors
  1. Francesco Potenza
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cecilia Rinaldi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Erika Ottaviano
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Vincenzo Gattulli
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vincenzo Gattulli.

Ethics declarations

Conflict of interest

The author declares that he has no conlict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Potenza, F., Rinaldi, C., Ottaviano, E. et al. A robotics and computer-aided procedure for defect evaluation in bridge inspection. J Civil Struct Health Monit 10, 471–484 (2020). https://doi.org/10.1007/s13349-020-00395-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13349-020-00395-3

Keywords

Search

Navigation