An Optimization Framework for UAS-Based Infrastructure Inspection Path Planning
Publication: Computing in Civil Engineering 2023
ABSTRACT
Automated visual inspection of infrastructure and the built environment using unmanned aerial systems (UAS) has found considerable traction among infrastructure owners and managers. These inspections rely on the limited battery and payload capacity of the UAS, and therefore optimizing the inspection path is essential for the scalable deployment of these systems. This preliminary study proposes a framework for planning UAS-based inspections by considering visual coverage as a constraint and an optimization objective function that could include path length as well as other performance metrics. The path parameters were optimized accordingly, and the influence of the hyperparameters on the path optimization results and their tradeoffs were also studied. The proposed framework lays the foundation for integrating structural engineering domain expertise into UAS-based inspection path planning.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Alipour, M., Harris, D. K., and Miller, G. R. (2019). “Robust pixel-level crack detection using deep fully convolutional neural networks.” Journal of Computing in Civil Engineering 33.6: 04019040.
Alipour, M., and Harris, D. K. (2020). “A big data analytics strategy for scalable urban infrastructure condition assessment using semi-supervised multi-transform self-training.” Journal of Civil Structural Health Monitoring 10: 313–332.
Alipour, M., and Harris, D. K. (2020). “Increasing the robustness of material-specific deep learning models for crack detection across different materials.” Engineering Structures 206: 110157.
ASCE. (2021). Report card for America’s infrastructure. https://infrastructurereportcard.org/.
Atha, D. J., and Jahanshahi, M. R. (2018). “Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection.” Structural Health Monitoring 17.5: 1110–1128.
Biundini, I. Z., Pinto, M. F., Melo, A. G., Marcato, A. L., Honório, L. M., and Aguiar, M. J. (2021). “A framework for coverage path planning optimization based on point cloud for structural inspection.” Sensors 21.2: 570.
Bolourian, N., and Hammad, A. (2020). “LiDAR-equipped UAV path planning considering potential locations of defects for bridge inspection.” Automation in Construction 117: 103250.
Cha, Y. J., Choi, W., and Büyüköztürk, O. (2017). “Deep learning‐based crack damage detection using convolutional neural networks.” Computer‐Aided Civil and Infrastructure Engineering 32.5: 361–378.
Chen, F. C., and Jahanshahi, M. R. (2017). “NB-CNN: Deep learning-based crack detection using convolutional neural network and Naïve Bayes data fusion.” IEEE Transactions on Industrial Electronics 65.5: 4392–4400.
Cho, S. W., Park, H. J., Lee, H., Shim, D. H., and Kim, S. Y. (2021). “Coverage path planning for multiple unmanned aerial vehicles in maritime search and rescue operations.” Computers & Industrial Engineering 161: 107612.
Davis, L. (1991). Handbook of genetic algorithms.
Dizaji, M. S., Alipour, M., and Harris, D. K. (2021). Subsurface damage detection and structural health monitoring using digital image correlation and topology optimization. Engineering Structures, 230, 111712.
Dizaji, M. S., Alipour, M., and Harris, D. K. (2022). Image-based tomography of structures to detect internal abnormalities using inverse approach. Experimental Techniques, 1–16.
Fortin, F. A., De Rainville, F. M., Gardner, M. A. G., Parizeau, M., and Gagné, C. (2012). “DEAP: Evolutionary algorithms made easy.” The Journal of Machine Learning Research 13.1: 2171–2175.
Horvat, D., and Zalik, B. (2012). “Ray-casting point-in-polyhedron test.” Proceedings of the CESCG 2012: The 16th Central European Seminar on Computer Graphics.
Hoskere, V., Park, J. W., Yoon, H., and Spencer, B. F., Jr. (2019). Vision-based modal survey of civil infrastructure using unmanned aerial vehicles. Journal of Structural Engineering, 145(7), 04019062.
Hoskere, V., Narazaki, Y., Hoang, T. A., and Spencer, B. F., Jr. (2020). “MaDnet: multi-task semantic segmentation of multiple types of structural materials and damage in images of civil infrastructure.” Journal of Civil Structural Health Monitoring 10: 757–773.
Ibrahim, A., Golparvar-Fard, M., and El-Rayes, K. (2022). “Multiobjective Optimization of Reality Capture Plans for Computer Vision–Driven Construction Monitoring with Camera-Equipped UAVs.” Journal of Computing in Civil Engineering 36.5: 04022018.
Jordan, S., Moore, J., Hovet, S., Box, J., Perry, J., Kirsche, K., Lewis, D., and Tse, Z. T. H. (2018). “State‐of‐the‐art technologies for UAV inspections.” IET Radar, Sonar & Navigation 12.2: 151–164.
Kim, H., Narazaki, Y., and Spencer, B. F., Jr. (2023). Automated bridge component recognition using close-range images from unmanned aerial vehicles. Engineering Structures, 274, 115184.
Lattanzi, D., and Miller, G. (2017). “Review of robotic infrastructure inspection systems.” Journal of Infrastructure Systems 23.3: 04017004.
Mirjalili, S., Song Dong, J., Sadiq, A. S., and Faris, H. (2020). “Genetic algorithm: Theory, literature review, and application in image reconstruction.” Nature-Inspired Optimizers: Theories, Literature Reviews and Applications: 69–85.
Máthé, K., and Buşoniu, L. (2015). “Vision and control for UAVs: A survey of general methods and inexpensive platforms for infrastructure inspection.” Sensors 15.7: 14887–14916.
Narazaki, Y., Hoskere, V., Chowdhary, G., and Spencer, B. F. (2022). Vision-based navigation planning for autonomous post-earthquake inspection of reinforced concrete railway viaducts using unmanned aerial vehicles. Automation in Construction, 137, 104214.
Nasimi, R., Moreu, F., Nasimi, M., and Wood, R. (2022). Developing Enhanced Unmanned Aerial Vehicle Sensing System for Practical Bridge Inspections Using Field Experiments. Transportation Research Record, 2676(6), 514–522.
Phung, M. D., Quach, C. H., Dinh, T. H., and Ha, Q. (2017). “Enhanced discrete particle swarm optimization path planning for UAV vision-based surface inspection.” Automation in Construction 81: 25–33.
Shah, S., Dey, D., Lovett, C., and Kapoor, A. (2018). “Airsim: High-fidelity visual and physical simulation for autonomous vehicles.” Field and Service Robotics: Results of the 11th International Conference. Springer International Publishing.
Shanthakumar, P., Yu, K., Singh, M., Orevillo, J., Bianchi, E., Hebdon, M., and Tokekar, P. (2020). “View planning and navigation algorithms for autonomous bridge inspection with UAVs.” Proceedings of the 2018 International Symposium on Experimental Robotics. Springer International Publishing.
Srivastava, P. R., and Kim, T. (2009). “Application of genetic algorithm in software testing.” International Journal of software Engineering and its Applications 3.4: 87–96.
Whitley, T., Tomiczek, A., Tripp, C., Ortega, A., Mennu, M., Bridge, J., and Ifju, P. (2020). Design of a small unmanned aircraft system for bridge inspections. Sensors, 20(18), 5358.
Xu, Y., Li, J., and Zhang, F. (2022). “A UAV-Based Forest Fire Patrol Path Planning Strategy.” Forests 13.11: 1952.
Zhao, Y., Guo, B., Che, H., and Alipour, M. (2023). “Developing Human Sensing Platforms for Digitizing Visual Inspections of Critical Infrastructure.” Structures Congress 2023.
Information & Authors
Information
Published In
Computing in Civil Engineering 2023
Pages: 890 - 898
History
Published online: Jan 25, 2024
ASCE Technical Topics:
- Aerospace engineering
- Aircraft and spacecraft
- Automation and robotics
- Batteries
- Buildings
- Business management
- Construction engineering
- Construction management
- Energy infrastructure
- Energy storage
- Engineering fundamentals
- Infrastructure
- Inspection
- Lifeline systems
- Managers
- Owners
- Payloads
- Personnel (type)
- Personnel management
- Practice and Profession
- Structural engineering
- Structures (by type)
- Systems engineering
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.