An Intelligent Robotic Sensing System for Indoor Building System Inspection
Publication: Computing in Civil Engineering 2023
ABSTRACT
Regular indoor building inspections and maintenance are essential to prevent property damage and sustain its condition and functionality for the intended occupants. Traditional inspection is heavily labor-intensive, time-consuming, experience-based, and error-prone. With the growing development of multi-sensor and artificial intelligence (AI)-empowered unmanned ground vehicles (UGV), inspection activities can be automated and digitalized. However, there is a lack of knowledge on how to incorporate them effectively for streamlined inspection of indoor building systems. This paper proposes a workflow of integrating robots, multimodal imagery sensors (e.g., infrared camera, LiDAR, RGB camera), and AI-based data analytics to support real-time detection and assessment of defects within indoor building environments. In addition, the detected imagery anomalies will be geo-registered and located into a 3D building model, to support further analysis and evaluation of building conditions. The successful implementation of the envisioned intelligent robotic sensing system can lead to a significantly more efficient and responsive diagnosis of indoor building systems.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Agyemang, I. O., Zhang, X., Acheampong, D., Adjei-Mensah, I., Kusi, G. A., Mawuli, B. C., and Agbley, B. L. Y. (2022). “Autonomous health assessment of civil infrastructure using deep learning and smart devices.” Automation in Construction, 141, 104396.
Asadi, K., Ramshankar, H., Pullagurla, H., Bhandare, A., Shanbhag, S., Mehta, P., Kundu, S., Han, K., Lobaton, E., and Wu, T. (2018). “Vision-based integrated mobile robotic system for real-time applications in construction.” Automation in Construction, 96, 470–482.
Cha, Y. J., Choi, W., and Büyüköztürk, O. (2017). “Deep learning‐based crack damage detection using convolutional neural networks.” Computer‐Aided Civil and Infrastructure Engineering, 32(5), 361–378.
Chew, M. Y., and Gan, V. J. (2022). “Long-Standing Themes and Future Prospects for the Inspection and Maintenance of Façade Falling Objects from Tall Buildings.” Sensors, 22(16), 6070.
Chow, J. K., Liu, K.-F., Tan, P. S., Su, Z., Wu, J., Li, Z., and Wang, Y.-H. (2021). “Automated defect inspection of concrete structures.” Automation in Construction, 132, 103959.
El Masri, Y., and Rakha, T. (2020). “A scoping review of non-destructive testing (NDT) techniques in building performance diagnostic inspections.” Construction and Building Materials, 265, 120542.
Guo, J., Wang, Q., Li, Y., and Liu, P. (2020). “Façade defects classification from imbalanced dataset using meta learning‐based convolutional neural network.” Computer‐Aided Civil and Infrastructure Engineering, 35(12), 1403–1418.
Ham, Y., and Golparvar-Fard, M. (2013). “An automated vision-based method for rapid 3D energy performance modeling of existing buildings using thermal and digital imagery.” Advanced Engineering Informatics, 27(3), 395–409.
Kim, P., Chen, J., and Cho, Y. K. (2018). “SLAM-driven robotic mapping and registration of 3D point clouds.” Automation in Construction, 89, 38–48.
Loupos, K., Doulamis, A. D., Stentoumis, C., Protopapadakis, E., Makantasis, K., Doulamis, N. D., Amditis, A., Chrobocinski, P., Victores, J., and Montero, R. (2018). “Autonomous robotic system for tunnel structural inspection and assessment.” International Journal of Intelligent Robotics and Applications, 2, 43–66.
López-Fernández, L., Lagüela, S., González-Aguilera, D., and Lorenzo, H. (2017). “Thermographic and mobile indoor mapping for the computation of energy losses in buildings.” Indoor and Built Environment, 26(6), 771–784.
Pan, C., Wang, J., Chai, W., Kakillioglu, B., El Masri, Y., Panagoulia, E., Bayomi, N., Chen, K., Fernandez, J. E., and Rakha, T. (2022). “Capsule network-based semantic segmentation model for thermal anomaly identification on building envelopes.” Advanced Engineering Informatics, 54, 101767.
Paneru, S., and Jeelani, I. (2021). “Computer vision applications in construction: Current state, opportunities & challenges.” Automation in Construction, 132, 103940.
Qian, D., Li, Y., Niu, F., and O’Neill, Z. (2019). “Nationwide savings analysis of energy conservation measures in buildings.” Energy Conversion and Management, 188, 1–18.
Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. “You only look once: Unified, real-time object detection.” Proc., Proceedings of the IEEE conference on computer vision and pattern recognition, 779–788.
Rodrigues, M. F. S., Teixeira, J. M., and Cardoso, J. C. (2011). “Buildings envelope anomalies: A visual survey methodology.” Construction and Building Materials, 25(5), 2741–2750.
Santos, C., Ferreira, T. M., Vicente, R., and da Silva, J. R. M. (2013). “Building typologies identification to support risk mitigation at the urban scale–Case study of the old city centre of Seixal, Portugal.” Journal of Cultural Heritage, 14(6), 449–463.
Shariq, M. H., and Hughes, B. R. (2020). “Revolutionising building inspection techniques to meet large-scale energy demands: A review of the state-of-the-art.” Renewable and Sustainable Energy Reviews, 130, 109979.
Wang, Q., Kim, M.-K., Sohn, H., and Cheng, J. C. (2016). “Surface flatness and distortion inspection of precast concrete elements using laser scanning technology.” Smart Struct. Syst, 18(3), 601–623.
Yan, R.-J., Kayacan, E., Chen, I.-M., Tiong, L. K., and Wu, J. (2018). “QuicaBot: Quality inspection and assessment robot.” IEEE Transactions on Automation Science and Engineering, 16(2), 506–517.
Information & Authors
Information
Published In
Computing in Civil Engineering 2023
Pages: 690 - 698
History
Published online: Jan 25, 2024
ASCE Technical Topics:
- Architectural engineering
- Automation and robotics
- Building systems
- Buildings
- Cameras
- Construction engineering
- Construction management
- Engineering fundamentals
- Equipment and machinery
- Inspection
- Measurement (by type)
- Probe instruments
- Sensors and sensing
- Smart buildings
- Structural engineering
- Structures (by type)
- Systems engineering
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.