Affordable Multiagent Robotic System for Same-Level Fall Hazard Detection in Indoor Construction Environments
Publication: Journal of Computing in Civil Engineering
Volume 37, Issue 1
Abstract
Fall accidents are the leading cause of fatalities in the construction industry, and can occur due to various environmental hazards, such as unprotected walkways, slippery surfaces, exposed edges, and so forth. To mitigate the risk of fall accidents in construction workplaces, it is crucial to identify and locate potential fall hazards. Because conventional safety monitoring methods have been inefficient, more-effective inspection methods are needed. This study presents a cost-effective multiagent robotic system that can automatically detect and localize potential fall hazards on construction jobsites. This study focused mainly on same-level fall hazards and considered all the slipping, tripping, and falling hazards in the indoor construction environment to be potential fall hazards. The proposed collaborative robots are assembled using five low-cost hardware modules and successfully can detect and localize same-level fall hazards by integrating simultaneous localization and mapping, path planning, and computer vision techniques. The proposed affordable robotic system allows for the widespread adoption of proactive fall accident prevention methods, which can contribute significantly to the safety management of construction workplaces.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
All data, models, or codes that support the findings of this study are available from the corresponding author upon reasonable request.
References
Abhijith, V. S., and A. A. B. Raj. 2020. “Robot operating system based charging pad detection for multirotors.” In Proc., 2020 4th Int. Conf. on Intelligent Computing and Control Systems (ICICCS), 1151–1155. New York: IEEE.
Albeaino, G., M. Gheisari, and R. R. A. Issa. 2022. “Human-drone interaction (HDI): Opportunities and considerations in construction.” In Automation and robotics in the architecture, engineering, and construction industry, 111–142. Berlin: Springer.
Albert, A., M. R. Hallowell, M. Skaggs, and B. Kleiner. 2017. “Empirical measurement and improvement of hazard recognition skill.” In Safety science, 1–8. Amsterdam, Netherlands: Elsevier.
Al Zaabi, M. R., H. Alhendi, H. Alkhoori, M. Alkhoori, S. Alkhemriri, and Y. Abu-Kheil. 2022. Automatic site inspection system in construction sites (ICI–Intelligent Camera Inspection), 1–6. New York: IEEE.
Benjaoran, V., and S. Bhokha. 2010. “An integrated safety management with construction management using 4D CAD model.” Saf. Sci. 48 (3): 395–403. https://doi.org/10.1016/J.SSCI.2009.09.009.
Bokade, A. U., and V. R. Ratnaparkhe. 2016. “Video surveillance robot control using smartphone and Raspberry pi.” In Proc., Int. Conf. on Communication and Signal Processing, ICCSP 2016, 2094–2097. New York: IEEE.
Bureau of Labour. 2018. Injuries, illnesses, and fatalities. Washington, DC: US Bureau of Labor Statistics.
Chantawit, D., B. H. Hadikusumo, C. Charoenngam, and S. Rowlinson. 2005. “4DCAD-Safety: Visualizing project scheduling and safety planning.” Constr. Innov. 5 (2): 99–114. https://doi.org/10.1108/14714170510815203.
Chen, T.-C. T., and Y.-C. Lin. 2021. “Diverse three-dimensional printing capacity planning for manufacturers.” Rob. Comput. Integr. Manuf. 67 (2): 102052. https://doi.org/10.1016/j.rcim.2020.102052.
Eliwa, M., A. Adham, I. Sami, and M. Eldeeb. 2017. A critical comparison between Fast and Hector SLAM algorithms, 44–49. Tamil Nadu, India: Ramachandra Educational and Sports Trust Publisher.
Fang, Q., H. Li, X. Luo, L. Ding, H. Luo, and C. Li. 2018. “Computer vision aided inspection on falling prevention measures for steeplejacks in an aerial environment.” Autom. Constr. 93 (Aug): 148–164. https://doi.org/10.1016/j.autcon.2018.05.022.
Fang, W., L. Ding, P. E. D. Love, H. Luo, H. Li, F. Peña-Mora, B. Zhong, and C. Zhou. 2020. “Computer vision applications in construction safety assurance.” Autom. Constr. 110 (10): 103013. https://doi.org/10.1016/j.autcon.2019.103013.
Gambatese, J. A. 2008. “Research issues in prevention through design.” J. Saf. Res. 39 (2): 153–156. https://doi.org/10.1016/J.JSR.2008.02.012.
Gheisari, M., A. Rashidi, and B. Esmaeili. 2018. “Using unmanned aerial systems for automated fall hazard monitoring.” In Proc., Construction Research Congress 2018: Safety and Disaster Management—Selected Papers from the Construction Research Congress 2018, 62–72. Reston, VA: ASCE.
Guo, T., X. Li, V. Cherukuri, and V. Monga. 2019. “Dense scene information estimation network for dehazing.” In Proc., Conf. on Computer Vision and Pattern Recognition Workshops (CVPRW), 2122–2130. New York: IEEE.
Guo, T., and V. Monga. 2020. “Reinforced depth-aware deep learning for single image dehazing.” In Proc., ICASSP 2020-2020 IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), 8891–8895. New York: IEEE.
Hallowell, M. R., and J. A. Gambatese. 2009. “Activity-based safety risk quantification for concrete formwork construction.” J. Constr. Eng. Manage. 135 (10): 990–998. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000071.
Hu, K., H. Rahmandad, T. Smith-Jackson, and W. Winchester. 2011. “Factors influencing the risk of falls in the construction industry: A review of the evidence.” Construct. Manage. Econ. 29 (4): 397–416. https://doi.org/10.1080/01446193.2011.558104.
Huang, G., Z. Liu, L. Van Der Maaten, and K. Q. Weinberger. 2017. “Densely connected convolutional networks.” In Proc., 2017 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2261–2269. New York: IEEE.
Jeelani, I., K. Asadi, H. Ramshankar, K. Han, and A. Albert. 2021. “Real-time vision-based worker localization & hazard detection for construction.” Autom. Constr. 121 (Jan): 103448. https://doi.org/10.1016/j.autcon.2020.103448.
Jeelani, I., M. Gheisari, and M. E. Rinker Sr. 2022. “Safety challenges of human-drone interactions on construction jobsites.” In Automation and robotics in the architecture, engineering, and construction industry, 143–164. Berlin: Springer.
Kang, Y., S. Siddiqui, S. J. Suk, S. Chi, and C. Kim. 2017. “Trends of fall accidents in the U.S. construction industry.” J. Constr. Eng. Manage. 143 (8): 04017043. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001332.
Kim, P., J. Chen, J. Kim, and Y. K. Cho. 2018. SLAM-driven intelligent autonomous mobile robot navigation for construction applications, 254–269. Berlin: Springer.
Kiviniemi, M., K. Sulankivi, K. Kähkönen, T. Makela, and M.-L. Meivirta. 2011. BIM-based safety management and communication for building construction—VTT’s research information portal. Tampere, Finland: VTT Technical Research Centre of Finland.
Kohlbrecher, S., O. Von Stryk, J. Meyer, and U. Klingauf. 2011. “A flexible and scalable SLAM system with full 3D motion estimation.” In Proc., 9th IEEE Int. Symp. on Safety, Security, and Rescue Robotics, 155–160. New York: IEEE.
Li, H., X. Yang, M. Skitmore, F. Wang, and P. Forsythe. 2017. “Automated classification of construction site hazard zones by crowd-sourced integrated density maps.” Autom. Constr. 81 (Jun): 328–339. https://doi.org/10.1016/j.autcon.2017.04.007.
Liu, Y., M. Habibnezhad, and H. Jebelli. 2021a. “Brain-computer interface for hands-free teleoperation of construction robots.” Autom. Constr. 123 (Apr): 103523. https://doi.org/10.1016/j.autcon.2020.103523.
Liu, Y., M. Habibnezhad, and H. Jebelli. 2021b. “Brainwave-driven human-robot collaboration in construction.” Autom. Constr. 124 (Nov): 103556. https://doi.org/10.1016/j.autcon.2021.103556.
Liu, Y., and H. Jebelli. 2022. “Worker-aware robotic motion planner in construction for improved psychological well-being during worker-robot interaction.” In Proc., of Construction Research Congress 2022: Computer Applications, Automation, and Data Analytics, 205–214. Reston, VA: ASCE. https://doi.org/10.1061/9780784483961.022.
Markom, M. A., A. H. Adom, E. S. M. M. Tan, S. A. A. Shukor, N. A. Rahim, and A. Y. M. Shakaff. 2016. A mapping mobile robot using RP Lidar scanner, 87–92. New York: IEEE.
Montemerlo, M., and S. Thrun. 2003. “Simultaneous localization and mapping with unknown data association using FastSLAM.” In Proc., IEEE Int. Conf. on Robotics and Automation, 1985–1991. New York: IEEE.
Montemerlo, M., S. Thrun, D. Koller, and B. Wegbreit. 2002. FastSLAM: A factored solution to the simultaneous localization and mapping problem. Menlo Park, CA: Association for the Advancement of Artificial Intelligence.
Ocando, M. G., N. Certad, S. Alvarado, and Á. Terrones. 2017. “Autonomous 2D SLAM and 3D mapping of an environment using a single 2D LIDAR and ROS.” In Proc., 2017 LARS 14th Latin American Robotics Symp. and 2017 5th SBR Brazilian Symp. on Robotics, LARS-SBR 2017—Part of the Robotics Conf. 2017, 1–6. Piscataway, NJ: Institute of Electrical and Electronics Engineers Inc.
Ojha, A., Y. Liu, S. Shayesteh, and H. Jebelli. 2021. “Developing an affordable robotic system for automated fall hazard detection and localization in indoor construction environments.” In Proc., Computing in Civil Engineering 2021: Robotics and Automation—Selected Papers from the ASCE Int. Conf. on Computing in Civil Engineering 2021. Reston, VA: ASCE.
Paneru, S., and I. Jeelani. 2021. “Computer vision applications in construction: Current state, opportunities & challenges.” Autom. Constr. 132 (Jan): 103940. https://doi.org/10.1016/j.autcon.2021.103940.
Park, M.-W., C. Koch, and I. Brilakis. 2012. “Three-dimensional tracking of construction resources using an on-site camera system.” J. Comput. Civ. Eng. 26 (4): 541–549. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000168.
Perlman, A., R. Sacks, and R. Barak. 2014. “Hazard recognition and risk perception in construction.” Saf. Sci. 64 (19): 22–31. https://doi.org/10.1016/j.ssci.2013.11.019.
Rashid, K. M., S. Datta, A. H. Behzadan, and R. Hasan. 2018. “Risk-incorporated trajectory prediction to prevent contact collisions on construction sites.” J. Constr. Eng. Project Manage. 8 (1): 10–21. https://doi.org/10.6106/JCEPM.2018.8.1.010.
Seo, J., S. Han, S. Lee, and H. Kim. 2015. “Computer vision techniques for construction safety and health monitoring.” Adv. Eng. Inf. 29 (2): 239–251. https://doi.org/10.1016/j.aei.2015.02.001.
Shayesteh, S., and H. Jebelli. 2022. “Toward human-in-the-loop construction robotics: Understanding workers’ response through trust measurement during human-robot collaboration.” In Proc., Construction Research Congress 2022, 631–639. Reston, VA: ASCE.
Shayesteh, S., A. Ojha, and H. Jebelli. 2022. “Workers’ trust in collaborative construction robots: EEG–Based trust recognition in an immersive environment.” In Automation and robotics in the architecture, engineering, and construction industry, 201–215. Berlin: Springer.
Tarrants, W. E. 1980. The measurement of safety performance. New York: Garland.
Torres-Torriti, M., and A. Guesalaga. 2008. “Scan-to-map matching using the Hausdorff distance for robust mobile robot localization.” In Proc., IEEE Int. Conf. on Robotics and Automation, 455–460. New York: IEEE.
Turnage, D. M. 2016. “Simulation results for localization and mapping algorithms.” In Proc., 2016 Winter Simulation Conf. (WSC), 3040–3051. New York: IEEE.
Wang, P., Z. Chen, Q. Zhang, and J. Sun. 2016. “A loop closure improvement method of Gmapping for low cost and resolution laser scanner.” IFAC-PapersOnLine 49 (12): 168–173. https://doi.org/10.1016/j.ifacol.2016.07.569.
Wang, Q., M. Langerwisch, and B. Wagner. 2013. “Wide range global path planning for a large number of networked mobile robots based on generalized Voronoi diagrams.” IFAC Proc. 46 (29): 107–112. https://doi.org/10.3182/20131111-3-KR-2043.00007.
Wang, W., X. Wu, X. Yuan, and Z. Gao. 2020. “An experiment-based review of low-light image enhancement methods.” IEEE Access 8 (14): 87884–87917. https://doi.org/10.1109/ACCESS.2020.2992749.
Xu, L., C. Feng, V. R. Kamat, and C. C. Menassa. 2019. “An occupancy grid mapping enhanced visual SLAM for real-time locating applications in indoor GPS-denied environments.” Autom. Constr. 104 (Apr): 230–245. https://doi.org/10.1016/j.autcon.2019.04.011.
Yagfarov, R., M. Ivanou, and I. Afanasyev. 2018. “Map comparison of Lidar–Based 2D SLAM algorithms using precise ground truth.” In Proc., 2018 15th Int. Conf. on Control, Automation, Robotics and Vision (ICARCV), 1979–1983. New York: IEEE.
Yang, J., P. Vela, J. Teizer, and Z. Shi. 2012. “Vision-based tower crane tracking for understanding construction activity.” J. Comput. Civ. Eng. 28 (1): 103–112. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000242.
Zhang, H., T.-W. Weng, P.-Y. Chen, C.-J. Hsieh, and L. Daniel. 2018. Efficient neural network robustness certification with general activation functions. New York: Curran Associates.
Zhang, S., K. Sulankivi, M. Kiviniemi, I. Romo, C. M. Eastman, and J. Teizer. 2015. “BIM-based fall hazard identification and prevention in construction safety planning.” Saf. Sci. 72 (14): 31–45. https://doi.org/10.1016/j.ssci.2014.08.001.
Zhong, B., H. Wu, L. Ding, P. E. D. Love, H. Li, H. Luo, and L. Jiao. 2019. “Mapping computer vision research in construction: Developments, knowledge gaps and implications for research.” Autom. Constr. 107 (8): 102919. https://doi.org/10.1016/j.autcon.2019.102919.
Zhou, W., J. Whyte, and R. Sacks. 2012. “Construction safety and digital design: A review.” Autom. Constr. 22 (Jan): 102–111. https://doi.org/10.1016/j.autcon.2011.07.005.
Information & Authors
Information
Published In
Journal of Computing in Civil Engineering
Volume 37 • Issue 1 • January 2023
Copyright
© 2022 American Society of Civil Engineers.
History
Received: Mar 1, 2022
Accepted: Jul 5, 2022
Published online: Sep 29, 2022
Published in print: Jan 1, 2023
Discussion open until: Feb 28, 2023
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
- Sajad Javadinasab Hormozabad, Nathan Jacobs, Mariantonieta Gutierrez Soto, Reinforcement Learning for Integrated Structural Control and Health Monitoring, Practice Periodical on Structural Design and Construction, 10.1061/PPSCFX.SCENG-1455, 29, 3, (2024).
- Huanyu Wu, Yongqi Liu, Ruidong Chang, Lingyi Wu, Research Status Quo and Trends of Construction Robotics: A Bibliometric Analysis, Journal of Computing in Civil Engineering, 10.1061/JCCEE5.CPENG-5274, 38, 1, (2024).
- Jack C. P. Cheng, Changhao Song, Xiao Zhang, Zhengyi Chen, Pose Graph Relocalization with Deep Object Detection and BIM-Supported Object Landmark Dictionary, Journal of Computing in Civil Engineering, 10.1061/JCCEE5.CPENG-5301, 37, 5, (2023).