Analyzing Safety Risk Imposed by Jobsite Debris to Nearby Built Environments Using Geometric Digital Twins and Vision-Based Deep Learning
Publication: Journal of Computing in Civil Engineering
Volume 36, Issue 6
Abstract
Extreme wind events can pick up loose and small objects on the ground, and once the objects become airborne, they negatively impact surrounding communities due to the collision impact. In this regard, jobsites and laydown yards that involve construction materials such as gravel piles and crushed rocks could be the main sources of potential windborne debris during extreme wind events. To analyze safety risk and predict the damage imposed by jobsite debris to nearby built environments, a new computer vision-based risk assessment based on geometric digital twins of jobsite debris is proposed for the reliability analysis on glazing systems of dwellings located on nearby jobsites. The impact of a gravel pile in a railroad jobsite on nearby buildings and residential environments was studied based on extreme wind event scenarios, and the failure risk of the building glazing system was computed. The risk associated with jobsite debris during extreme wind events and their impact on neighboring communities are analyzed through three computing modules: (1) satellite imagery-based terrain modeling to study 3D characteristics of the at-risk built environment; (2) analyzing visual data from Google Street View to assess the risk associated with glazing panels of dwellings in the communities; and (3) analyzing visual data from a jobsite to quantify the impact of jobsite debris, to associate its safety risk to neighboring communities. The proposed method can provide an immediate heads up for those who reside nearby jobsites, allowing to take required preemptive actions to protect their habitation against potential windborne debris. Practitioners will also be informed of such jobsite debris-related risk before extreme wind events to better secure their jobsites for the risk mitigation.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code (e.g., site images, training models) that support the findings of this study are available from the corresponding author upon reasonable request.
Acknowledgments
This material is based upon work supported by the National Science Foundation under Grant No. 1832187. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.
References
Alizadeh, B., and A. H. Behzadan. 2021. “Flood depth mapping in street photos with image processing and deep neural networks.” Comput. Environ. Urban Syst. 88 (Jul): 101628. https://doi.org/10.1016/j.compenvurbsys.2021.101628.
Alizadeh, B., D. Li, Z. Zhang, and A. H. Behzadan. 2021. “Feasibility study of urban flood mapping using traffic signs for route optimization.” Preprint, submitted September 27, 2021. http://arxiv.org/abs/2109.11712.
Asadi, S., E. Karan, and A. Mohammadpour. 2017. “Advancing safety by in-depth assessment of workers attention and perception.” Int. J. Saf. 1 (3): 46–60. https://doi.org/10.24900/ijss/01034660.2017.1201.
Balali, V., A. A. Rad, and M. Golparvar-Fard. 2015. “Detection, classification, and mapping of US traffic signs using Google Street View images for roadway inventory management.” Visualization Eng. 3 (1): 1–18. https://doi.org/10.1186/s40327-015-0027-1.
Beason, W. L., G. E. Meyers, and R. James. 1984. “Hurricane related window glass damage in Houston.” J. Struct. Eng. 110 (12): 2843–2857. https://doi.org/10.1061/(ASCE)0733-9445(1984)110:12(2843).
Behr, R. A., and J. E. Minor. 1994. “A survey of glazing system behavior in multi-story buildings during Hurricane Andrew.” Struct. Des. Tall Build. 3 (3): 143–161. https://doi.org/10.1002/tal.4320030302.
Bohm, S. B. 2020. “Can Florida’s construction sites be hurricane-proofed?” Accessed May 15, 2020. https://www.lexology.com/library/detail.aspx?g=5c21b3ee-165b-4746-bf9c-b56d6f5c0e90.
Carter, G., and S. D. Smith. 2006. “Safety hazard identification on construction projects.” J. Constr. Eng. Manage. 132 (2): 197–205. https://doi.org/10.1061/(ASCE)0733-9364(2006)132:2(197).
Chavez, M. S. 2016. “Hurricane preparedness in a construction site: A framework to assess the construction companies’ current practices.” FIU electronic theses and dissertations, Dept. of Construction Management, Florida International Univ.
Chen, F.-C., M. R. Jahanshahi, D. Johnson, and E. J. Delp. 2019. “Vision-based decision support for flood risk assessment using Google Street View images.” In Structural health monitoring. Lancaster, PA: DEStech Publishing.
Chen, L.-C., Y. Zhu, G. Papandreou, F. Schroff, and H. Adam. 2018. “Encoder-decoder with atrous separable convolution for semantic image segmentation.” In Proc., European Conf. on computer vision (ECCV), 801–818. New York: Springer.
Dharani, L. R., F. Ji, R. A. Behr, J. E. Minor, and P. A. Kremer. 2004. “Breakage prediction of laminated glass using the ‘sacrificial ply’ design concept.” J. Archit. Eng. 10 (4): 126–135. https://doi.org/10.1061/(ASCE)1076-0431(2004)10:4(126).
Doddipatla, L. S., and G. A. Kopp. 2019. “A review of critical scouring velocity of compact roof aggregate.” J. Wind Eng. Ind. Aerodyn. 188 (May): 110–124. https://doi.org/10.1016/j.jweia.2019.02.018.
FEMA. 2021. Hazus hurricane model technical manual. Washington, DC: FEMA.
Guo, H. 2010. “Understanding global natural disasters and the role of earth observation.” Int. J. Digital Earth 3 (3): 221–230. https://doi.org/10.1080/17538947.2010.499662.
Ham, Y., and M. Kamari. 2019. “Automated content-based filtering for enhanced vision-based documentation in construction toward exploiting big visual data from drones.” Autom. Constr. 105 (Sep): 102831. https://doi.org/10.1016/j.autcon.2019.102831.
Ham, Y., S. J. Lee, and A. G. Chowdhury. 2017. “Imaging-to-simulation framework for improving disaster preparedness of construction projects and neighboring communities.” In Computing in civil engineering 2017, 230–237. Reston, VA: ASCE.
Haslam, R. A., S. A. Hide, A. G. Gibb, D. E. Gyi, T. Pavitt, S. Atkinson, and A. R. Duff. 2005. “Contributing factors in construction accidents.” Appl. Ergon. 36 (4): 401–415. https://doi.org/10.1016/j.apergo.2004.12.002.
He, K., X. Zhang, S. Ren, and J. Sun. 2016. “Deep residual learning for image recognition.” Proc., IEEE Conf. on Computer Vision and Pattern Recognition, 770–778. New York: IEEE.
Holmes, J. 2004. “Trajectories of spheres in strong winds with application to windborne debris.” J. Wind Eng. Ind. Aerodyn. 92 (1): 9–22. https://doi.org/10.1016/j.jweia.2003.09.031.
Holmes, J., C. W. Letchford, and N. Lin. 2006. “Investigations of plate-type windborne debris—Part II: Computed trajectories.” J. Wind Eng. Ind. Aerodyn. 94 (1): 21–39. https://doi.org/10.1016/j.jweia.2005.10.002.
Horticulture Unlimited Inc. 2022. “Honey mesquite.” Accessed January 22, 2022. https://horticultureunlimited.com/plant-guide/honey-mesquite/.
Ill, E. W. R., D. K. Chappell, D. G. Baldwin, and R. Sensing. 1997. “AVHRR imagery used to identify hurricane damage in a forested wetland of Louisiana.” Photogramm. Eng. 63 (3): 293–297.
ISPARS (International Society for Photogrammetry and Remote Sensing). 2020. 2D semantic labeling contest—Potsdam. Hannover, Germany: ISPARS.
Jeelani, I., A. Albert, and J. A. Gambatese. 2017. “Why do construction hazards remain unrecognized at the work interface?” J. Constr. Eng. Manage. 143 (5): 04016128. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001274.
Jeelani, I., K. Asadi, H. Ramshankar, K. Han, and A. Albert. 2019. “Real-world mapping of gaze fixations using instance segmentation for road construction safety applications.” Preprint, submitted January 30, 2019. http://arxiv.org/abs/1901.11078.
Johnson, C., and T. Mahoney. 2011. “Challenges to mapping coastal risk in the southeastern United States for FEMA’s risk map program.” In Solutions to coastal disasters 2011, 581–592. Reston, VA: ASCE.
Kamari, M., and Y. Ham. 2018. “Automated filtering big visual data from drones for enhanced visual analytics in construction.” In Proc., ASCE Construction Research Congress 2018. Reston, VA: ASCE. https://doi.org/10.1061/9780784481264.039.
Kamari, M., and Y. Ham. 2021a. “Analyzing potential risk of wind-induced damage in construction sites and neighboring communities using large-scale visual data from drones.” In Proc., Construction Research Congress (CRC) 2020. Reston, VA: ASCE. https://doi.org/10.1061/9780784482865.097.
Kamari, M., and Y. Ham. 2021b. “Semantic detection of potential wind-borne debris in construction jobsites: Digital twining for hurricane preparedness and jobsite safety.” In Proc., Int. Conf. on Computing in Civil Engineering (i3CE). Reston, VA: ASCE. https://doi.org/10.1061/9780784483893.111.
Kamari, M., and Y. Ham. 2021c. “Vision-based volumetric measurements via deep learning-based point cloud segmentation for material management in jobsites.” Autom. Constr. 121 (Jan): 103430. https://doi.org/10.1016/j.autcon.2020.103430.
Kamari, M., and Y. Ham. 2022. “AI-based risk assessment for construction site disaster preparedness through deep learning-based digital twinning.” Autom. Constr. 134 (Feb): 104091. https://doi.org/10.1016/j.autcon.2021.104091.
Kareem, A. 1985. “Structural performance and wind speed-damage correlation in Hurricane Alicia.” J. Struct. Eng. 111 (12): 2596–2610. https://doi.org/10.1061/(ASCE)0733-9445(1985)111:12(2596).
Kashani, A. G., P. S. Crawford, S. K. Biswas, A. J. Graettinger, and D. Grau. 2015. “Automated tornado damage assessment and wind speed estimation based on terrestrial laser scanning.” J. Comput. Civ. Eng. 29 (3): 04014051. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000389.
Kim, J., M. Kamari, S. Lee, and Y. Ham. 2021. “Large scale visual data-driven probabilistic risk assessment of utility poles regarding the vulnerability of power distribution infrastructure system.” J. Constr. Eng. Manage. 147 (10): 04021121. https://doi.org/10.1061/(ASCE)CO.1943-7862.0002153.
Kind, R., and R. Wardlaw. 1984. “Behavior in wind of loose-laid roof insulation systems, part I: Stone scour and blow-off.” In Proc., 4th Canadian Workshop on Wind Engineering. Reston, VA: ASCE.
Krizhevsky, A., I. Sutskever, and G. E. Hinton. 2017. “Imagenet classification with deep convolutional neural networks.” Commun. ACM 60 (6): 84–90. https://doi.org/10.1145/3065386.
Lettau, H. 1969. “Note on aerodynamic roughness-parameter estimation on the basis of roughness-element description.” J. Appl. Meteorol. 8 (5): 828–832. https://doi.org/10.1175/1520-0450(1969)008%3C0828:NOARPE%3E2.0.CO;2.
Li, M., L. Cheng, J. Gong, Y. Liu, Z. Chen, F. Li, G. Chen, D. Chen, and X. Song. 2008. “Post-earthquake assessment of building damage degree using LiDAR data and imagery.” Supplement, Sci. China Ser. E: Technol. Sci. 51 (S2): 133–143. https://doi.org/10.1007/s11431-008-6014-1.
Li, Y., and B. R. Ellingwood. 2006. “Hurricane damage to residential construction in the US: Importance of uncertainty modeling in risk assessment.” Eng. Struct. 28 (7): 1009–1018. https://doi.org/10.1016/j.engstruct.2005.11.005.
Liou, Y.-A., S. K. Kar, and L. Chang. 2010. “Use of high-resolution FORMOSAT-2 satellite images for post-earthquake disaster assessment: A study following the 12 May 2008 Wenchuan Earthquake.” Int. J. Remote Sens. 31 (13): 3355–3368. https://doi.org/10.1080/01431161003727655.
Liu, P., A. Y. Chen, Y. N. Huang, J. Y. Han, J. S. Lai, and S. C. Kang. 2014. “A review of rotorcraft unmanned aerial vehicle (UAV) developments and applications in civil engineering. smart structures and systems.” Smart Struct. Syst. 13 (6): 1065–1094. https://doi.org/10.12989/sss.2014.13.6.1065.
Long, J., E. Shelhamer, and T. Darrell. 2015. “Fully convolutional networks for semantic segmentation.” Proc., IEEE Conf. on Computer Vision and Pattern Recognition, 3431–3440. New York: IEEE.
Mengistu, F., and H. F. Gebregziabher. 2021. “Assessment of ballast flying in the national railway network of Ethiopia.” J. Eng. 13 (7): 420–429. https://doi.org/10.4236/eng.2021.137030.
Minor, J. E. 1994. “Windborne debris and the building envelope.” J. Wind Eng. Ind. Aerodyn. 53 (1–2): 207–227. https://doi.org/10.1016/0167-6105(94)90027-2.
Olsen, M. J., Z. Chen, T. Hutchinson, and F. Kuester. 2013. “Optical techniques for multiscale damage assessment.” Geomatics Nat. Hazards Risk 4 (1): 49–70. https://doi.org/10.1080/19475705.2012.670668.
Pesaresi, M., A. Gerhardinger, and F. Haag. 2007. “Rapid damage assessment of built-up structures using VHR satellite data in tsunami-affected areas.” Int. J. Remote Sens. 28 (13–14): 3013–3036. https://doi.org/10.1080/01431160601094492.
Pheng, L. S., B. Raphael, and W. K. Kit. 2006. “Tsunamis: Some pre-emptive disaster planning and management issues for consideration by the construction industry.” Struct. Surv. 24 (5): 378–396. https://doi.org/10.1108/02630800610711979.
Pinelli, J.-P., E. Simiu, K. Gurley, C. Subramanian, L. Zhang, A. Cope, J. J. Filliben, and S. Hamid. 2004. “Hurricane damage prediction model for residential structures.” J. Struct. Eng. 130 (11): 1685–1691. https://doi.org/10.1061/(ASCE)0733-9445(2004)130:11(1685).
Porav, H., T. Bruls, and P. Newman. 2019. “I can see clearly now: Image restoration via de-raining.” In Proc., 2019 Int. Conf. on Robotics and Automation (ICRA), 7087–7093. New York: IEEE.
Raymond, G. P. 2000. “Track and support rehabilitation for a mine company railroad.” Can. Geotech. J. 37 (2): 318–332. https://doi.org/10.1139/t99-108.
Russakovsky, O., J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, and M. Bernstein. 2015. “Imagenet large scale visual recognition challenge.” Int. J. Comput. Vision 115 (3): 211–252. https://doi.org/10.1007/s11263-015-0816-y.
Sakaridis, C., D. Dai, and L. Van Gool. 2018. “Semantic foggy scene understanding with synthetic data.” Int. J. Comput. Vision 126 (9): 973–992. https://doi.org/10.1007/s11263-018-1072-8.
Strelkov, A., S. Teplykh, and N. Bukhman. 2016. “Liquid filtration properties in gravel foundation of railroad tracks.” J. Phys. Conf. Ser. 738 (1): 012124. https://doi.org/10.1088/1742-6596/738/1/012124.
SunSentinel. 2017. “Hurricane Irma debris piles could be around for months.” Accessed November 13, 2021. https://www.sun-sentinel.com/news/weather/hurricane/fl-reg-hurricane-irma-debris-disposal-delays-20170919-story.html.
Thorpe, M., and Y. van Gennip. 2018. “Deep limits of residual neural networks.” Accessed January 15, 2022. http://arxiv.org/abs/1810.11741.
Tolppanen, P., O. Stephansson, and L. Stenlid. 2002. “3-D degradation analysis of railroad ballast.” Bull. Eng. Geol. Environ. 61 (1): 35–42. https://doi.org/10.1007/s100640100140.
Tralli, D. M., R. G. Blom, V. Zlotnicki, A. Donnellan, and D. L. Evans. 2005. “Satellite remote sensing of earthquake, volcano, flood, landslide and coastal inundation hazards.” J. Photogramm. Remote Sens. 59 (4): 185–198. https://doi.org/10.1016/j.isprsjprs.2005.02.002.
Ural, S., E. Hussain, K. Kim, C.-S. Fu, and J. Shan. 2011. “Building extraction and rubble mapping for city Port-Au-Prince post-2010 earthquake with GeoEye-1 imagery and lidar data.” Photogramm. Eng. Remote Sens. 77 (10): 1011–1023. https://doi.org/10.14358/PERS.77.10.1011.
Vickery, P. J., J. Lin, P. F. Skerlj, L. A. Twisdale Jr., and K. Huang. 2006. “HAZUS-MH hurricane model methodology. I: Hurricane hazard, terrain, and wind load modeling.” Nat. Hazard. Rev. 7 (2): 82–93. https://doi.org/10.1061/(ASCE)1527-6988(2006)7:2(82).
Vijayaraj, V., E. A. Bright, and B. L. Bhaduri. 2008. “Rapid damage assessment from high resolution imagery.” In Proc., IGARSS 2008-2008 IEEE Int. Geoscience and Remote Sensing Symp. New York: IEEE.
Wang, C., Q. Yu, K. H. Law, F. McKenna, X. Y. Stella, E. Taciroglu, A. Zsarnóczay, W. Elhaddad, and B. Cetiner. 2021. “Machine learning-based regional scale intelligent modeling of building information for natural hazard risk management.” Autom. Constr. 122 (Feb): 103474. https://doi.org/10.1016/j.autcon.2020.103474.
Wang, F., and Y. J. Xu. 2010. “Comparison of remote sensing change detection techniques for assessing hurricane damage to forests.” Environ. Monit. Assess. 162 (1): 311–326. https://doi.org/10.1007/s10661-009-0798-8.
Wang, W., J. J. Qu, X. Hao, Y. Liu, and J. A. Stanturf. 2010. “Post-hurricane forest damage assessment using satellite remote sensing.” Agric. For. Meteorol. 150 (1): 122–132. https://doi.org/10.1016/j.agrformet.2009.09.009.
WeekendBuilds. 2022. “How tall is a 1, 2 and 3 story house?” Accessed January 22, 2021. https://weekendbuilds.com/how-tall-is-a-house/.
Wills, J., B. Lee, and T. Wyatt. 2002. “A model of wind-borne debris damage.” J. Wind Eng. Ind. Aerodyn. 90 (4–5): 555–565. https://doi.org/10.1016/S0167-6105(01)00197-0.
Womble, J. A., S. Ghosh, B. Adams, and C. Friedland. 2006. “Advanced damage detection for Hurricane Katrina: Integrating remote sensing and VIEWSTM field reconnaissance.” In MCEER special report series engineering organizational issues before, during after Hurricane Katrina, 2. New York: Multidisciplinary Center for Earthquake Engineering Research.
Zhang, J., C. Zhou, K. Xu, and M. Watanabe. 2002. “Flood disaster monitoring and evaluation in China.” Global Environ. Change Part B: Environ. Hazards 4 (2): 33–43. https://doi.org/10.1016/S1464-2867(03)00002-0.
Information & Authors
Information
Published In
Journal of Computing in Civil Engineering
Volume 36 • Issue 6 • November 2022
Copyright
© 2022 American Society of Civil Engineers.
History
Received: Mar 2, 2022
Accepted: May 25, 2022
Published online: Aug 27, 2022
Published in print: Nov 1, 2022
Discussion open until: Jan 27, 2023
ASCE Technical Topics:
- Buildings
- Business management
- Coating
- Continuum mechanics
- Debris
- Disaster risk management
- Dynamic loads
- Dynamics (solid mechanics)
- Engineering mechanics
- Environmental engineering
- Gravels
- Infrastructure
- Materials engineering
- Materials processing
- Pavements
- Pollutants
- Practice and Profession
- Public administration
- Public health and safety
- Risk management
- Safety
- Solid mechanics
- Solid wastes
- Structural dynamics
- Structural engineering
- Structures (by type)
- Transportation engineering
- Wastes
- Wind engineering
- Wind loads
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.