4D BIM and Reality Model–Driven Camera Placement Optimization for Construction Monitoring
Publication: Journal of Construction Engineering and Management
Volume 150, Issue 6
Abstract
Cameras are one of the most valuable sensors for collecting high-quality visual data on construction sites for uses ranging from surveillance to automated information exaction. The dynamic nature of sites means the visual data from cameras can suffer from occlusions and lack of coverage due to progressing works, hindering the performance of automated visual analysis methods. Therefore, manual planning and adjustments by experienced practitioners are required for appropriate camera placement at the site, which is expensive and time-consuming. Past research has simulated cameras and used algorithms with an objective function to optimize installation parameters with planned site models ranging from two-dimensional (2D) to four-dimensional (4D). However, these models lack information from ongoing site conditions, hampering actual camera performance. This study proposes a camera placement framework incorporating 4D-building information model (BIM) and reality models. The framework first identifies the camera placement determinants through expert interviews. Next, the planned BIM and reality models are used to construct the simulation environment, and camera placement parameters are optimized. The proposed framework is implemented and evaluated on a construction site. 25% average camera coverage improvement from the benchmark solution is achieved. This study further contributes to the potential application of automated visual monitoring systems on construction sites.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some data, models, or codes that support the findings of this study are available from the corresponding author upon reasonable request.
Acknowledgments
The authors would like to thank the National Science and Technology Council (NSTC), Taiwan, for supporting this research through Grants MOST-110-2222-E-002-002-MY3 and MOST-109-2622-E-002-027.
References
Albahri, A. H., and A. Hammad. 2017. “Simulation-based optimization of surveillance camera types, number, and placement in buildings using BIM.” J. Comput. Civ. Eng. 31 (6): 04017055. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000704.
Blickle, T., and L. Thiele. 1996. “A comparison of selection schemes used in evolutionary algorithms.” Evol. Comput. 4 (4): 361–394. https://doi.org/10.1162/evco.1996.4.4.361.
Braun, A., S. Tuttas, A. Borrmann, and U. Stilla. 2020. “Improving progress monitoring by fusing point clouds, semantic data and computer vision.” Autom. Constr. 116 (Aug): 103210. https://doi.org/10.1016/j.autcon.2020.103210.
Brilakis, I., M.-W. Park, and G. Jog. 2011. “Automated vision tracking of project related entities.” Adv. Eng. Inf. 25 (4): 713–724. https://doi.org/10.1016/j.aei.2011.01.003.
Caldas, C. H., D. G. Torrent, and C. T. Haas. 2004. “Integration of automated data collection technologies for real-time field materials management.” In Proc., 21st Int. Symp. on Automation and Robotics in Construction. Edinburgh, UK: International Association for Automation and Robotics in Construction.
Chen, H., K. Matsumoto, J. Ota, and T. Arai. 2007. “Self-calibration of environmental camera for mobile robot navigation.” Rob. Auton. Syst. 55 (3): 177–190. https://doi.org/10.1016/j.robot.2006.09.003.
Chen, X., Y. Zhu, H. Chen, Y. Ouyang, X. Luo, and X. Wu. 2021. “BIM-based optimization of camera placement for indoor construction monitoring considering the construction schedule.” Autom. Constr. 130 (Jun): 103825. https://doi.org/10.1016/j.autcon.2021.103825.
Chen, Z., Z. Lai, C. Song, X. Zhang, and J. C. Cheng. 2023. “Smart camera placement for building surveillance using OpenBIM and an efficient bi-level optimization approach.” J. Build. Eng. 77 (Mar): 107257. https://doi.org/10.1016/j.jobe.2023.107257.
Chi, S., and C. H. Caldas. 2011. “Automated object identification using optical video cameras on construction sites.” Comput.-Aided Civ. Infrastruct. Eng. 26 (5): 368–380. https://doi.org/10.1111/j.1467-8667.2010.00690.x.
Fang, Q., H. Li, X. Luo, L. Ding, H. Luo, and C. Li. 2018. “Computer vision aided inspection on falling prevention measures for steeplejacks in an aerial environment.” Autom. Constr. 93 (Mar): 148–164. https://doi.org/10.1016/j.autcon.2018.05.022.
Fang, W., L. Ding, P. E. Love, H. Luo, H. Li, F. Peña-Mora, B. Zhong, and C. Zhou. 2020a. “Computer vision applications in construction safety assurance.” Autom. Constr. 110 (Feb): 103013. https://doi.org/10.1016/j.autcon.2019.103013.
Fang, W., P. E. Love, H. Luo, and L. Ding. 2020b. “Computer vision for behaviour-based safety in construction: A review and future directions.” Adv. Eng. Inf. 43 (Mar): 100980. https://doi.org/10.1016/j.aei.2019.100980.
Golparvar-Fard, M., A. Heydarian, and J. Niebles. 2013. “Vision-based action recognition of earthmoving equipment using spatio-temporal features and support vector machine classifiers.” Adv. Eng. Inf. 27 (4): 652–663. https://doi.org/10.1016/j.aei.2013.09.001.
Golparvar-Fard, M., F. Peña-Mora, and S. Savarese. 2011. “Monitoring changes of 3d building elements from unordered photo collections.” In Proc., IEEE Int. Conf. on Computer Vision, 249–256. New York: IEEE.
Han, S., and S. Lee. 2013. “A vision-based motion capture and recognition framework for behavior-based safety management.” Autom. Constr. 35 (May): 131–141. https://doi.org/10.1016/j.autcon.2013.05.001.
Ibrahim, A., M. Golparvar-Fard, and K. El-Rayes. 2022. “Metrics and methods for evaluating model-driven reality capture plans.” Comput.-Aided Civ. Infrastruct. Eng. 37 (1): 55–72. https://doi.org/10.1111/mice.12693.
Kim, H., K. Kim, and H. Kim. 2016. “Vision-based object-centric safety assessment using fuzzy inference: Monitoring struck-by accidents with moving objects.” J. Comput. Civ. Eng. 30 (4): 04015075. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000562.
Kim, J., and S. Chi. 2017. “Adaptive detector and tracker on construction sites using functional integration and online learning.” J. Comput. Civ. Eng. 31 (5): 04017026. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000677.
Kim, J., Y. Ham, Y. Chung, and S. Chi. 2019. “Systematic camera placement framework for operation-level visual monitoring on construction jobsites.” J. Constr. Eng. Manage. 145 (4): 04019019. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001636.
Luo, H., M. Wang, P. K. Y. Wong, and J. C. Cheng. 2020. “Full body pose estimation of construction equipment using computer vision and deep learning techniques.” Autom. Constr. 110 (May): 103016. https://doi.org/10.1016/j.autcon.2019.103016.
Luo, H., C. Xiong, W. Fang, P. E. Love, B. Zhang, and X. Ouyang. 2018a. “Convolutional neural networks: Computer vision-based workforce activity assessment in construction.” Autom. Constr. 94 (Oct): 282–289. https://doi.org/10.1016/j.autcon.2018.06.007.
Luo, X., H. Li, D. Cao, F. Dai, J. Seo, and S. Lee. 2018b. “Recognizing diverse construction activities in site images via relevance networks of construction-related objects detected by convolutional neural networks.” J. Comput. Civ. Eng. 32 (3): 04018012. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000756.
Luo, X., H. Li, D. Cao, Y. Yu, X. Yang, and T. Huang. 2018c. “Towards efficient and objective work sampling: Recognizing workers’ activities in site surveillance videos with two-stream convolutional networks.” Autom. Constr. 94 (May): 360–370. https://doi.org/10.1016/j.autcon.2018.07.011.
Meger, D., I. Rekleitis, and G. Dudek. 2006. “Simultaneous planning, localization, and mapping in a camera sensor network.” In Distributed autonomous robotic systems 7, edited by M. Gini and R. Voyles, 155–164. Tokyo: Springer Japan.
Pal, A. 2023. “Automated activity-level progress monitoring from visual data and schedules through digital twin construction.” Ph.D. thesis, Dept. of Civil Engineering, National Taiwan Univ.
Pal, A., and S.-H. Hsieh. 2021. “Deep-learning-based visual data analytics for smart construction management.” Autom. Constr. 131 (Nov): 103892. https://doi.org/10.1016/j.autcon.2021.103892.
Pal, A., J. J. Lin, and S.-H. Hsieh. 2021. “A framework for automated daily construction progress monitoring leveraging unordered site photographs.” In Proc., ASCE Int. Conf. on Computing in Civil Engineering 2021 (i3CE2021), 538–545. Reston, VA: ASCE.
Pal, A., J. J. Lin, and S.-H. Hsieh. 2022. “Automated construction progress monitoring of partially completed building elements leveraging geometry modeling and appearance detection with deep learning.” In Construction research congress 2022, 708717. Reston, VA: ASCE.
Pal, A., J. J. Lin, S.-H. Hsieh, and M. Golparvar-Fard. 2023. “Automated vision-based construction progress monitoring in built environment through digital twin.” Dev. Built Environ. 16 (Feb): 100247. https://doi.org/10.1016/j.dibe.2023.100247.
Pal, A., J. J. Lin, S.-H. Hsieh, and M. Golparvar-Fard. 2024. “Activity-level construction progress monitoring through semantic segmentation of 3D-informed orthographic images.” Autom. Constr. 157 (May): 105157. https://doi.org/10.1016/j.autcon.2023.105157.
Park, M.-W., N. Elsafty, and Z. Zhu. 2015. “Hardhat-wearing detection for enhancing on-site safety of construction workers.” J. Constr. Eng. Manage. 141 (9): 04015024. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000974.
Rashid, K. M., and J. Louis. 2019. “Times-series data augmentation and deep learning for construction equipment activity recognition.” Adv. Eng. Inf. 42 (Oct): 100944. https://doi.org/10.1016/j.aei.2019.100944.
Seo, J., S. Han, S. Lee, and H. Kim. 2015. “Computer vision techniques for construction safety and health monitoring.” Adv. Eng. Inf. 29 (2): 239–251. https://doi.org/10.1016/j.aei.2015.02.001.
Shannon, C. E. 1948. “A mathematical theory of communication.” Bell Syst. Tech. J. 27 (Feb): 379–423. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x.
Shim, J.-H., and Y.-I. Cho. 2015. “A mobile robot localization using external surveillance cameras at indoor.” Procedia Comput. Sci. 56 (Jan): 502–507. https://doi.org/10.1016/j.procs.2015.07.242.
Tran, S. V. T., T. L. Nguyen, H. L. Chi, D. Lee, and C. Park. 2022. “Generative planning for construction safety surveillance camera installation in 4D BIM environment.” Autom. Constr. 134 (Dec): 104103. https://doi.org/10.1016/j.autcon.2021.104103.
Wang, T. H., A. Pal, J. J. Lin, and S.-H. Hsieh. 2023. “Construction photo localization in 3d reality models for vision-based automated daily project monitoring.” J. Comput. Civ. Eng. 37 (6): 04023029. https://doi.org/10.1061/JCCEE5.CPENG-5353.
Information & Authors
Information
Published In
Journal of Construction Engineering and Management
Volume 150 • Issue 6 • June 2024
Copyright
© 2024 American Society of Civil Engineers.
History
Received: Oct 2, 2023
Accepted: Jan 5, 2024
Published online: Mar 29, 2024
Published in print: Jun 1, 2024
Discussion open until: Aug 29, 2024
ASCE Technical Topics:
- Automation and robotics
- Cameras
- Construction engineering
- Construction management
- Construction sites
- Data collection
- Engineering fundamentals
- Equipment and machinery
- Geotechnical engineering
- Geotechnical investigation
- Methodology (by type)
- Models (by type)
- Optimization models
- Research methods (by type)
- Site investigation
- Systems engineering
- Two-dimensional models
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.