Tracking Volumetric Units in Modular Factories for Automated Progress Monitoring Using Computer Vision
Publication: Construction Research Congress 2022
ABSTRACT
The construction industry is increasingly adopting off-site and prefabricated methods due to advantages offered in safety, quality, and lead time. Applying industrialized methods for plant management in offsite construction factories requires the collection of large volumes of production process data, which is a tedious task when performed manually. Recent attempts to automate this process have relied on sensor-based data collection methods which are susceptible to noise, expensive, and difficult to validate. Computer vision methods, however, enable process data collection from videos without the limitations of the other sensor-based methods. This technology has not been applied for offsite construction except in very few instances and therefore, this study proposes a novel method to reliably collect the production process data using computer vision method in near real-time from widely used surveillance cameras in offsite construction. The proposed method allows the user to annotate the workstations of interest on the video as ground truths and process these areas throughout the entire video to track the units entering and leaving stations, while continuously updating a near real-time schedule of the production line. This framework was validated by implementing on the surveillance videos of the production process of modular home manufacturing in a factory. The results consistently provided 100% accuracy, after denoising, for all the videos processed including 60 h of work for a station. The developed method enables real-time tracking of station performance, which can enable continuous improvement methods for factory management and resource allocation.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Ahmadian Fard Fini, A., Maghrebi, M., Forsythe, P. J., and Waller, T. S. (2021). Using existing site surveillance cameras to automatically measure the installation speed in prefabricated timber construction. Engineering, Construction and Architectural Management, ahead-of-print(ahead-of-print). https://doi.org/10.1108/ECAM-04-2020-0281.
Altaf, M. S., Bouferguene, A., Liu, H., Al-Hussein, M., and Yu, H. (2018). Integrated production planning and control system for a panelized home prefabrication facility using simulation and RFID. Automation in Construction, 85, 369–383. https://doi.org/10.1016/j.autcon.2017.09.009.
Anderl, R., Picard, A., Wang, Y., Fleischer, J., Dosch, S., Klee, B., and Bauer, J. (n.d.). – Guiding principles for the implementation of Industrie 4.0 in small and medium sized businesses. 1.
Cheok, G. S., Stone, W. C., Lipman, R. R., and Witzgall, C. (2000). Ladars for construction assessment and update. Automation in Construction, 9(5–6), 463–477. https://doi.org/10.1016/S0926-5805(00)00058-3.
Demiralp, G., Guven, G., and Ergen, E. (2012). Analyzing the benefits of RFID technology for cost sharing in construction supply chains: A case study on prefabricated precast components. Automation in Construction, 24, 120–129. https://doi.org/10.1016/j.autcon.2012.02.005.
Deng, H., Hong, H., Luo, D., Deng, Y., and Su, C. (2020). Automatic Indoor Construction Process Monitoring for Tiles Based on BIM and Computer Vision. Journal of Construction Engineering and Management, 146(1), 04019095. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001744.
Golparvar-Fard, M., Peña-Mora, F., and Savarese, S. (2015). Automated Progress Monitoring Using Unordered Daily Construction Photographs and IFC-Based Building Information Models. Journal of Computing in Civil Engineering, 29(1), 04014025. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000205.
Hamledari, H., McCabe, B., and Davari, S. (2017). Automated computer vision-based detection of components of under-construction indoor partitions. Automation in Construction, 74, 78–94. https://doi.org/10.1016/j.autcon.2016.11.009.
Kropp, C., Koch, C., and König, M. (2018). Interior construction state recognition with 4D BIM registered image sequences. Automation in Construction, 86, 11–32. https://doi.org/10.1016/j.autcon.2017.10.027.
Kuhn, H. W. (1955). The Hungarian method for the assignment problem. Naval Research Logistics Quarterly, 2(1–2), 83–97. https://doi.org/10.1002/nav.3800020109.
Martinez, P., Barkokebas, B., Hamzeh, F., Al-Hussein, M., and Ahmad, R. (2021). A vision-based approach for automatic progress tracking of floor paneling in offsite construction facilities. Automation in Construction, 125, 103620. https://doi.org/10.1016/j.autcon.2021.103620.
McCulloch, B. (1997). Automating Field Data Collection in Construction Organizations. 957–963. https://cedb.asce.org/CEDBsearch/record.jsp?dockey=0108308.
Min, H., and Junyu, L. (2013). An Intelligent System for Precast Concrete Element Manufacturing Management Based on RFID Technology. 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, 1138–1143. https://doi.org/10.1109/GreenCom-iThings-CPSCom.2013.198.
Pal Singh Bhatia, A., Han, S., Moselhi, O., Lei, Z., and Raimondi, C. (2019). Data Analytics of Production Cycle Time for Offsite Construction Projects. Modular and Offsite Construction (MOC) Summit Proceedings, 25–32. https://doi.org/10.29173/mocs73.
Puri, N., and Turkan, Y. (2020). Bridge construction progress monitoring using lidar and 4D design models. Automation in Construction, 109, 102961. https://doi.org/10.1016/j.autcon.2019.102961.
Wang, M., Altaf, M. S., Al-Hussein, M., and Ma, Y. (2020). Framework for an IoT-based shop floor material management system for panelized homebuilding. International Journal of Construction Management, 20(2), 130–145. https://doi.org/10.1080/15623599.2018.1484554.
Wuni, I. Y., and Shen, G. Q. P. (2019). Holistic Review and Conceptual Framework for the Drivers of Offsite Construction: A Total Interpretive Structural Modelling Approach. Buildings, 9(5), 117. https://doi.org/10.3390/buildings9050117.
Zhang, Z., Pan, W., and Zheng, Z.-J. (2019). Transfer Learning Enabled Process Recognition for Module Installation of High-rise Modular Buildings. Modular and Offsite Construction (MOC) Summit Proceedings, 268–275. https://doi.org/10.29173/mocs103.
Information & Authors
Information
Published In
History
Published online: Mar 7, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
- Roshan Panahi, Joseph Louis, Ankur Podder, Colby Swanson, Shanti Pless, Automated Assembly Progress Monitoring in Modular Construction Factories Using Computer Vision-Based Instance Segmentation, Computing in Civil Engineering 2023, 10.1061/9780784485224.036, (290-297), (2024).
- Roshan Panahi, John-Paul Kivlin, Joseph Louis, Request for Information (RFI) Recommender System for Pre-Construction Design Review Application Using Natural Language Processing, Chat-GPT, and Computer Vision, Computing in Civil Engineering 2023, 10.1061/9780784485224.020, (159-166), (2024).