Computer Vision-Based Monitoring of Construction Site Housekeeping: An Evaluation of CNN and Transformer-Based Models
Publication: Computing in Civil Engineering 2023
ABSTRACT
Housekeeping is a fundamental component of site safety management. Good housekeeping refers to maintaining a neat and orderly working environment, ensuring the walkway is free from obstruction and properly storing materials and equipment. These good practices improve construction safety and productivity, and they are a reflection of good safety culture. However, poor housekeeping is a common challenge in construction sites. To ensure good housekeeping, supervisors will typically perform on-site manual inspections. However, these inspections are costly and inefficient, and inspectors can be inconsistent in defining good and poor housekeeping. Computer vision approaches can help resolve some of these problems in an automatic manner. Specifically, image classification methods can identify good and poor housekeeping images in video streams supplied by inspection robots or drones. Furthermore, the computer vision system can alert relevant supervisors when it detects poor housekeeping, and the supervisors can tidy up the identified locations. Hence, this study aims to develop a supervised deep learning model to classify good and poor housekeeping images. This study utilized a state-of-the-art vision transformer-based backbone model and tuned for housekeeping images. The study shows that, unlike conventional image classification for general scene images, housekeeping images are highly varied. Nevertheless, despite the challenges, the computer vision models developed in this study achieved satisfactory accuracy for identifying good and poor housekeeping images.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Aboagye-Nimo, E., and F. Emuze. n.d. Construction safety through housekeeping: The Hawthorne effect.
Agwu, M. O., and S. O. Ajayi. 2014. “Good Housekeeping - A Panacea for Slips, Trips & Falls Accident in the NLNG Project, Bonny.” International Journal of Business Administration 5 (4): p12. https://doi.org/10.5430/ijba.v5n4p12.
Chian, E., W. Fang, Y. M. Goh, and J. Tian. 2021. “Computer Vision Approaches for Detecting Missing Barricades.” Automation in Construction 131 (November): 103862. https://doi.org/10.1016/j.autcon.2021.103862.
Chian, E. Y. T., Y. M. Goh, J. Tian, and B. H. W. Guo. 2022. “Dynamic Identification of Crane Load Fall Zone: A Computer Vision Approach.” Safety Science 156 (December): 105904. https://doi.org/10.1016/j.ssci.2022.105904.
Davis, P., F. Aziz, M. T. Newaz, W. Sher, and L. Simon. 2021. “The Classific. of Construction Waste Material Using a Deep Convolutional Neural Network.” Automation in Construction 122 (February): 103481. https://doi.org/10.1016/j.autcon.2020.103481.
Deng, J., W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. n.d. ImageNet: A Large-Scale Hierarchical Image Database.
Dosovitskiy, A., L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, and M. Dehghani. 2021. “An Image Is Worth 16x16 Words: Transformers for Image Recognition at Scale.” arXiv.http://arxiv.org/abs/2010.11929.
Goh, Y. M., J. Tian, and E. Y. T. Chian. 2022. “Management of Safe Distancing on Construction Sites during COVID-19: A Smart Real-Time Monitoring System.” Computers & Industrial Engineering 163 (January): 107847. https://doi.org/10.1016/j.cie.2021.107847.
He, K., X. Zhang, S. Ren, and J. Sun. 2015. “Deep Residual Learning for Image Recognition.” arXiv.http://arxiv.org/abs/1512.03385.
Howard, A., M. Sandler, G. Chu, L.-C. Chen, B. Chen, M. Tan, and W. Wang 2019. “Searching for MobileNetV3.” arXiv.http://arxiv.org/abs/1905.02244.
Huang, G., Z. Liu, L. van der Maaten, and K. Q. Weinberger. 2018. “Densely Connected Convolutional Networks.” arXiv.http://arxiv.org/abs/1608.06993.
Irizarry, J., and D. B. Costa. 2016. “Exploratory Study of Potential Applications of Unmanned Aerial Systems for Construction Management Tasks.” Journal of Management in Engineering 32 (3): 05016001. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000422.
Liu, Z., Y. Lin, Y. Cao, H. Hu, Y. Wei, Z. Zhang, S. Lin, and B. Guo. 2021. “Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows.” arXiv.http://arxiv.org/abs/2103.14030.
Panahi, R., J. Louis, N. Aziere, A. Podder, and C. Swanson. 2022. “Identifying Modular Construction Worker Tasks Using Computer Vision.” In Computing in Civil Engineering 2021, 959–66. Orlando, Florida: American Society of Civil Engineers. https://doi.org/10.1061/9780784483893.118.
Simonyan, K., and A. Zisserman. 2015. “Very Deep Convolutional Networks for Large-Scale Image Recognition.” arXiv.http://arxiv.org/abs/1409.1556.
Szegedy, C., V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna. 2015. “Rethinking the Inception Architecture for Computer Vision.” arXiv.http://arxiv.org/abs/1512.00567.
Tan, M., and Q. V. Le. 2020. “EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks.” arXiv.http://arxiv.org/abs/1905.11946.
Tu, Z., H. Talebi, H. Zhang, F. Yang, P. Milanfar, A. Bovik, and Y. Li. 2022. “MaxViT: Multi-Axis Vision Transformer.” arXiv.http://arxiv.org/abs/2204.01697.
Xu, S., J. Wang, X. Wang, and W. Shou. 2019. Computer Vision Techniques in Construction, Operation and Maintenance Phases of Civil Assets: A Critical Review. In. Banff, AB, Canada. https://doi.org/10.22260/ISARC2019/0090.
Information & Authors
Information
Published In
History
Published online: Jan 25, 2024
ASCE Technical Topics:
- Business management
- Computer models
- Computer vision and image processing
- Computing in civil engineering
- Construction engineering
- Construction management
- Construction sites
- Engineering fundamentals
- Geotechnical engineering
- Geotechnical investigation
- Inspection
- Methodology (by type)
- Models (by type)
- Occupational safety
- Practice and Profession
- Public administration
- Public health and safety
- Safety
- Site investigation
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.