Technical Papers
Aug 31, 2023

The Development of a Rebar-Counting Model for Reinforced Concrete Columns: Using an Unmanned Aerial Vehicle and Deep-Learning Approach

Publication: Journal of Construction Engineering and Management
Volume 149, Issue 11

Abstract

Inspecting the number of rebars in each column of a reinforced concrete (RC) structure is a significant task that must be undertaken during the rebar inspection process. Conventionally, counting the rebars has relied on a manual inspection carried out by visiting inspectors. However, this approach is very time-consuming, labor-intensive, and poses a potential safety risk. Previous studies have focused on the applications of counting the rebars for a production line and/or warehouse, using vision-based methods. Therefore, this study aims to propose an innovative approach incorporating the use of an unmanned aerial vehicle (UAV) on real construction sites to count the rebars automatically. For analyzing the images, robust object detection methods based on deep learning (Faster R-CNN, R-FCN, SSD 300, SSD500, YOLOv5, and YOLOv6) were developed. A total of 384 models generated from six different methods were trained and implemented using data sets based on the original and augmented images with adjustments made for the hyperparameters. In a test, the best optimized model based on Faster R-CNN produced an accuracy of 94.61% at AP50. In addition, video testing demonstrated a coverage of up to 32 frames per second in the experimental environment, suggesting that this method has potential for real-time application.

Practical Applications

Drones provide an efficient way to monitor the number of rebars in reinforced columns by capturing still images or video footage. However, manually counting the rebars from this data in the form of images is both time-consuming and laborious. This research therefore develops an AI-driven technique, based on deep learning, designed to automate the process. In the experiment, the approach that was developed achieved an accuracy rate of 94.61% under diverse conditions on real construction sites, including nonuniform illumination and complex backgrounds (e.g., scaffolding and molding). Nevertheless, there is potential for further improvement in certain scenarios (e.g., where there are shadows in high-illumination images, or similar objects close to the rebars). In addition, video testing demonstrated that the system could process up to 32 frames per s. Despite its limitations, the method developed in this research could be put to practical use on construction sites, except in those scenarios where it showed a lower rate of accuracy. Moreover, as 30 frames per s is often regarded as equivalent to real-time, it would also be feasible to use it for video analytics’ applications such as real-time monitoring and progress tracking.

Get full access to this article

View all available purchase options and get full access to this article.

Data Availability Statement

All data, models, and code generated or used during the study appear in the published article. The data set obtained, trained model, and test results, video output can be downloaded from Figshare data repository (Wang 2023).

References

ACI (American Concrete Institute). 2019. Building code requirements for structural concrete and commentary. ACI 318-19. Farmington Hills, MI: ACI.
Bu, T., J. Zhu, and T. Ma. 2022. “A UAV photography–based detection method for defective road marking.” J. Perform. Constr. Facil. 36 (5): 04022035. https://doi.org/10.1061/(ASCE)cf.1943-5509.0001748.
Chen, K., et al. 2019. MMDetection: Open MMLab detection toolbox and benchmark.” Preprint, submitted June 17, 2019. http://arxiv.org/abs/1906.07155.
Chen, M., X. Shi, Y. Zhang, D. Wu, and M. Guizani. 2017. “Deep feature learning for medical image analysis with convolutional autoencoder neural network.” IEEE Trans. Big Data 7 (4): 750–758. https://doi.org/10.1109/tbdata.2017.2717439.
Chow, J. K., K. F. Liu, P. S. Tan, Z. Su, J. Wu, Z. Li, and Y. H. Wang. 2021. “Automated defect inspection of concrete structures.” Autom. Constr. 132 (Dec): 103959. https://doi.org/10.1016/j.autcon.2021.103959.
Devine, R. D., S. M. Barbachyn, A. P. Thrall, and Y. C. Kurama. 2018. “Effect of tripping prefabricated rebar assemblies on bar spacing.” J. Constr. Eng. Manage. 144 (11): 04018099. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001559.
Fan, Z., J. Lu, B. Qiu, T. Jiang, K. An, A. N. Josephraj, and C. Wei. 2019. “Automated steel bar counting and center localization with convolutional neural networks.” Preprint, submitted June 19, 2019. http://arxiv.org/abs/1906.00891.
Fang, Q., H. Li, X. Luo, L. Ding, H. Luo, T. M. Rose, and W. An. 2018a. “Detecting non-hardhat-use by a deep learning method from far-field surveillance videos.” Autom. Constr. 85 (Sep): 1–9. https://doi.org/10.1016/j.autcon.2017.09.018.
Fang, W., L. Ding, B. Zhong, P. E. D. Love, and H. Luo. 2018b. “Automated detection of workers and heavy equipment on construction sites: A convolutional neural network approach.” Adv. Eng. Inf. 37 (Aug): 139–149. https://doi.org/10.1016/j.aei.2018.05.003.
He, K., X. Zhang, S. Ren, and J. Sun. 2016. “Deep residual learning for image recognition.” In Proc., IEEE Conf. on Computer Vision and Pattern Recognition, 770–778. New York: IEEE.
Hernández-Ruiz, A. C., J. A. Martínez-Nieto, and J. D. Buldain-Pérez. 2021. “Steel bar counting from images with machine learning.” Electron 10 (4): 402. https://doi.org/10.3390/electronics10040402.
Krizhevsky, A., I. Sutskever, and G. E. Hinton. 2012. “ImageNet classification with deep convolutional neural networks.” Adv. Neural Inf. Process. Syst. 60 (6): 84–90. https://doi.org/10.1145/3065386.
Lee, J. H., and S. O. Park. 2019. “Machine learning-based automatic reinforcing bar image analysis system in the internet of things.” Multimedia Tools Appl. 78 (Feb): 3171–3180. https://doi.org/10.1007/s11042-018-5984-7.
Li, C., et al. 2022a. “YOLOv6: A single-stage object detection framework for industrial applications.” Preprint, submitted September 7, 2022. http://arxiv.org/abs/2209.02976.
Li, J., G. Zhou, D. Li, M. Zhang, and X. Zhao. 2022b. “Recognizing workers’ construction activities on a reinforcement processing area through the position relationship of objects detected by faster R-CNN.” Eng. Constr. Archit. Manage. 30 (4): 1657–1678. https://doi.org/10.1108/ECAM-04-2021-0312.
Li, Y., and J. Chen. 2021. “Computer vision–based counting model for dense steel pipe on construction sites.” J. Constr. Eng. Manage. 148 (1): 04021178. https://doi.org/10.1061/(ASCE)co.1943-7862.0002217.
Li, Y., Y. Lu, and J. Chen. 2021. “A deep learning approach for real-time rebar counting on the construction site based on YOLOv3 detector.” Autom. Constr. 124 (Apr): 103602. https://doi.org/10.1016/j.autcon.2021.103602.
Liu, C., L. Zhu, and X. Zhang. 2019. “Bundled round bars counting based on iteratively trained SVM.” In Proc., 15th Int. Conf. Intelligent Computing Theories and Application ICIC 2019, 156–165. Berlin: Springer.
Liu, W., D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C. Y. Fu, and A. C. Berg. 2016. “SSD: Single shot multibox detector.” In Proc., 14th European Conf. Computer Vision–ECCV 2016, 21–37. Berlin: Springer.
Liu, Y.-F., S. Cho, B. F. Spencer, and J.-S. Fan. 2014. “Concrete crack assessment using digital image processing and 3D scene reconstruction.” J. Comput. Civ. Eng. 30 (1): 04014124. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000446.
Mansoor, A., S. Liu, G. M. Ali, A. Bouferguene, and M. Al-Hussein. 2023. “A deep-learning classification framework for reducing communication errors in dynamic hand signaling for crane operation.” J. Constr. Eng. Manage. 149 (2): 04022167. https://doi.org/10.1061/jcemd4.coeng-12811.
Mei, X., X. Zhou, F. Xu, and Z. Zhang. 2022. “Human intrusion detection in static hazardous areas at construction sites: Deep learning–based method.” J. Constr. Eng. Manage. 149 (1): 04022142. https://doi.org/10.1061/(asce)co.1943-7862.0002409.
Shorten, C., and T. M. Khoshgoftaar. 2019. “A survey on image data augmentation for deep learning.” J. Big Data 6 (1): 1–48. https://doi.org/10.1186/s40537-019-0197-0.
Su, Z., K. Fang, Z. Peng, and Z. Feng. 2010. “Rebar automatically counting on the product line.” In Proc., IEEE Int. Conf. on Progress in Informatics and Computing, 756–760. New York: IEEE.
Wang, S. 2023. Rebar counting detection using object detection based on deep learning. London: Figshare Data Repositioning. https://doi.org/10.6084/m9.figshare.23633703.
Whiteley, J. 1997. “BS 4449 and European standards.” Concrete 31 (5): 12–14.
Wu, Y., A. Kirillov, F. Massa, W.-Y. Lo, and R. Girshick. 2019. “Detectron2.” Accessed November 16, 2021. https://github.com/facebookresearch/detectron2.
Wu, Y., X. Zhou, and Y. Zhang. 2015. “Steel bars counting and splitting method based on machine vision.” In Proc., 2015 IEEE Int. Conf. on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER), 420–425. New York: IEEE.
Xiao, B., and S.-C. Kang. 2020. “Development of an image data set of construction machines for deep learning object detection.” J. Comput. Civ. Eng. 35 (2): 05020005. https://doi.org/10.1061/(ASCE)cp.1943-5487.0000945.
Xiaohu, L., and O. Jineng. 2018. “Research on steel bar detection and counting method based on contours.” In Proc., Int. Conf. on Electronics Technology (ICET), 294–297. New York: IEEE.
Xin, Y., W. Xue, P. X. Yuan, Q. Da Han, and C. H. Chen. 2010. “Research on an automatic counting method for steel bars’ image.” In Proc., Int. Conf. on Electrical and Control Engineering, 1644–1647. New York: IEEE.
Zhang, D., Z. Xie, and C. Wang. 2008. “Bar section image enhancement and positioning method in on-line steel bar counting and automatic separating system.” In Proc., Congress on Image and Signal Processing, 319–323. New York: IEEE.
Zhao, J., X. Xia, H. Wang, and S. Kong. 2016. “Design of real-time steel bars recognition system based on machine vision.” In Proc., 8th Int. Conf. on Intelligent Human-Machine Systems and Cybernetics (IHMSC), 505–509. New York: IEEE.
Zhu, Y., C. Tang, H. Liu, and P. Huang. 2020. “End-face localization and segmentation of steel bar based on convolution neural network.” IEEE Access 8 (Apr): 74679–74690. https://doi.org/10.1109/ACCESS.2020.2989300.

Information & Authors

Information

Published In

Go to Journal of Construction Engineering and Management
Journal of Construction Engineering and Management
Volume 149Issue 11November 2023

History

Received: Feb 19, 2023
Accepted: Jul 7, 2023
Published online: Aug 31, 2023
Published in print: Nov 1, 2023
Discussion open until: Jan 31, 2024

Permissions

Request permissions for this article.

ASCE Technical Topics:

Authors

Affiliations

Seunghyeon Wang
Lecturer, Dept. of Architectural Engineering, Hanyang Univ., Seungdong-Gu, Seoul 133791, Korea.
Mincheol Kim
Researcher, Dept. of Architectural Engineering, Hanyang Univ., Seungdong-Gu, Seoul 133791, Korea.
Hyeonyong Hae
Research Fellow, AI Lab, IGAWORKS, Mapo-Gu, Seoul 04036, Korea.
Senior Lecturer, School of Architecture and Cities, Univ. of Westminster, London NW1 5LS, UK. ORCID: https://orcid.org/0000-0001-8670-4735
Professor, Dept. of Architectural Engineering, Hanyang Univ., Seungdong-Gu, Seoul 133791, Korea (corresponding author). ORCID: https://orcid.org/0000-0001-5078-4796. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share