Critical Review and Road Map of Automated Methods for Earthmoving Equipment Productivity Monitoring
Publication: Journal of Computing in Civil Engineering
Volume 36, Issue 3
Abstract
Monitoring the productivity of construction equipment would help to improve construction productivity, control cost, and discover potential project issues. However, manual equipment productivity monitoring is labor-intensive and inefficient. In recent years, a large number of studies have been conducted to develop automatic methods for equipment productivity monitoring. Numerous technologies were used to estimate equipment operation time, calculate soil quantity, and analyze influence factors, among others. However, there is no recent review paper focusing on equipment productivity monitoring. This paper provides a comprehensive review of automated methods for earthmoving equipment productivity monitoring. A total of 119 related papers are reviewed and 88 papers are categorized based on the method of collecting productivity-related data. In addition, the benefits and limitations of different methods are compared in detail. Finally, a roadmap is proposed to illustrate a path forward for automatic equipment monitoring and productivity analysis. The review is expected to provide future directions that will support the development of full automation in productivity monitoring of construction equipment.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
No data, models, or code were generated or used during the study.
References
AbouRizk, S. 2010. “Role of simulation in construction engineering and management.” J. Constr. Eng. Manage. 136 (10): 1140–1153. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000220.
Ahn, C., S. Lee, F. Peña-Mora, and A. Schapiro. 2012. “Monitoring system for operational efficiency and environmental performance of construction operations, using vibration signal analysis.” In Proc., Construction Research Congress, 2012. Reston, VA: ASCE.
Ahn, C. R., S. Lee, and F. Peña-Mora. 2015. “Application of low-cost accelerometers for measuring the operational efficiency of a construction equipment fleet.” J. Comput. Civ. Eng. 29 (2): 04014042. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000337.
Ahn, S., S. Han, and M. Al-Hussein. 2020. “Improvement of transportation cost estimation for prefabricated construction using geo-fence-based large-scale GPS data feature extraction and support vector regression.” Adv. Eng. Inf. 43 (Jan): 101012. https://doi.org/10.1016/j.aei.2019.101012.
Akhavian, R., and A. H. Behzadan. 2012. “An integrated data collection and analysis framework for remote monitoring and planning of construction operations.” Adv. Eng. Inf. 26 (4): 749–761. https://doi.org/10.1016/j.aei.2012.04.004.
Akhavian, R., and A. H. Behzadan. 2013. “Knowledge-based simulation modeling of construction fleet operations using multimodal-process data mining.” J. Constr. Eng. Manage. 139 (11): 04013021. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000775.
Akhavian, R., and A. H. Behzadan. 2015. “Construction equipment activity recognition for simulation input modeling using mobile sensors and machine learning classifiers.” Adv. Eng. Inf. 29 (4): 867–877. https://doi.org/10.1016/j.aei.2015.03.001.
Alshibani, D. A., and D. O. Moselhi. 2016. “Productivity based method for forecasting cost & time of earthmoving operations using sampling GPS data.” J. Inf. Technol. Constr. 21 (3): 39–56.
Azar, E. 2017. “Semantic annotation of videos from equipment-intensive construction operations by shot recognition and probabilistic reasoning.” J. Comput. Civ. Eng. 31 (5): 04017042. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000693.
Azar, E., S. Dickinson, and B. McCabe. 2013. “Server-customer interaction tracker: Computer vision–based system to estimate dirt-loading cycles.” J. Constr. Eng. Manage. 139 (7): 785–794. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000652.
Azar, E., and V. Kamat. 2017. “Earthmoving equipment automation: A review of technical advances and future outlook.” J. Inf. Technol. Constr. 22 (13): 247–265.
Azar, E., and B. McCabe. 2012a. “Automated visual recognition of dump trucks in construction videos.” J. Comput. Civ. Eng. 26 (6): 769–781. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000179.
Azar, E., and B. McCabe. 2012b. “Part based model and spatial–temporal reasoning to recognize hydraulic excavators in construction images and videos.” Autom. Constr. 24 (Jul): 194–202. https://doi.org/10.1016/j.autcon.2012.03.003.
Azar, E. R. 2016. “Construction equipment identification using marker-based recognition and an active zoom camera.” J. Comput. Civ. Eng. 30 (3): 04015033. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000507.
Bae, J., K. Kim, and D. Hong. 2019. “Automatic identification of excavator activities using joystick signals.” Int. J. Precis. Eng. Manuf. 20 (12): 2101–2107. https://doi.org/10.1007/s12541-019-00219-5.
Bastan, M., K. Yap, and L. Chau. 2018. “Idling car detection with convnets in infrared image sequences.” In Proc., 2018 IEEE Int. Symp. on Circuits and Systems (ISCAS), 1–5. New York: IEEE.
Bouet, M., and A. L. dos Santos. 2008. “RFID tags: Positioning principles and localization techniques.” In Proc., 2008 1st IFIP Wireless Days, 1–5. New York: IEEE.
Bouguet, J. 2000. Pyramidal implementation of the Lucas Kanade feature tracker. Hillsboro, OR: Intel.
Bügler, M., A. Borrmann, G. Ogunmakin, P. A. Vela, and J. Teizer. 2017. “Fusion of photogrammetry and video analysis for productivity assessment of earthwork processes.” Comput.-Aided Civ. Infrastruct. Eng. 32 (2): 107–123. https://doi.org/10.1111/mice.12235.
Bügler, M., G. Ongunmakin, J. Teizer, P. Vela, and A. Borrmann. 2014. “A comprehensive methodology for vision-based progress and activity estimation of excavation processes for productivity assessment.” In Proc., 21st Int. Workshop: Intelligent Computing in Engineering, EG-ICE 2014. Berlin: European Group for Intelligent Computing in Engineering.
Cai, J., and H. Cai. 2020. “Robust hybrid approach of vision-based tracking and radio-based identification and localization for 3D tracking of multiple construction workers.” J. Comput. Civ. Eng. 34 (4): 04020021. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000901.
Caterpillar. 2021a. “Caterpillar truck diagnostic scanner fault code reader.” Accessed November 16, 2021. https://www.repairmanuals.co/products/caterpillar-truck-diagnostic-scanner-fault-code-reader.
Caterpillar. 2021b. “Machine automation and control systems for construction | Milton CAT.” Accessed November 16, 2021. https://www.miltoncat.com/improving-performance/accugrade-machine-automation.
Chen, C., Z. Zhu, and A. Hammad. 2020a. “Automated excavators activity recognition and productivity analysis from construction site surveillance videos.” Autom. Constr. 110 (Feb): 103045. https://doi.org/10.1016/j.autcon.2019.103045.
Chen, C., Z. Zhu, and A. Hammad. 2020b. “Automatic analysis of idling in excavator’s operations based on excavator-truck relationships.” In Proc., ISARC, 1307–1313. Oulu, Finland: International Association for Automation and Robotics in Construction.
Chen, H., X. Luo, Z. Zheng, and J. Ke. 2019. “A proactive workers’ safety risk evaluation framework based on position and posture data fusion.” Autom. Constr. 98 (Feb): 275–288. https://doi.org/10.1016/j.autcon.2018.11.026.
Cheng, C.-F., A. Rashidi, M. A. Davenport, and D. V. Anderson. 2017. “Activity analysis of construction equipment using audio signals and support vector machines.” Autom. Constr. 81 (Sep): 240–253. https://doi.org/10.1016/j.autcon.2017.06.005.
Cheng, C.-F., A. Rashidi, M. A. Davenport, and D. V. Anderson. 2019. “Evaluation of software and hardware settings for audio-based analysis of construction operations.” Int. J. Civ. Eng. 17 (9): 1469–1480. https://doi.org/10.1007/s40999-019-00409-2.
Cheng, T., M. Venugopal, J. Teizer, and P. A. Vela. 2011. “Performance evaluation of ultra wideband technology for construction resource location tracking in harsh environments.” Autom. Constr. 20 (8): 1173–1184. https://doi.org/10.1016/j.autcon.2011.05.001.
Chi, S., and C. H. Caldas. 2011. “Automated object identification using optical video cameras on construction sites.” Comput.-Aided Civ. Infrastruct. Eng. 26 (5): 368–380. https://doi.org/10.1111/j.1467-8667.2010.00690.x.
Dai, J., Y. Li, K. He, and J. Sun. 2016. “R-FCN: Object detection via region-based fully convolutional networks.” Preprints, submitted May 20, 2016. http://arxiv.org/abs/1605.06409.
Edwards, D., and I. Griffiths. 2000a. “Artificial intelligence approach to calculation of hydraulic excavator cycle time and output.” Min. Technol. Trans. Inst. Min. Metall. 109 (1): 23–29.
Edwards, D., and G. Holt. 2000b. “ESTIVATE: A model for calculating excavator productivity and output costs.” Eng. Constr. Archit. Manage. 7 (1): 52–62. https://doi.org/10.1108/eb021132.
Fang, W., L. Ding, B. Zhong, P. E. D. Love, and H. Luo. 2018. “Automated detection of workers and heavy equipment on construction sites: A convolutional neural network approach.” Adv. Eng. Inf. 37 (Aug): 139–149. https://doi.org/10.1016/j.aei.2018.05.003.
Feng, C., S. Dong, K. M. Lundeen, Y. Xiao, and V. R. Kamat. 2015. “Vision-based articulated machine pose estimation for excavation monitoring and guidance.” In Proc., ISARC, 1–9. Oulu, Finland: International Association for Automation and Robotics in Construction.
Fukunaga, K. 2013. Introduction to statistical pattern recognition. San Francisco: Elsevier.
Golparvar-Fard, M., A. Heydarian, and J. C. Niebles. 2013. “Vision-based action recognition of earthmoving equipment using spatio-temporal features and support vector machine classifiers.” Adv. Eng. Inf. 27 (4): 652–663. https://doi.org/10.1016/j.aei.2013.09.001.
Gong, J., and C. H. Caldas. 2011. “An object recognition, tracking, and contextual reasoning-based video interpretation method for rapid productivity analysis of construction operations.” Autom. Constr. 20 (8): 1211–1226. https://doi.org/10.1016/j.autcon.2011.05.005.
Gong, J., C. H. Caldas, and C. Gordon. 2011. “Learning and classifying actions of construction workers and equipment using bag-of-video-feature-words and Bayesian network models.” Adv. Eng. Inf. 25 (4): 771–782. https://doi.org/10.1016/j.aei.2011.06.002.
Haag, S., and R. Anderl. 2018. “Digital twin—Proof of concept.” Manuf. Lett. 15 (Jan): 64–66. https://doi.org/10.1016/j.mfglet.2018.02.006.
Han, S. H., T. H. Hong, and S. L. Lee. 2008. “Production prediction of conventional and global positioning system–based earthmoving systems using simulation and multiple regression analysis.” Can. J. Civ. Eng. 35 (6): 574–587. https://doi.org/10.1139/L08-005.
Hannus, M. 2003. Construction ICT roadmap. West Chester, PA: Road-Con.
Henriques, J. F., R. Caseiro, P. Martins, and J. Batista. 2012. “Exploiting the circulant structure of tracking-by-detection with kernels.” In Computer vision—ECCV 2012, lecture notes in computer science, edited by A. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, and C. Schmid, 702–715. Berlin: Springer.
Henriques, J. F., R. Caseiro, P. Martins, and J. Batista. 2015. “High-speed tracking with kernelized correlation filters.” IEEE Trans. Pattern Anal. Mach. Intell. 37 (3): 583–596. https://doi.org/10.1109/TPAMI.2014.2345390.
Hernandez, C., T. Slaton, V. Balali, and R. Akhavian. 2019. “A deep learning framework for construction equipment activity analysis.” In Proc., ASCE Int. Conf. on Computing in Civil Engineering, 479–486. Reston, VA: ASCE.
Hola, B., and K. Schabowicz. 2010. “Estimation of earthworks execution time cost by means of artificial neural networks.” Autom. Constr. 19 (5): 570–579. https://doi.org/10.1016/j.autcon.2010.02.004.
Holt, G., and D. Edwards. 2015. “Analysis of interrelationships among excavator productivity modifying factors.” Int. J. Productivity Perform. Manage. 64 (6): 853–869. https://doi.org/10.1108/IJPPM-02-2014-0026.
Ibrahim, M., and O. Moselhi. 2014. “Automated productivity assessment of earthmoving operations.” J. Inf. Technol. Constr. 19 (9): 169–184.
Jain, A., A. Sharma, S. L. Borana, B. Ravindra, and J. P. Mangalhara. 2018. “Study and analysis of exhaust emission of diesel vehicles using thermal imagers.” Defence Sci. J. 68 (6): 533–539. https://doi.org/10.14429/dsj.68.12701.
Kalal, Z., K. Mikolajczyk, and J. Matas. 2010. “Forward-backward error: Automatic detection of tracking failures.” In Proc., 20th Int. Conf. on Pattern Recognition, 2756–2759. New York: IEEE.
Kalal, Z., K. Mikolajczyk, and J. Matas. 2012. “Tracking-learning-detection.” IEEE Trans. Pattern Anal. Mach. Intell. 34 (7): 1409–1422. https://doi.org/10.1109/TPAMI.2011.239.
Khajavi, S. H., N. H. Motlagh, A. Jaribion, L. C. Werner, and J. Holmström. 2019. “Digital twin: Vision, benefits, boundaries, and creation for buildings.” IEEE Access 7 (Sep): 147406–147419. https://doi.org/10.1109/ACCESS.2019.2946515.
Kim, H., C. R. Ahn, D. Engelhaupt, and S. Lee. 2018a. “Application of dynamic time warping to the recognition of mixed equipment activities in cycle time measurement.” Autom. Constr. 87 (Mar): 225–234. https://doi.org/10.1016/j.autcon.2017.12.014.
Kim, H., S. Bang, H. Jeong, Y. Ham, and H. Kim. 2018b. “Analyzing context and productivity of tunnel earthmoving processes using imaging and simulation.” Autom. Constr. 92 (Aug): 188–198. https://doi.org/10.1016/j.autcon.2018.04.002.
Kim, H., Y. Ham, W. Kim, S. Park, and H. Kim. 2019a. “Vision-based nonintrusive context documentation for earthmoving productivity simulation.” Autom. Constr. 102 (Jun): 135–147. https://doi.org/10.1016/j.autcon.2019.02.006.
Kim, H., H. Kim, Y. W. Hong, and H. Byun. 2018c. “Detecting construction equipment using a region-based fully convolutional network and transfer learning.” J. Comput. Civ. Eng. 32 (2): 04017082. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000731.
Kim, H., K. Kim, and H. Kim. 2016. “Vision-based object-centric safety assessment using fuzzy inference: Monitoring struck-by accidents with moving objects.” J. Comput. Civ. Eng. 30 (4): 04015075. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000562.
Kim, J. 2020. “Visual analytics for operation-level construction monitoring and documentation: State-of-the-art technologies, research challenges, and future directions.” Front. Built Environ. 575738. https://doi.org/10.3389/fbuil.2020.575738.
Kim, J., and S. Chi. 2017. “Adaptive detector and tracker on construction sites using functional integration and online learning.” J. Comput. Civ. Eng. 31 (5): 04017026. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000677.
Kim, J., and S. Chi. 2019. “Action recognition of earthmoving excavators based on sequential pattern analysis of visual features and operation cycles.” Autom. Constr. 104 (Aug): 255–264. https://doi.org/10.1016/j.autcon.2019.03.025.
Kim, J., and S. Chi. 2020. “Multi-camera vision-based productivity monitoring of earthmoving operations.” Autom. Constr. 112 (Apr): 103121. https://doi.org/10.1016/j.autcon.2020.103121.
Kim, J., S. Chi, and J. Seo. 2018d. “Interaction analysis for vision-based activity identification of earthmoving excavators and dump trucks.” Autom. Constr. 87 (Mar): 297–308. https://doi.org/10.1016/j.autcon.2017.12.016.
Kim, J., J. Hwang, S. Chi, and J. Seo. 2020. “Towards database-free vision-based monitoring on construction sites: A deep active learning approach.” Autom. Constr. 120 (Dec): 103376. https://doi.org/10.1016/j.autcon.2020.103376.
Kim, K., H. Kim, and H. Kim. 2017. “Image-based construction hazard avoidance system using augmented reality in wearable device.” Autom. Constr. 83 (Nov): 390–403. https://doi.org/10.1016/j.autcon.2017.06.014.
Kim, S.-H., Y.-S. Lee, D.-I. Sun, S.-K. Lee, B.-H. Yu, S.-H. Jang, W. Kim, and C.-S. Han. 2019b. “Development of bulldozer sensor system for estimating the position of blade cutting edge.” Autom. Constr. 106 (Oct): 102890. https://doi.org/10.1016/j.autcon.2019.102890.
Kim, Y. B., J. Ha, H. Kang, P. Y. Kim, J. Park, and F. C. Park. 2013. “Dynamically optimal trajectories for earthmoving excavators.” Autom. Constr. 35 (Nov): 568–578. https://doi.org/10.1016/j.autcon.2013.01.007.
Köpüklü, O., X. Wei, and G. Rigoll. 2020. “You only watch once: A unified CNN architecture for real-time spatiotemporal action localization.” Accessed November 15, 2019. http://arxiv.org/abs/1911.06644.
Li, J., H. Li, W. Umer, H. Wang, X. Xing, S. Zhao, and J. Hou. 2020. “Identification and classification of construction equipment operators’ mental fatigue using wearable eye-tracking technology.” Autom. Constr. 109 (Jan): 103000. https://doi.org/10.1016/j.autcon.2019.103000.
Li, J., H. Li, H. Wang, W. Umer, H. Fu, and X. Xing. 2019. “Evaluating the impact of mental fatigue on construction equipment operators’ ability to detect hazards using wearable eye-tracking technology.” Autom. Constr. 105 (Sep): 102835. https://doi.org/10.1016/j.autcon.2019.102835.
Li, L., W. Huang, I. Gu, and Q. Tian. 2003. “Foreground object detection from videos containing complex background.” In Proc., ACM Int. Multimedia Conf. and Exhibition, 10. New York: Special Interest Group on Computer Graphics.
Li, X., W. Yi, H.-L. Chi, X. Wang, and A. Chan. 2017. “A critical review of virtual and augmented reality (VR/AR) application in construction safety.” Autom. Constr. 86 (Feb): 150–162.
Lingard, H., R. Wakefield, and N. Blismas. 2013. “‘If you cannot measure it, you cannot improve it’: Measuring health and safety performance in the construction industry | Semantic Scholar.” Accessed December 30, 2020. https://www.semanticscholar.org/paper/%22If-you-cannot-measure-it%2C-you-cannot-improve-it%22%3A-Lingard-Wakefield/034e0275d72935945f10c04b0e0bee892478d120.
Liu, W., D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.-Y. Fu, and A. C. Berg. 2016. “SSD: Single shot multibox detector.” In Proc., European Conf. on Computer Vision—ECCV 2016, 21–37. San Jose, CA: Adobe.
Liu, Y., Z. Tu, L. Lin, X. Xie, and Q. Qin. 2020. “Real-time spatio-temporal action localization via learning motion representation.” In Proc., Asian Conf. on Computer Vision (ACCV). Shen Zhen, China: Tencent AI Lab.
Louis, J., and P. S. Dunston. 2018. “Integrating IoT into operational workflows for real-time and automated decision-making in repetitive construction operations.” Autom. Constr. 94 (Oct): 317–327. https://doi.org/10.1016/j.autcon.2018.07.005.
Lu, W., G. Q. Huang, and H. Li. 2011. “Scenarios for applying RFID technology in construction project management.” Autom. Constr. 20 (2): 101–106. https://doi.org/10.1016/j.autcon.2010.09.007.
Lucas, B., and T. Kanade. 1981. “An iterative image registration technique with an application to stereo vision.” In Proc., 7th Int. Joint Conf. on Artificial Intelligence (IJCAI), 121–130. Stanford, CA: International Joint Conference on Artificial Intelligence.
Lundeen, K. M., S. Dong, N. Fredricks, M. Akula, J. Seo, and V. R. Kamat. 2016. “Optical marker-based end effector pose estimation for articulated excavators.” Autom. Constr. 65 (May): 51–64. https://doi.org/10.1016/j.autcon.2016.02.003.
Lustbader, J. A., T. Venson, S. Adelman, C. Dehart, S. Yeakel, and M. S. Castillo. 2012. “Application of sleeper cab thermal management technologies to reduce idle climate control loads in long-haul trucks.” In Proc., SAE Technical Paper. Cedar Falls, IAa: DISTek.
Manyele, S. V. 2017. “Investigation of excavator performance factors in an open-pit mine using loading cycle time.” Engineering 9 (7): 599–624. https://doi.org/10.4236/eng.2017.97038.
Mathur, N., S. S. Aria, T. Adams, C. R. Ahn, and S. Lee. 2015. “Automated cycle time measurement and analysis of excavator’s loading operation using smart phone-embedded IMU sensors.” In Proc., 2015 Int. Workshop on Computing in Civil Engineering, 215–222. Reston, VA: ASCE.
Memarzadeh, M., M. Golparvar-Fard, and J. C. Niebles. 2013. “Automated 2D detection of construction equipment and workers from site video streams using histograms of oriented gradients and colors.” Autom. Constr. 32 (Jul): 24–37. https://doi.org/10.1016/j.autcon.2012.12.002.
Montaser, A., I. Bakry, A. Alshibani, and O. Moselhi. 2012. “Estimating productivity of earthmoving operations using spatial technologies.” Can. J. Civ. Eng. 39 (9): 1072–1082. https://doi.org/10.1139/l2012-059.
Montaser, A., and O. Moselhi. 2012. “RFID+ for tracking earthmoving operations.” In Proc., Construction Research Congress (CRC 2012), 1011–1022. West Lafayette, IN: ASCE.
Montaser, A., and O. Moselhi. 2014. “Truck+ for earthmoving operations.” Technol. Constr. 19 (25): 412–433.
Moselhi, O., D. Gong, and K. El-Rayes. 2011. “Estimating weather impact on the duration of construction activities.” Can. J. Civ. Eng. 24 (3): 359–366. https://doi.org/10.1139/l96-122.
Naskoudakis, I., and K. Petroutsatou. 2016. “A thematic review of main researches on construction equipment over the recent years.” Procedia Eng. 47 (2): 110–118. https://doi.org/10.1016/j.proeng.2016.11.611.
Ni, L. M., Y. Liu, Y. C. Lau, and A. P. Patil. 2003. “LANDMARC: Indoor location sensing using active RFID.” In Proc., 1st IEEE Int. Conf. on Pervasive Computing and Communications, 2003. (PerCom 2003). 407–415. New York: IEEE.
Park, M.-W., A. Makhmalbaf, and I. Brilakis. 2011. “Comparative study of vision tracking methods for tracking of construction site resources.” Autom. Constr. 20 (7): 905–915. https://doi.org/10.1016/j.autcon.2011.03.007.
Pazhoohesh, M., and C. Zhang. 2015. “Automated construction progress monitoring using thermal images and wireless sensor network.” In Proc., CSCE Annual Conf., 957–963. Surrey, Canada: Canadian Society for Civil Engineering.
Pradhananga, N., and J. Teizer. 2013. “Automatic spatio-temporal analysis of construction site equipment operations using GPS data.” Autom. Constr. 29 (Jan): 107–122. https://doi.org/10.1016/j.autcon.2012.09.004.
Rashid, K. M., and J. Louis. 2019. “Times-series data augmentation and deep learning for construction equipment activity recognition.” Adv. Eng. Inf. 42 (Oct): 100944. https://doi.org/10.1016/j.aei.2019.100944.
Rashid, K. M., and J. Louis. 2020. “Automated activity identification for construction equipment using motion data from articulated members.” Front. Built Environ. 5 (Jan): 144. https://doi.org/10.3389/fbuil.2019.00144.
Reddy, V., C. Sanderson, and B. C. Lovell. 2009. “An efficient and robust sequential algorithm for background estimation in video surveillance.” In Proc., 2009 16th IEEE Int. Conf. on Image Processing (ICIP), 1109–1112. Washington, DC: IEEE Computer Society.
Redmon, J., S. Divvala, R. Girshick, and A. Farhadi. 2016. “You only look once: Unified, real-time object detection.” In Proc., 2016 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 779–788. Washington, DC: IEEE Computer Society.
Roberts, D., and M. Golparvar-Fard. 2019. “End-to-end vision-based detection, tracking and activity analysis of earthmoving equipment filmed at ground level.” Autom. Constr. 105 (Sep): 102811. https://doi.org/10.1016/j.autcon.2019.04.006.
Sabillon, C., A. Rashidi, B. Samanta, M. A. Davenport, and D. V. Anderson. 2020. “Audio-based Bayesian model for productivity estimation of cyclic construction activities.” J. Comput. Civ. Eng. 34 (1): 04019048. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000863.
Salem, A., A. Salah, and O. Moselhi. 2018. “Fuzzy-based configuration of automated data acquisition systems for earthmoving operations.” Electron. J. Inf. Technol. Constr. 23 (May): 122–137.
Santosh, K. G., W. G. Bharti, and P. Yannawar. 2010. “A review on speech recognition technique.” Int. J. Comput. Appl. 10 (3): 16–24.
Seresht, N., and A. Fayek. 2019. “Factors influencing multifactor productivity of equipment-intensive activities.” Int. J. Productivity Perform. Manage. 69 (9): 2021–2045. https://doi.org/10.1108/IJPPM-07-2018-0250.
Shahandashti, S. M., et al. 2011. “Data-fusion approaches and applications for construction engineering.” J. Constr. Eng. Manage. 137 (10): 863–869. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000287.
Sherafat, B., C. R. Ahn, R. Akhavian, A. H. Behzadan, M. Golparvar-Fard, H. Kim, Y.-C. Lee, A. Rashidi, and E. R. Azar. 2020. “Automated methods for activity recognition of construction workers and equipment: State-of-the-art review.” J. Constr. Eng. Manage. 146 (6): 03120002. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001843.
Sherafat, B., A. Rashidi, Y.-C. Lee, and C. R. Ahn. 2019. “A hybrid kinematic-acoustic system for automated activity detection of construction equipment.” Sensors 19 (19): 4286. https://doi.org/10.3390/s19194286.
Slaton, T., C. Hernandez, and R. Akhavian. 2020. “Construction activity recognition with convolutional recurrent networks.” Autom. Constr. 113 (May): 103138. https://doi.org/10.1016/j.autcon.2020.103138.
Smith, S. D. 1999. “Earthmoving productivity estimation using linear regression techniques.” J. Constr. Eng. Manage. 125 (3): 133–141. https://doi.org/10.1061/(ASCE)0733-9364(1999)125:3(133).
Soltani, M. M., Z. Zhu, and A. Hammad. 2017. “Skeleton estimation of excavator by detecting its parts.” Autom. Constr. 82 (Oct): 1–15. https://doi.org/10.1016/j.autcon.2017.06.023.
Soltani, M. M., Z. Zhu, and A. Hammad. 2018. “Framework for location data fusion and pose estimation of excavators using stereo vision.” J. Comput. Civ. Eng. 32 (6): 04018045. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000783.
Song, L., and N. N. Eldin. 2012. “Adaptive real-time tracking and simulation of heavy construction operations for look-ahead scheduling.” Autom. Constr. 27 (Nov): 32–39. https://doi.org/10.1016/j.autcon.2012.05.007.
Song, S., E. Marks, and N. Pradhananga. 2017. “Impact variables of dump truck cycle time for heavy excavation construction projects.” J. Constr. Eng. Project Manage. 7 (2): 11–18.
Tajeen, H., and Z. Zhu. 2014. “Image dataset development for measuring construction equipment recognition performance.” Autom. Constr. 48 (Dec): 1–10. https://doi.org/10.1016/j.autcon.2014.07.006.
Tam, C. M., T. K. L. Tong, and S. L. Tse. 2002. “Artificial neural networks model for predicting excavator productivity.” Eng. Constr. Archit. Manage. 9 (5–6): 446–452. https://doi.org/10.1108/eb021238.
Teizer, J. 2015. “Status quo and open challenges in vision-based sensing and tracking of temporary resources on infrastructure construction sites.” Adv. Eng. Inf. 29 (2): 225–238. https://doi.org/10.1016/j.aei.2015.03.006.
Topcon. 2017. “DIY diagnosis device TD300.” Accessed November 16, 2021. http://www.topdondiagnostics.com/topdonwebsite/product/productdetail/10.htm.
Topcon. 2020. “Machine control—The basics.” Accessed November 12, 2021. https://www.topconpositioning.com/gb/insights/machine-control-basics.
Trimble. 2021. “Grade control for excavators | Trimble heavy industry.” Accessed November 15, 2021. https://heavyindustry.trimble.com/en/products/grade-control-excavators.
Vahdatikhaki, F., and A. Hammad. 2014. “Framework for near real-time simulation of earthmoving projects using location tracking technologies.” Autom. Constr. 42 (Jun): 50–67. https://doi.org/10.1016/j.autcon.2014.02.018.
Vasenev, A., T. Hartmann, and A. G. Dorée. 2014. “A distributed data collection and management framework for tracking construction operations.” Adv. Eng. Inf. 28 (2): 127–137. https://doi.org/10.1016/j.aei.2014.01.003.
Wojke, N., A. Bewley, and D. Paulus. 2017. “Simple online and realtime tracking with a deep association metric.” Preprints, submitted March 21, 2017. http://arxiv.org/abs/1703.07402.
Xiao, B., and Z. Zhu. 2018. “Two-dimensional visual tracking in construction scenarios: A comparative study.” J. Comput. Civ. Eng. 32 (3): 04018006. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000738.
Yang, J., D. J. Edwards, and P. E. D. Love. 2003. “A computational intelligent fuzzy model approach for excavator cycle time simulation.” Autom. Constr. 12 (6): 725–735. https://doi.org/10.1016/S0926-5805(03)00056-6.
Yoon, J., J. Kim, J. Seo, and S. Suh. 2014. “Spatial factors affecting the loading efficiency of excavators.” Autom. Constr. 48 (Dec): 97–106. https://doi.org/10.1016/j.autcon.2014.08.002.
Yuan, C., S. Li, and H. Cai. 2017. “Vision-based excavator detection and tracking using hybrid kinematic shapes and key nodes.” J. Comput. Civ. Eng. 31 (1): 04016038. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000602.
Zankoul, E., H. Khoury, D. Salhab, and S. Antar. 2018. “A review on Internet of Things solutions for enhancing construction equipment fleet productivity.” In Proc., Creative Construction Conf., 971–978. Budapest, Hungary: Diamond Congress.
Zhu, Z., X. Ren, and Z. Chen. 2016. “Visual tracking of construction jobsite workforce and equipment with particle filtering.” J. Comput. Civ. Eng. 30 (6): 04016023. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000573.
Zou, J., and H. Kim. 2007. “Using hue, saturation, and value color space for hydraulic excavator idle time analysis.” J. Comput. Civ. Eng. 21 (4): 238–246. https://doi.org/10.1061/(ASCE)0887-3801(2007)21:4(238).
Information & Authors
Information
Published In
Journal of Computing in Civil Engineering
Volume 36 • Issue 3 • May 2022
Copyright
© 2022 American Society of Civil Engineers.
History
Published online: Feb 21, 2022
Published in print: May 1, 2022
Discussion open until: Jul 21, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
- Hiba Jalloul, Ahmad Alshami, Navid Nickdoost, Jinyeong Moon, Juyeong Choi, Automated Material Separation Activity Identification for Sustainable Demolition Operations, Construction Research Congress 2024, 10.1061/9780784485262.100, (981-990), (2024).