Automated Methods for Activity Recognition of Construction Workers and Equipment: State-of-the-Art Review
Publication: Journal of Construction Engineering and Management
Volume 146, Issue 6
Abstract
Equipment and workers are two important resources in the construction industry. Performance monitoring of these resources would help project managers improve the productivity rates of construction jobsites and discover potential performance issues. A typical construction workface monitoring system consists of four major levels: location tracking, activity recognition, activity tracking, and performance monitoring. These levels are employed to evaluate work sequences over time and also assess the workers’ and equipment’s well-being and abnormal edge cases. Results of an automated performance monitoring system could be used to employ preventive measures to minimize operating/repair costs and downtimes. The authors of this paper have studied the feasibility of implementing a wide range of technologies and computational techniques for automated activity recognition and tracking of construction equipment and workers. This paper provides a comprehensive review of these methods and techniques as well as describes their advantages, practical value, and limitations. Additionally, a multifaceted comparison between these methods is presented, and potential knowledge gaps and future research directions are discussed.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Data generated or analyzed during the study are available from the corresponding author by request.
Acknowledgments
This research project has been funded by the US National Science Foundation (NSF) under Grant Nos. CMMI-1606034, CMMI-1800957, and CMMI-1818534. The authors gratefully acknowledge the NSF’s support. Any opinions, findings, conclusions, and recommendations expressed in this paper are those of the authors and do not reflect the views of the funding agency.
References
Aha, D. W., D. Kibler, and M. K. Albert. 1991. “Instance-based learning algorithms.” Mach. Learn. 6 (1): 37–66. https://doi.org/10.1007/BF00153759.
Ahn, C. R., S. Lee, and F. Peña-Mora. 2012. “Monitoring system for operational efficiency and environmental performance of construction operations using vibration signal analysis.” In Proc., Construction Research Congress 2012: Construction Challenges in a Flat World, 1879–1888. Reston, VA: ASCE. https://doi.org/10.1061/9780784412329.189.
Ahn, C. R., S. Lee, and F. Peña-Mora. 2013. “Application of low-cost accelerometers for measuring the operational efficiency of a construction equipment fleet.” J. Comput. Civ. Eng. 29 (2): 04014042. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000337.
Akhavian, R., and A. H. Behzadan. 2012. “Remote monitoring of dynamic construction processes using automated equipment tracking.” In Proc., Construction Research Congress 2012: Construction Challenges in a Flat World, 1360–1369. Reston, VA: ASCE. https://doi.org/10.1061/9780784412329.137.
Akhavian, R., and A. H. Behzadan. 2013a. “Automated knowledge discovery and data-driven simulation model generation of construction operations.” In Proc., 2013 Winter Simulations Conf., 3030–3041. New York: IEEE. https://doi.org/10.1109/WSC.2013.6721670.
Akhavian, R., and A. H. Behzadan. 2013b. “Knowledge-based simulation modeling of construction fleet operations using multimodal-process data mining.” J. Constr. Eng. Manage. 139 (11): 04013021. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000775.
Akhavian, R., and A. H. Behzadan. 2014. “Simulation-based evaluation of fuel consumption in heavy construction projects by monitoring equipment idle times.” In Proc., 2013 Winter Simulation Conf., 3098–3108. New York: IEEE. https://doi.org/10.1109/WSC.2013.6721677.
Akhavian, R., and A. H. Behzadan. 2015. “Construction equipment activity recognition for simulation input modeling using mobile sensors and machine learning classifiers.” Adv. Eng. Inf. 29 (4): 867–877. https://doi.org/10.1016/j.aei.2015.03.001.
Akhavian, R., and A. H. Behzadan. 2016. “Smartphone-based construction workers’ activity recognition and classification.” Autom. Constr. 71 (Nov): 198–209. https://doi.org/10.1016/j.autcon.2016.08.015.
Akhavian, R., and A. H. Behzadan. 2018. “Coupling human activity recognition and wearable sensors for data-driven construction simulation.” J. Inf. Technol. Constr. 23 (1): 1–15.
Altman, N. S. 1992. “An introduction to kernel and nearest-neighbor nonparametric regression.” Am. Statistician 46 (3): 175–185. https://doi.org/10.1080/00031305.1992.10475879.
Arditi, D., and K. Mochtar. 2000. “Trends in productivity improvement in the US construction industry.” Constr. Manage. Econ. 18 (1): 15–27. https://doi.org/10.1080/014461900370915.
Asadi, K., R. Jain, Z. Qin, M. Sun, M. Noghabaei, J. Cole, K. Han, and E. Lobaton. 2019a. “Vision-based obstacle removal system for autonomous ground vehicles using a robotic arm.” J. Comput. Civ. Eng. https://doi.org/10.1061/9780784482438.042.
Asadi, K., H. Ramshankar, M. Noghabaei, and K. Han. 2019b. “Real-time image localization and registration with BIM using perspective alignment for indoor monitoring of construction.” J. Comput. Civ. Eng. 33 (5): 04019031. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000847.
Awolusi, I., E. Marks, and M. Hallowell. 2018. “Wearable technology for personalized construction safety monitoring and trending: Review of applicable devices.” Autom. Constr. 85 (Jan): 96–106. https://doi.org/10.1016/j.autcon.2017.10.010.
Azar, E. R. 2015. “Construction equipment identification using marker-based recognition and an active zoom camera.” J. Comput. Civ. Eng. 30 (3): 04015033. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000507.
Azar, E. R., and V. R. Kamat. 2017. “Earthmoving equipment automation: A review of technical advances and future outlook.” J. Inf. Technol. Constr. (ITcon) 22 (13): 247–265.
Azar, E. R., and B. McCabe. 2012. “Part based model and spatial–temporal reasoning to recognize hydraulic excavators in construction images and videos.” Autom. Constr. 24 (Jul): 194–202. https://doi.org/10.1016/j.autcon.2012.03.003.
Azar, E. R., and B. Y. McCabe. 2013. “A visual sensing approach to estimate material hauling cycles in heavy construction and surface mining jobsites.” In Vol. 30 of Proc., Int. Symp. on Automation and Robotics in Construction, 1. Vilnius, Lithuania: Vilnius Gediminas Technical Univ.
Bae, J., K. Kim, and D. Hong. 2019. “Automatic identification of excavator activities using joystick signals.” Int. J. Precis. Eng. Manuf. 20 (12): 2101–2107. https://doi.org/10.1007/s12541-019-00219-5.
Behzadan, A. H., Z. Aziz, C. J. Anumba, and V. R. Kamat. 2008. “Ubiquitous location tracking for context-specific information delivery on construction sites.” Autom. Constr. 17 (6): 737–748. https://doi.org/10.1016/j.autcon.2008.02.002.
Breiman, L. 2001. “Random forests.” Mach. Learn. 45 (1): 5–32. https://doi.org/10.1023/A:1010933404324.
Brilakis, I., M. W. Park, and G. Jog. 2011. “Automated vision tracking of project related entities.” Adv. Eng. Inf. 25 (4): 713–724. https://doi.org/10.1016/j.aei.2011.01.003.
Bügler, M., A. Borrmann, G. Ogunmakin, P. A. Vela, and J. Teizer. 2017. “Fusion of photogrammetry and video analysis for productivity assessment of earthwork processes.” Comput.-Aided Civ. Infrastruct. Eng. 32 (2): 107–123. https://doi.org/10.1111/mice.12235.
Cao, J., W. Huang, T. Zhao, J. Wang, and R. Wang. 2015. “An enhance excavation equipments classification algorithm based on acoustic spectrum dynamic feature.” Multidimension. Syst. Signal Process. 28 (3): 921–943. https://doi.org/10.1007/s11045-015-0374-z.
Cao, J., W. Wang, J. Wang, and R. Wang. 2017a. “Excavation equipment recognition based on novel acoustic statistical features.” IEEE Trans. Cybern. 47 (12): 4392–4404. https://doi.org/10.1109/TCYB.2016.2609999.
Cao, J., T. Zhao, J. Wang, R. Wang, and Y. Chen. 2017b. “Excavation equipment classification based on improved MFCC features and ELM.” Neurocomputing 261 (Oct): 231–241. https://doi.org/10.1016/j.neucom.2016.03.113.
Cezar, G. 2012. “Activity recognition in construction sites using 3D accelerometer and gyrometer.” Accessed Octobar 10, 2018. https://pdfs.semanticscholar.org/6661/62709fab34f211b71b5fee7fe1c781936aa2.pdf.
Cheng, C. F., A. Rashidi, M. A. Davenport, and D. Anderson. 2016. “Audio signal processing for activity recognition of construction heavy equipment.” In Vol. 33 of Proc., Int. Symp. on Automation and Robotics in Construction, 1. Vilnius, Lithuania: Vilnius Gediminas Technical Univ.
Cheng, C. F., A. Rashidi, M. A. Davenport, and D. V. Anderson. 2017a. “Activity analysis of construction equipment using audio signals and support vector machines.” Autom. Constr. 81 (Sep): 240–253. https://doi.org/10.1016/j.autcon.2017.06.005.
Cheng, C. F., A. Rashidi, M. A. Davenport, D. V. Anderson, and C. Sabillon. 2018. Software and hardware requirements for audio-based analysis of construction operations. Reston, VA: ASCE.
Cheng, C. F., A. Rashidi, M. A. Davenport, D. V. Anderson, and C. A. Sabillon. 2017b. “Acoustical modeling of construction jobsites: Hardware and software requirements.” In Proc., Computing in Civil Engineering 2017, 352–359. Reston, VA: ASCE. https://doi.org/10.1061/9780784480847.044.
Cheok, G. S., W. C. Stone, R. R. Lipman, and C. Witzgall. 2000. “Ladars for construction assessment and update.” Autom. Constr. 9 (5–6): 463–477. https://doi.org/10.1016/S0926-5805(00)00058-3.
Chi, S., and C. H. Caldas. 2011. “Automated object identification using optical video cameras on construction sites.” Comput.-Aided Civ. Infrastruct. Eng. 26 (5): 368–380. https://doi.org/10.1111/j.1467-8667.2010.00690.x.
Cho, C., Y. Lee, and T. Zhang. 2017. “Sound recognition techniques for multi-layered construction activities and events.” In Computing in civil engineering, 326–334. Reston, VA: ASCE. https://doi.org/10.1061/9780784480847.041.
Fang, W., L. Ding, B. Zhong, P. E. Love, and H. Luo. 2018. “Automated detection of workers and heavy equipment on construction sites: A convolutional neural network approach.” Adv. Eng. Inf. 37 (Aug): 139–149. https://doi.org/10.1016/j.aei.2018.05.003.
Frank, E., M. Hall, and B. Pfahringer. 2002. “Locally weighted naive Bayes.” In Proc., 19th Conf. on Uncertainty in Artificial Intelligence, 249–256. Burlington, MA: Morgan Kaufmann.
Gaikwad, S. K., B. W. Gawali, and P. Yannawar. 2010. “A review on speech recognition technique.” Int J. Comput. Appl. 10 (3): 16–24. https://doi.org/10.5120/1462-1976.
Gencoglu, O., T. Virtanen, and H. Huttunen. 2014. “Recognition of acoustic events using deep neural networks.” In Proc., 22nd European Signal Processing Conf., 506–510. New York: IEEE.
Golparvar-Fard, M., A. Heydarian, and J. C. Niebles. 2013. “Vision-based action recognition of earthmoving equipment using spatio-temporal features and support vector machine classifiers.” Adv. Eng. Inf. 27 (4): 652–663. https://doi.org/10.1016/j.aei.2013.09.001.
Golparvar-Fard, M., F. Peña-Mora, and S. Savarese. 2011. “Integrated sequential as-built and as-planned representation with D 4 AR tools in support of decision-making tasks in the AEC/FM industry.” J. Constr. Eng. Manage. 137 (12): 1099–1116. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000371.
Gong, J., and C. H. Caldas. 2009. “Computer vision-based video interpretation model for automated productivity analysis of construction operations.” J. Comput. Civ. Eng. 24 (3): 252–263. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000027.
Gong, J., and C. H. Caldas. 2011. “An object recognition, tracking, and contextual reasoning-based video interpretation method for rapid productivity analysis of construction operations.” Autom. Constr. 20 (8): 1211–1226. https://doi.org/10.1016/j.autcon.2011.05.005.
Gong, J., C. H. Caldas, and C. Gordon. 2011. “Learning and classifying actions of construction workers and equipment using bag-of-video-feature-words and Bayesian network models.” Adv. Eng. Inf. 25 (4): 771–782. https://doi.org/10.1016/j.aei.2011.06.002.
Goodrum, P. M., C. T. Haas, J. D. Borcherding, and E. Allmon. 2000. “Case studies of US construction labor productivity trends, 1970-1998.” In Proc., Construction Congress VI: Building Together for a Better Tomorrow in an Increasingly Complex World, 808–817. Reston, VA: ASCE. https://doi.org/10.1061/40475(278)85.
Gu, W., and M. S. Ho. 2000. “A comparison of industrial productivity growth in Canada and the United States.” Am. Econ. Rev. 90 (2): 172–175. https://doi.org/10.1257/aer.90.2.172.
Hallowell, M. R. 2010. “Worker fatigue: Managing concerns in rapid renewal highway construction projects.” Prof. Saf. 55 (12): 18–26.
Han, K. K., and M. Golparvar-Fard. 2017. “Potential of big visual data and building information modeling for construction performance analytics: An exploratory study.” Autom. Constr. 73 (Jan): 184–198. https://doi.org/10.1016/j.autcon.2016.11.004.
Han, S., M. Achar, S. Lee, and F. Peña-Mora. 2013. “Empirical assessment of a RGB-D sensor on motion capture and action recognition for construction worker monitoring.” Visual. Eng. 1 (1): 6. https://doi.org/10.1186/2213-7459-1-6.
Hanna, A. S. 2001. Quantifying the cumulative impact of change orders for electrical and mechanical contractors. Austin, TX: Univ. of Texas.
Haykin, S. 2009. Neural networks and learning machines. 3rd ed. Upper Saddle River, NJ: Pearson Education.
Hernandez, C., T. Slaton, V. Balali, and R. Akhavian. 2019. “A deep learning framework for construction equipment activity analysis.” In Computing in civil engineering 2019: Data, sensing, and analytics, 479–486. Reston, VA: ASCE. https://doi.org/10.1061/9780784482438.061.
Hulten, G., L. Spencer, and P. Domingos. 2001. “Mining time-changing data streams.” In Proc., 7th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining, 97–106. New York: Association for Computing Machinery. https://doi.org/10.1145/502512.502529.
Jahanbanifar, S., and R. Akhavian. 2018. “Evaluation of wearable sensors to quantify construction workers muscle force: An ergonomic analysis.” In Proc., 2018 Winter Simulation Conf., 3921–3929. New York: IEEE. https://doi.org/10.1109/WSC.2018.8632419.
Jiang, W., Z. Cai, M. Luo, and Z. L. Yu. 2011. “A simple microphone array for source direction and distance estimation.” In Proc., 2011 6th IEEE Conf. on Industrial Electronics and Applications, 1002–1005. New York: IEEE. https://doi.org/10.1109/ICIEA.2011.5975733.
John, G. H., and P. Langley. 1995. “Estimating continuous distributions in Bayesian classifiers.” In Proc., 11th Conf. on Uncertainty in Artificial Intelligence, 338–345. Burlington, MA: Morgan Kaufmann.
Joshua, L., and K. Varghese. 2010a. “Accelerometer-based activity recognition in construction.” J. Comput. Civ. Eng. 25 (5): 370–379. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000097.
Joshua, L., and K. Varghese. 2010b. “Construction activity classification using accelerometers.” In Proc., Construction Research Congress 2010: Innovation for Reshaping Construction Practice, 61–70. Reston, VA: ASCE. https://doi.org/10.1061/41109(373)7.
Joshua, L., and K. Varghese. 2013. “Selection of accelerometer location on bricklayers using decision trees.” Comput.-Aided Civ. Infrastruct. Eng. 28 (5): 372–388. https://doi.org/10.1111/mice.12002.
Kamat, V. R., J. C. Martinez, M. Fischer, M. Golparvar-Fard, F. Peña-Mora, and S. Savarese. 2010. “Research in visualization techniques for field construction.” J. Constr. Eng. Manage. 137 (10): 853–862. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000262.
Kamišalić, A., I. Fister, M. Turkanović, and S. Karakatič. 2018. “Sensors and functionalities of non-invasive wrist-wearable devices: A review.” Sensors 18 (6): 1714. https://doi.org/10.3390/s18061714.
Khan, S. H., and M. Sohail. 2013. “Activity monitoring of workers using single wearable inertial sensor.” In Proc., 2013 Int. Conf. on Open Source Systems and Technologies, 60–67. New York: IEEE. https://doi.org/10.1109/ICOSST.2013.6720607.
Khosrowpour, A., I. Fedorov, A. Holynski, J. C. Niebles, and M. Golparvar-Fard. 2014a. “Automated worker activity analysis in indoor environments for direct-work rate improvement from long sequences of RGB-D images.” In Proc., Construction Research Congress 2014: Construction in a Global Network, 729–738. Reston, VA: ASCE. https://doi.org/10.1061/9780784413517.075.
Khosrowpour, A., J. C. Niebles, and M. Golparvar-Fard. 2014b. “Vision-based workface assessment using depth images for activity analysis of interior construction operations.” Autom. Constr. 48 (Dec): 74–87. https://doi.org/10.1016/j.autcon.2014.08.003.
Kim, D., M. Liu, S. Lee, and V. R. Kamat. 2019a. “Remote proximity monitoring between mobile construction resources using camera-mounted UAVs.” Autom. Constr. 99 (Mar): 168–182. https://doi.org/10.1016/j.autcon.2018.12.014.
Kim, H., C. R. Ahn, D. Engelhaupt, and S. Lee. 2018a. “Application of dynamic time warping to the recognition of mixed equipment activities in cycle time measurement.” Autom. Constr. 87 (Mar): 225–234. https://doi.org/10.1016/j.autcon.2017.12.014.
Kim, H., S. Bang, H. Jeong, Y. Ham, and H. Kim. 2018b. “Analyzing context and productivity of tunnel earthmoving processes using imaging and simulation.” Autom. Constr. 92 (Aug): 188–198. https://doi.org/10.1016/j.autcon.2018.04.002.
Kim, H., Y. Ham, W. Kim, S. Park, and H. Kim. 2019b. “Vision-based nonintrusive context documentation for earthmoving productivity simulation.” Autom. Constr. 102 (Jun): 135–147. https://doi.org/10.1016/j.autcon.2019.02.006.
Kim, H., H. Kim, Y. W. Hong, and H. Byun. 2017a. “Detecting construction equipment using a region-based fully convolutional network and transfer learning.” J. Comput. Civ. Eng. 32 (2): 04017082. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000731.
Kim, H., K. Kim, and H. Kim. 2015. “Vision-based object-centric safety assessment using fuzzy inference: Monitoring struck-by accidents with moving objects.” J. Comput. Civ. Eng. 30 (4): 04015075. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000562.
Kim, J., and S. Chi. 2017. “Adaptive detector and tracker on construction sites using functional integration and online learning.” J. Comput. Civ. Eng. 31 (5): 04017026. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000677.
Kim, J., and S. Chi. 2019. “Action recognition of earthmoving excavators based on sequential pattern analysis of visual features and operation cycles.” Autom. Constr. 104 (Aug): 255–264. https://doi.org/10.1016/j.autcon.2019.03.025.
Kim, J., S. Chi, and J. Seo. 2018c. “Interaction analysis for vision-based activity identification of earthmoving excavators and dump trucks.” Autom. Constr. 87 (Mar): 297–308. https://doi.org/10.1016/j.autcon.2017.12.016.
Kim, K., H. Kim, and H. Kim. 2017b. “Image-based construction hazard avoidance system using augmented reality in wearable device.” Autom. Constr. 83 (Nov): 390–403. https://doi.org/10.1016/j.autcon.2017.06.014.
Kohavi, R. 1995. “The power of decision tables.” In Proc., European Conf. on Machine Learning, 174–189. Berlin: Springer. https://doi.org/10.1007/3-540-59286-5_57.
Kunreuther, H. C., V. M. Bier, and J. R. Phimister. 2004. Accident precursor analysis and management: Reducing technological risk through diligence. Washington, DC: National Academies Press.
Lara, O. D., and M. A. Labrador. 2013. “A survey on human activity recognition using wearable sensors.” IEEE Commun. Surv. Tutorials 15 (3): 1192–1209. https://doi.org/10.1109/SURV.2012.110112.00192.
Lee, H., C. R. Ahn, N. Choi, T. Kim, and H. Lee. 2019. “The effects of housing environments on the performance of activity-recognition systems using Wi-Fi channel state information: An exploratory study.” Sensors 19 (5): 983. https://doi.org/10.3390/s19050983.
Lee, Y. C., M. Shariatfar, A. Rashidi, and H. W. Lee. 2020. “Evidence-driven sound detection for prenotification and identification of construction safety hazards and accidents.” Autom. Constr. 113 (1): 103127. https://doi.org/10.1016/j.autcon.2020.103127.
Lim, T. K., S. M. Park, H. C. Lee, and D. E. Lee. 2015. “Artificial neural network–based slip-trip classifier using smart sensor for construction workplace.” J. Constr. Eng. Manage. 142 (2): 04015065. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001049.
Lin, J. J., and M. Golparvar Fard. 2016. “Web-based 4D visual production models for decentralized work tracking and information communication on construction sites.” In Proc., 2016 Construction Research Congress: Old and New Construction Technologies Converge in Historic San Juan, 1731–1741. Reston, VA: ASCE. https://doi.org/10.1061/9780784479827.173.
Liu, K., and M. Golparvar-Fard. 2015. “Crowdsourcing construction activity analysis from jobsite video streams.” J. Constr. Eng. Manage. 141 (11): 04015035. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001010.
Lu, L., H. J. Zhang, and H. Jiang. 2002. “Content analysis for audio classification and segmentation.” IEEE Trans. Speech Audio Process. 10 (7): 504–516. https://doi.org/10.1109/TSA.2002.804546.
Luo, H., C. Xiong, W. Fang, P. E. Love, B. Zhang, and X. Ouyang. 2018. “Convolutional neural networks: Computer vision-based workforce activity assessment in construction.” Autom. Constr. 94 (Oct): 282–289. https://doi.org/10.1016/j.autcon.2018.06.007.
Memarzadeh, M., M. Golparvar-Fard, and J. C. Niebles. 2013. “Automated 2D detection of construction equipment and workers from site video streams using histograms of oriented gradients and colors.” Autom. Constr. 32 (Jul): 24–37. https://doi.org/10.1016/j.autcon.2012.12.002.
Nath, N. D., R. Akhavian, and A. H. Behzadan. 2017. “Ergonomic analysis of construction worker’s body postures using wearable mobile sensors.” Appl. Ergon. 62 (Jul): 107–117. https://doi.org/10.1016/j.apergo.2017.02.007.
Nath, N. D., T. Chaspari, and A. H. Behzadan. 2018. “Automated ergonomic risk monitoring using body-mounted sensors and machine learning.” Adv. Eng. Inf. 38 (Oct): 514–526. https://doi.org/10.1016/j.aei.2018.08.020.
Park, M. W., C. Koch, and I. Brilakis. 2011a. “Three-dimensional tracking of construction resources using an on-site camera system.” J. Comput. Civ. Eng. 26 (4): 541–549. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000168.
Park, M. W., A. Makhmalbaf, and I. Brilakis. 2011b. “Comparative study of vision tracking methods for tracking of construction site resources.” Autom. Constr. 20 (7): 905–915. https://doi.org/10.1016/j.autcon.2011.03.007.
Patsis, Y., and W. Verhelst. 2008. “A speech/music/silence/garbage/classifier for searching and indexing broadcast news material.” In Proc., 19th Int. Workshop on Database and Expert Systems Applications, 585–589. New York: IEEE. https://doi.org/10.1109/DEXA.2008.104.
Platt, J., 1998. Sequential minimal optimization: A fast algorithm for training support vector machines. Redmond, WA: Microsoft Research.
Quinlan, J. R. 2014. C4. 5: Programs for machine learning. Amsterdam, Netherlands: Elsevier.
Ranasinghe, S., F. Al Machot, and H. C. Mayr. 2016. “A review on applications of activity recognition systems with regard to performance and evaluation.” Int. J. Distrib. Sens. Netw. 12 (8): 1550147716665520. https://doi.org/10.1177/1550147716665520.
Rashid, K. M., and J. Louis. 2019. “Times-series data augmentation and deep learning for construction equipment activity recognition.” Adv. Eng. Inf. 42 (1): 100944. https://doi.org/10.1016/j.aei.2019.100944.
Rashid, K. M., and J. Louis. 2020. “Automated activity identification for construction equipment using motion data from articulated members.” Front. Built Environ 5 (1): 144. https://doi.org/10.3389/fbuil.2019.00144.
Ren-Jye, D., H. H. Hsien, and W. Keisuke. 2018. “Applications of ICTs and action recognition for construction workers.” Trends Civ. Eng. Archit. 1 (3): 48–54. https://doi.org/10.32474/TCEIA.2018.01.000113.
Rezazadeh Azar, E. 2017. “Semantic annotation of videos from equipment-intensive construction operations by shot recognition and probabilistic reasoning.” J. Comput. Civ. Eng. 31 (5): 04017042. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000693.
Rezazadeh Azar, E., S. Dickinson, and B. McCabe. 2012. “Server-customer interaction tracker: Computer vision–based system to estimate dirt-loading cycles.” J. Constr. Eng. Manage. 139 (7): 785–794. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000652.
Rezazadeh Azar, E., and B. McCabe. 2011. “Automated visual recognition of dump trucks in construction videos.” J. Comput. Civ. Eng. 26 (6): 769–781. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000179.
Roberts, D., and M. Golparvar-Fard. 2019. “End-to-end vision-based detection, tracking and activity analysis of earthmoving equipment filmed at ground level.” Autom. Constr. 105 (Sep): 102811. https://doi.org/10.1016/j.autcon.2019.04.006.
Roberts, D., M. Golparvar-Fard, J. Carlos Niebles, J. Y. Gwak, and R. Bao. 2018. “Vision-based construction activity analysis in long video sequences via hidden Markov models: Experiments on earthmoving operations.” In Proc., Construction Research Congress 2018. Reston, VA: ASCE. https://doi.org/10.1061/9780784481288.017.
Rokach, L., and O. Z. Maimon. 2008. Vol. 69 of Data mining with decision trees: Theory and applications. Singapore: World Scientific.
Ryu, J., J. Seo, H. Jebelli, and S. Lee. 2018. “Automated action recognition using an accelerometer-embedded wristband-type activity tracker.” J. Constr. Eng. Manage. 145 (1): 04018114. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001579.
Sabillon, C., A. Rashidi, B. Samanta, M. A. Davenport, and D. V. Anderson. 2020. “Audio-based bayesian model for productivity estimation of cyclic construction activities.” J. Comput. Civ. Eng. 34 (1): 04019048. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000863.
Sabillon, C. A., A. Rashidi, B. Samanta, C. F. Cheng, M. A. Davenport, and D. V. Anderson. 2017. “A productivity forecasting system for construction cyclic operations using audio signals and a Bayesian approach.” In Proc., Construction Research Congress 2018, 295–304. Reston, VA: ASCE. https://doi.org/10.1061/9780784481264.029.
Schneider, S. P. 2001. “Musculoskeletal injuries in construction: A review of the literature.” Appl. Occup. Environ. Hyg. 16 (11): 1056–1064. https://doi.org/10.1080/104732201753214161.
Seo, J., R. Starbuck, S. Han, S. Lee, and T. J. Armstrong. 2014. “Motion data-driven biomechanical analysis during construction tasks on sites.” J. Comput. Civ. Eng. 29 (4): B4014005. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000400.
Sharan, R. V., and T. J. Moir. 2016. “An overview of applications and advancements in automatic sound recognition.” Neurocomputing 200 (Aug): 22–34. https://doi.org/10.1016/j.neucom.2016.03.020.
Sherafat, B., A. Rashidi, Y. C. Lee, and C. R. Ahn. 2019a. “Automated activity recognition of construction equipment using a data fusion approach.” In Computing in civil engineering 2019: Data, sensing, and analytics. Reston, VA: ASCE. https://doi.org/10.1061/9780784482438.001.
Sherafat, B., A. Rashidi, Y. C. Lee, and C. R. Ahn. 2019b. “A hybrid kinematic-acoustic system for automated activity detection of construction equipment.” Sensors 19 (19): 4286. https://doi.org/10.3390/s19194286.
Slaton, T. C., M. Shariatfar, C. Hernandez, and R. Akhavian. 2020. “Construction activity recognition with convolutional recurrent networks.” Autom. Constr. 113 (1): 103138. https://doi.org/10.1016/j.autcon.2020.103138.
Soltani, M. M., Z. Zhu, and A. Hammad. 2017. “Skeleton estimation of excavator by detecting its parts.” Autom. Constr. 82 (Oct): 1–15. https://doi.org/10.1016/j.autcon.2017.06.023.
Soltani, M. M., Z. Zhu, and A. Hammad. 2018. “Framework for location data fusion and pose estimation of excavators using stereo vision.” J. Comput. Civ. Eng. 32 (6): 04018045. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000783.
Song, L., and N. N. Eldin. 2012. “Adaptive real-time tracking and simulation of heavy construction operations for look-ahead scheduling.” Autom. Constr. 27 (Nov): 32–39. https://doi.org/10.1016/j.autcon.2012.05.007.
Sumner, M., E. Frank, and M. Hall. 2005. “Speeding up logistic model tree induction.” In Proc., European Conf. on Principles of Data Mining and Knowledge Discovery, 675–683. Berlin: Springer. https://doi.org/10.1007/11564126_72.
Tajeen, H., and Z. Zhu. 2014. “Image dataset development for measuring construction equipment recognition performance.” Autom. Constr. 48 (Dec): 1–10. https://doi.org/10.1016/j.autcon.2014.07.006.
Tang, S., and M. Golparvar-Fard. 2017. “Joint reasoning of visual and text data for construction safety inspection.” In Proc., Int. Workshop on Computing in Civil Engineering. Reston, VA: ASCE. https://doi.org/10.1061/9780784480847.056.
Teizer, J. 2015. “Status quo and open challenges in vision-based sensing and tracking of temporary resources on infrastructure construction sites.” Adv. Eng. Inf. 29 (2): 225–238. https://doi.org/10.1016/j.aei.2015.03.006.
Torrent, D. G., and C. H. Caldas. 2009. “Methodology for automating the identification and localization of construction components on industrial projects.” J. Comput. Civ. Eng. 23 (1): 3–13. https://doi.org/10.1061/(ASCE)0887-3801(2009)23:1(3).
Vahdatikhaki, F., A. Hammad, and H. Siddiqui. 2015. “Optimization-based excavator pose estimation using real-time location systems.” Autom. Constr. 56 (Aug): 76–92. https://doi.org/10.1016/j.autcon.2015.03.006.
Wang, D., J. Chen, D. Zhao, F. Dai, C. Zheng, and X. Wu. 2017. “Monitoring workers’ attention and vigilance in construction activities through a wireless and wearable electroencephalography system.” Autom. Constr. 82 (Oct): 122–137. https://doi.org/10.1016/j.autcon.2017.02.001.
Yang, J., Z. Shi, and Z. Wu. 2016. “Vision-based action recognition of construction workers using dense trajectories.” Adv. Eng. Inf. 30 (3): 327–336. https://doi.org/10.1016/j.aei.2016.04.009.
Yang, K., S. Aria, C. R. Ahn, and T. L. Stentz. 2014. “Automated detection of near-miss fall incidents in iron workers using inertial measurement units.” In Proc., Construction Research Congress 2014: Construction in a Global Network, 935–944. Reston, VA: ASCE. https://doi.org/10.1061/9780784413517.096.
Yang, S., J. Cao, and J. Wang. 2015. “Acoustics recognition of construction equipments based on LPCC features and SVM.” In Proc., 2015 34th Chinese Control Conf., 3987–3991. New York: IEEE. https://doi.org/10.1109/ChiCC.2015.7260254.
Yang, Z., Y. Yuan, M. Zhang, X. Zhao, and B. Tian. 2019. “Assessment of construction workers’ labor intensity based on wearable smartphone system.” J. Constr. Eng. Manage. 145 (7): 04019039. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001666.
Yoon, H. Y., and T. E. Lockhart. 2006. “Nonfatal occupational injuries associated with slips and falls in the United States.” Int. J. Ind. Ergon. 36 (1): 83–92. https://doi.org/10.1016/j.ergon.2005.08.005.
Yuan, C., S. Li, and H. Cai. 2016. “Vision-based excavator detection and tracking using hybrid kinematic shapes and key nodes.” J. Comput. Civ. Eng. 31 (1): 04016038. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000602.
Zhang, M., T. Cao, and X. Zhao. 2017. “Applying sensor-based technology to improve construction safety management.” Sensors 17 (8): 1841. https://doi:10.3390/s17081841.
Zhang, T., Y. Lee, M. Scarpiniti, and A. Unciniand. 2018. “A supervised machine learning-based sound identification for construction activity monitoring and performance evaluation.” In Proc., Construction Research Congress 2018, 358–366. Reston, VA: ASCE. https://doi.org/10.1061/9780784481264.035.
Zhu, Z., X. Ren, and Z. Chen. 2016. “Visual tracking of construction jobsite workforce and equipment with particle filtering.” J. Comput. Civ. Eng. 30 (6): 04016023. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000573.
Zhu, Z., X. Ren, and Z. Chen. 2017. “Integrated detection and tracking of workforce and equipment from construction jobsite videos.” Autom. Constr. 81 (Sep): 161–171. https://doi.org/10.1016/j.autcon.2017.05.005.
Zou, J., and H. Kim. 2007. “Using hue, saturation, and value color space for hydraulic excavator idle time analysis.” J. Comput. Civ. Eng. 21 (4): 238–246. https://doi.org/10.1061/(ASCE)0887-3801(2007)21:4(238.
Information & Authors
Information
Published In
Journal of Construction Engineering and Management
Volume 146 • Issue 6 • June 2020
Copyright
©2020 American Society of Civil Engineers.
History
Published online: Apr 8, 2020
Published in print: Jun 1, 2020
Discussion open until: Sep 8, 2020
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.