Chapter
Mar 29, 2018
Vision-Based Construction Activity Analysis in Long Video Sequences via Hidden Markov Models: Experiments on Earthmoving Operations
Authors: Dominic Roberts [email protected], Mani Golparvar-Fard [email protected], Juan Carlos Niebles [email protected], JunYoung Gwak [email protected], and Ruxiao Bao [email protected]Author Affiliations
Publication: Construction Research Congress 2018
Abstract
This paper presents a new method for detailed activity analysis of dynamic construction resources in highly varying videos obtained from construction site cameras. Toward this goal, we propose a Hidden Markov Model (HMM) that is able to automatically discover and assign sequences of activities that are most discriminative for an observed construction operation. To do so, the algorithm leverages dense trajectory features from a detected dynamic resource (e.g., excavator) in a video. Using these dense trajectory features, we train a Gaussian mixture model (GMM) to estimate the probability density function of each activity with multiple one-versus-all support vector machine classifiers. The proposed HMM also models duration of each activity, and the transition between activities (e.g., “swing bucket loaded” after “load bucket” for earth-moving activities of an excavator). As a proof-of-concept, we train and test our HMM+GMM model on an unprecedented dataset of 10 real-world long video sequences of interacting pairs of excavators and dumptrucks. Our preliminary experimental results on long-sequence activity recognition in presence of noise, occlusions, and scene clutter demonstrate the effectiveness of our method.
Get full access to this article
View all available purchase options and get full access to this chapter.
Information & Authors
Information
Published In
Copyright
© 2018 American Society of Civil Engineers.
History
Published online: Mar 29, 2018
Permissions
Request permissions for this article.
Authors
Affiliations
Graduate Student, Dept. of Civil and Environmental Engineering, Univ. of Illinois at Urbana-Champaign, 205 N Mathews Ave., Urbana, IL 61801. E-mail: [email protected]
Associate Professor and Faculty Entrepreneurial Fellow, Dept. of Civil and Environmental Engineering and Computer Science, Univ. of Illinois at Urbana-Champaign, 205 N Mathews Ave., Urbana, IL 61801. E-mail: [email protected]
Assistant Professor, Dept. of Electrical and Electronic Engineering, Universidad del Norte, Barranquilla, Atlantico, Colombia. E-mail: [email protected]
Graduate Student, Dept. of Computer Science, Stanford Univ., 353 Serra Mall, Stanford, CA 94305. E-mail: [email protected]
Graduate Student, Dept. of Civil and Environmental Engineering, Univ. of Illinois at Urbana-Champaign, 205 N Mathews Ave., Urbana, IL 61801. E-mail: [email protected]
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
View Options
Get Access
Access content
Please select your options to get access
Log in/Register
Log in via your institution (Shibboleth)
ASCE Members:
Please log in to see member pricing
Purchase
Save for later Item saved, go to cart Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.
Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
Get Access
Access content
Please select your options to get access
Log in/Register
Log in via your institution (Shibboleth)
ASCE Members:
Please log in to see member pricing
Purchase
Save for later Item saved, go to cart Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.
Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.