Chapter
Nov 9, 2020
Construction Research Congress 2020

Enhancing Deep Neural Network-Based Trajectory Prediction: Fine-Tuning and Inherent Movement-Driven Post-Processing

Publication: Construction Research Congress 2020: Safety, Workforce, and Education

ABSTRACT

As a proactive means of preventing struck-by accidents in construction, many studies have presented proximity monitoring applications using wireless sensors (e.g., RFID, UWB, and GPS) or computer vision methods. Most prior research has emphasized proximity detection rather than prediction. However, prediction can be more effective and important for contact-driven accident prevention, particularly given that the sooner workers (e.g., equipment operators and workers on foot) are informed of their proximity to each other, the more likely they are to avoid the impending collision. In earlier studies, the authors presented a trajectory prediction method leveraging a deep neural network to examine the feasibility of proximity prediction in real-world applications. In this study, we enhance the existing trajectory prediction accuracy. Specifically, we improve the trajectory prediction model by tuning its pre-trained weight parameters with construction data. Moreover, inherent movement-driven post-processing algorithm is developed to refine the trajectory prediction of a target in accordance with its inherent movement patterns such as the final position, predominant direction, and average velocity. In a test on real-site operations data, the proposed approach demonstrates the improvement in accuracy: for 5.28 seconds’ prediction, it achieves 0.39 meter average displacement error, improved by 51.43% as compared with the previous one (0.84 meters). The improved trajectory prediction method can support to predict potential contact-driven hazards in advance, which can allow for prompt feedback (e.g., visible, acoustic, and vibration alarms) to equipment operators and workers on foot. The proactive intervention can lead the workers to take prompt evasive action, thereby reducing the chance of an impending collision.

Get full access to this article

View all available purchase options and get full access to this chapter.

ACKNOWLEDGMENT

The work presented in this paper was supported financially by a National Science Foundation Award (No. IIS-1734266, ‘Scene Understanding and Predictive Monitoring for Safe Human-Robot Collaboration in Unstructured and Dynamic Construction Environment’). Any opinions, findings, and conclusions or recommendations expressed in this paper are those of the authors and do not necessarily reflect the views of the National Science Foundation. Lastly, the authors wish to especially thank Weston Tanner and John McGlennon from WALSH Construction Co. for their considerate assistance in collecting onsite data.

REFERENCES

Alahi, A., Goel, K., Ramanathan, V., Robicquet, A., Fei-Fei, L., and Savarse, S. (2016). “Social LSTM: Human trajectory prediction in crowded spaces.” The IEEE Conference on Computer Vision and Pattern Recognition (CPVR), 961-971, 2016.
Antonini, G., Bierlarire, M., and Weber, M. (2006). “Discrete choice models of pedestrian walking behavior.” Transportation Research Part B: Methodological, 40(8): 667-687, 2006.
BLS (2019), "Census of fatal occupational injuries-Current and revised data." Bureau of Labor Statistics, 2019, <https://www.bls.gov/iif/oshcfoi1.htm>;
CPWR (2017a), "Struck-by injuries and prevention in the construction industry." The Center for Construction Research and Training, 2017.
CPWR (2017b), "Caught-in/between injuries and prevention in the construction industry." The Center for Construction Research and Training, 2017.
Gupta, A., Johnson, J., Fei-Fei, L., Savarese, S. and Alahi, A. (2018). "Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks." IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
Helbing, D and Molnar, P. (1995). “Social force model for pedestrian dynamics.” Physical Review E, 51(4282), 1995.
Kim, D., Liu, M., Lee, S., and Kamat, V.R. (2019a). "Remote proximity monitoring between mobile construction resources using camera-mounted UAVs." Automation in Construction, 99(2019):168–182, 2019.
Kim, D., Liu, M., Lee, S., and Kamat, V.R. (2019b). "Trajectory prediction of mobile construction resources toward pro-active struck-by hazard detection." 36th International Symposium on Automation and Robotics in Construction, Alberta, Canada, 2019.
Kim, D.H., Yin, K., Liu, M., Lee, S.H., and Kamat, V.R. (2017). "Feasibility of a drone-based on-site proximity detection in an outdoor construction site." IWCCE 2017, Seattle, WA, USA, 2017
Kim, H.J., Kim, K.N., and Kim, H.K. (2016). "Vision-based object-centric safety assessment using fuzzy inference: Monitoring struck-by accidents with moving objects." Journal of Computing in Civil Engineering, 30: 04015075, 2016
Leal-Taix'e, L., Fenzi, M., Kuznetsova, A., Rosenhahn, B., and Savarese, S. (2014). "Learning an image-based motion context for multiple people tracking." IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.
Marks, E. and Teizer, J. (2012). "Proximity sensing and warning technology for heavy construction equipment operation." Construction Research Congress 2012, West Lafayette, IN, USA, 2012
Park, J.W., Marks, E., Cho, Y.K., and Suryanto, W. (2016). "Performance test of wireless technologies for personnel and equipment proximity sensing in work zones." Journal of Construction Engineering and Management, 142(1): 04015049, 2016
Pellegrini, S., Ess, A., and Van Gool, A. (2010). "Improving data association by joint modeling of pedestrian trajectories and groupings." Computer Vision–ECCV2010, 452–465, 2010.
Pfeiffer, M., Paolo, G., Sommer, H., Nieto, J., Siegwart, R., and Cadena, C. (2018). “A data-driven model for interaction-aware pedesrtrain motion prediction in object cluttered environments.” The IEEE Conference on Robotics and Automation (ICRA), 21-25, 2018.
Ruff, T.M. (2001). "Monitoring blind spots: A major concern for haul trucks." Engineering and Mining Journal, 202(12):17-26, 2001.
Tay, M.K.C. and Laugier, C. (2008). “Modeling smooth paths using Gaussian processes.” Field and Service Robotics, 381-390, 2008.
Teizer, J. (2015). "Wearable, wireless identification sensing platform: Self-monitoring alert and reporting technology for hazard avoidance and training (smarthat)." Electronic Journal of Information Technology in Construction, 20: 295-312, 2015
Teizer, J., Allread, B.S., Fullerton, C.E., Hinze, J. (2010). "Autonomous pro-active real-time construction worker and equipment operator proximity safety and alert system." Automation in Construction, 19(2010):630-640, 2010.
Trautman, P., Ma, J., Murray, R.M., Krause, A. (2015). “Robot navigation in dense human crowds: Statistical models and experimental studies of human-robot cooporation.” The International Journal of Robotics Research, 34(3):335-356, 2015.
Xu, Y., Piao, Z., and Gao, S. (2018). “Encoding crowd interaction with deep neural network for pedestrian trajectory prediction.” The IEEE Conference on Computer Vision and Pattern recognition (CPVR), 5275-5284, 2018.
Yamaguchi, K., Berg, A.C., Ortiz, L.E., and Berg, T.L. (2011). “Who are you with and where are you going?” The IEEE Computer Vision and Pattern Recognition (CPVR), 3488-3496, 2015.

Information & Authors

Information

Published In

Go to Construction Research Congress 2020
Construction Research Congress 2020: Safety, Workforce, and Education
Pages: 67 - 75
Editors: Mounir El Asmar, Ph.D., Arizona State University, David Grau, Ph.D., Arizona State University, and Pingbo Tang, Ph.D., Arizona State University
ISBN (Online): 978-0-7844-8287-2

History

Published online: Nov 9, 2020
Published in print: Nov 9, 2020

Permissions

Request permissions for this article.

Authors

Affiliations

Ph.D. Candidate, Dept. of Civil and Environmental Engineering, Univ. of Michigan, Ann Arbor, MI. E-mail: [email protected]
Houtan Jebelli [email protected]
Assistant Professor, Dept. of Architectural Engineering, Pennsylvania State Univ., PA. E-mail: [email protected]
SangHyun Lee [email protected]
Professor, Dept. of Civil and Environmental Engineering, Univ. of Michigan, Ann Arbor, MI. E-mail: [email protected]
Vineet R. Kamat [email protected]
Professor, Dept. of Civil and Environmental Engineering, Univ. of Michigan, Ann Arbor, MI. E-mail: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Paper
$35.00
Add to cart
Buy E-book
$180.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Paper
$35.00
Add to cart
Buy E-book
$180.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share