Technical Papers
Nov 20, 2023

Prediction of Truck-Involved Crash Severity on a Rural Mountainous Freeway Using Transfer Learning with ResNet-50 Deep Neural Network

Publication: Journal of Transportation Engineering, Part A: Systems
Volume 150, Issue 2

Abstract

Crashes involving heavy trucks on rural mountainous freeways are known to result in severe injuries and fatalities, particularly under challenging driving conditions. This study aims to develop a robust model to accurately predict fatal and injury crashes involving heavy trucks on rural mountainous freeways. The crash database of Interstate-80 in Wyoming was used to extract a wide range of variables related to environmental, roadway, crash, occupant, and vehicle characteristics. This study employed a state-of-the-art deep neural network architecture named ResNet-50 using transfer learning to develop crash severity prediction models. The numeric crash data were converted to images utilizing DeepInsight to facilitate the application of the proposed deep learning model. Due to the imbalanced nature of the crash severity data, this study employed random undersampling (RUS) and synthetic minority oversampling technique (SMOTE) data balancing techniques and investigated several data sampling ratios. A ratio of 122 (Fatal: Injury: PDO) combined with both RUS and SMOTE produced the best performance with recall values of 99.7%, 79.7%, and 79.3% for fatal, injury, and PDO crashes, respectively. This study also employed Boruta and extreme gradient boosting (XGBoost) to examine the significance of variables on crash severity. The findings revealed that the deployment of airbags, use of seatbelts, driver distraction, and driver conditions such as inattentiveness and fatigue, vehicle type, vertical grades, weather, and road surface conditions were the most critical variables contributing to the severity of crashes involving heavy trucks. Furthermore, this study developed several reduced truck-involved crash severity prediction models without significantly compromising the prediction performance. The proposed deep neural network model can provide accurate and timely prediction of fatal and injury crashes involving heavy trucks, which is beneficial for ensuring efficient collision management, avoiding secondary pile-up crashes, and facilitating prompt medical assistance.

Practical Applications

The proposed method offers a potential solution to predict crash severity, particularly for fatal and injury crashes, in challenging mountainous regions. This is crucial for effective collision management, prevention of secondary crashes, and timely medical assistance. Key contributing factors to crash severity, such as steep grades, sharp turns, driver distraction, fatigue, weather conditions, and road surface conditions, were identified. This information can guide safety practitioners, emergency services, traffic management centers, and manufacturers in improving their countermeasures and safety applications to provide accurate warnings to road users. For example, connected and automated vehicles can use this information to warn drivers about difficult roads with lots of trucks or upcoming bad weather on mountainous roads. Smart cameras inside the car can also be used to detect if the driver is distracted, not paying attention, or tired and can give them physical or sound alerts to help prevent serious accidents. The proposed method can be applied in various safety-related scenarios using numerical or vision-based data to gain a deeper understanding of driver behavior and its association with safety events, ultimately improving road safety for everyone.

Get full access to this article

View all available purchase options and get full access to this article.

Data Availability Statement

Some or all data used during the study were provided by a third party. Direct requests for these materials may be made to the provider as indicated in the Acknowledgments.

Acknowledgments

The authors would like to acknowledge the Wyoming Department of Transportation and Federal Highway Administration for funding, supporting, and providing necessary resources for this study. Grant Number: RS05220.

References

Abdelwahab, H. T., and M. A. Abdel-Aty. 2001. “Development of artificial neural network models to predict driver injury severity in traffic accidents at signalized intersections.” Transp. Res. Rec. 1746 (1): 6–13. https://doi.org/10.3141/1746-02.
Ahmadpour, H., O. Bazrafshan, E. Rafiei-Sardooi, H. Zamani, and T. Panagopoulos. 2021. “Gully erosion susceptibility assessment in the Kondoran watershed using machine learning algorithms and the Boruta feature selection.” Sustainability 13 (18): 1–23. https://doi.org/10.3390/su131810110.
Ahmed, M. M., R. Franke, K. Ksaibati, and D. S. Shinstine. 2018. “Effects of truck traffic on crash injury severity on rural highways in Wyoming using Bayesian binary logit models.” Accid. Anal. Prev. 117 (Mar): 106–113. https://doi.org/10.1016/j.aap.2018.04.011.
Ahmed, M. M., S. Gaweesh, M. J. Hossain, S. Sharmin, and T. Peel. 2017. Calibrating crash modification factors for Wyoming-specific conditions: Application of the highway safety manual - Part D. Cheyenne, WY: Wyoming DOT.
Alkheder, S., M. Taamneh, and S. Taamneh. 2017. “Severity prediction of traffic accident using an artificial neural network.” J. Forecasting 36 (1): 100–108. https://doi.org/10.1002/for.2425.
CDC (Centers for Disease Control and Prevention). 2011. Policy impact: Seat belts. Atlanta: National Center for Injury Prevention and Control.
Chawla, N. V. 2009. “Data mining for imbalanced datasets: An overview.” In Data mining and knowledge discovery handbook, edited by O. Maimon and L. Rokach, 875–886. Boston: Springer.
Chawla, N. V., K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer. 2002. “SMOTE: Synthetic minority over-sampling technique.” J. Artif. Intell. Res. 16 (Jun): 321–357. https://doi.org/10.1613/jair.953.
Chen, C., G. Zhang, Z. Qian, R. A. Tarefder, and Z. Tian. 2016. “Investigating driver injury severity patterns in rollover crashes using support vector machine models.” Accid. Anal. Prev. 90 (May): 128–139. https://doi.org/10.1016/j.aap.2016.02.011.
Chicco, D. 2017. “Ten quick tips for machine learning in computational biology.” BioData Min. 10 (1): 1–17. https://doi.org/10.1186/s13040-017-0155-3.
Chu, Y., X. Yue, L. Yu, M. Sergei, and Z. Wang. 2020. “Automatic image captioning based on ResNet50 and LSTM with soft attention.” Wireless Commun. Mobile Comput. 2020 (Oct): 1–7. https://doi.org/10.1155/2020/8909458.
Das, A., M. N. Khan, and M. M. Ahmed. 2022. “A deep learning approach for detecting lane change maneuvers using SHRP2 naturalistic driving data.” Transp. Res. Rec. 2677 (1): 907–928. https://doi.org/10.1177/03611981221103229.
Das, S., A. Dutta, K. Dixon, L. Minjares-Kyle, and G. Gillette. 2018. “Using deep learning in severity analysis of at-fault motorcycle rider crashes.” Transp. Res. Rec. 2672 (34): 122–134. https://doi.org/10.1177/0361198118797212.
FHWA (Federal Highway Administration). 2023. “How do weather events impact roads?—FHWA road weather management.” Accessed August 6, 2023. https://ops.fhwa.dot.gov/weather/q1_roadimpact.htm.
Friedman, J., T. Hastie, and R. Tibshirani. 2008. The elements of statistical learning. New York: Springer.
Ganganwar, V. 2012. “An overview of classification algorithms for imbalanced datasets.” Int. J. Emerging Technol. Adv. Eng. 2 (4): 42.
Haleem, K., and M. Abdel-Aty. 2010. “Examining traffic crash injury severity at unsignalized intersections.” J. Saf. Res. 41 (4): 347–357. https://doi.org/10.1016/j.jsr.2010.04.006.
Haq, M. T., M. Zlatkovic, and K. Ksaibati. 2020. “Investigating occupant injury severity of truck-involved crashes based on vehicle types on a mountainous freeway: A hierarchical Bayesian random intercept approach.” Accid. Anal. Prev. 144 (Jun): 105654. https://doi.org/10.1016/j.aap.2020.105654.
He, K., X. Zhang, S. Ren, and J. Sun. 2016. “Deep residual learning for image recognition.” In Proc., IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, 770–778. New York: IEEE Computer Society. https://doi.org/10.1109/CVPR.2016.90.
Hossain, M. J. 2017. Development of crash modification factors for shoulder rumple strips and passing lanes on rural two-way two-lane highways. Laramie, WY: Univ. of Wyoming.
Hossain, M. J., J. N. Ivan, S. Zhao, K. Wang, S. Sharmin, N. Ravishanker, and E. Jackson. 2023. “Considering demographics of other involved drivers in predicting the highest driver injury severity in multi-vehicle crashes on rural two-lane roads in California.” J. Transp. Saf. Secur. 15 (1): 43–58. https://doi.org/10.1080/19439962.2022.2033899.
Huynh, B. Q., H. Li, and M. L. Giger. 2016. “Digital mammographic tumor classification using transfer learning from deep convolutional neural networks.” J. Med. Imaging 3 (3): 1–5. https://doi.org/10.1117/1.jmi.3.3.034501.
Jiang, L., Y. Xie, X. Wen, and T. Ren. 2020. “Modeling highly imbalanced crash severity data by ensemble methods and global sensitivity analysis.” J. Transp. Saf. Secur. 14 (4): 562–584. https://doi.org/10.1080/19439962.2020.1796863.
Khan, M. N., and M. M. Ahmed. 2020. “Trajectory-level fog detection based on in-vehicle video camera with TensorFlow deep learning utilizing SHRP2 naturalistic driving data.” Accid. Anal. Prev. 142 (Jul): 105521. https://doi.org/10.1016/j.aap.2020.105521.
Khan, M. N., and M. M. Ahmed. 2021. “Weather and surface condition detection based on road-side webcams: Application of pre-trained convolutional neural network.” Int. J. Transp. Sci. Technol. 11 (3): 468–483. https://doi.org/10.1016/j.ijtst.2021.06.003.
Khan, M. N., and M. M. Ahmed. 2022. “A novel deep learning approach to predict crash severity in adverse weather on rural mountainous freeway.” J. Transp. Saf. Secur. 15 (8): 795–825. https://doi.org/10.1080/19439962.2022.2129891.
Kiremire, A. R. 2011. “The application of the Pareto principle in software engineering.” Consult January 13 (Jan): 2016.
Kunt, M. M., I. Aghayan, and N. Noii. 2011. “Prediction for traffic accident severity: Comparing the artificial neural network, genetic algorithm, combined genetic algorithm and pattern search methods.” Transport 26 (4): 353–366. https://doi.org/10.3846/16484142.2011.635465.
Li, T., M. Alipour, B. M. Donaldson, and D. K. Harris. 2021. “Deep learning-based visual identification of signs of bat presence in bridge infrastructure images: A transfer learning approach.” Transp. Res. Rec. 2675 (12): 939–951. https://doi.org/10.1177/03611981211031904.
Liu, P., and W. Fan. 2022. “Analyzing injury severity of rear-end crashes involving large trucks using a mixed logit model: A case study in North Carolina.” J. Transp. Saf. Secur. 14 (5): 723–736. https://doi.org/10.1080/19439962.2020.1812784.
Mitchell, R. J., M. R. Bambach, and B. Toson. 2015. “Injury risk for matched front and rear seat car passengers by injury severity and crash type: An exploratory study.” Accid. Anal. Prev. 82 (Sep): 171–179. https://doi.org/10.1016/j.aap.2015.05.023.
Mondal, A. R., M. A. E. Bhuiyan, and F. Yang. 2020. “Advancement of weather-related crash prediction model using nonparametric machine learning algorithms.” SN Appl. Sci. 2 (8): 1–11. https://doi.org/10.1007/S42452-020-03196-X.
Morgan, A., and F. L. Mannering. 2011. “The effects of road-surface conditions, age, and gender on driver-injury severities.” Accid. Anal. Prev. 43 (5): 1852–1863. https://doi.org/10.1016/j.aap.2011.04.024.
Mukti, I. Z., and D. Biswas. 2019. “Transfer learning based plant diseases detection using ResNet50.” In Proc., 4th Int. Conf. on Electrical Information and Communication Technology (EICT), 20–22. New York: IEEE. https://doi.org/10.1109/EICT48899.2019.9068805.
Mussone, L., M. Bassani, and P. Masci. 2017. “Analysis of factors affecting the severity of crashes in urban road intersections.” Accid. Anal. Prev. 103 (Jun): 112–122. https://doi.org/10.1016/j.aap.2017.04.007.
National Center for Statistics and Analysis. 2021. Traffic safety facts 2019: A compilation of motor vehicle crash data. DOT HS 813 141. Washington, DC: National Highway Traffic Safety Administration.
Peng, Y., and L. N. Boyle. 2012. “Commercial driver factors in run-off-road crashes.” Transp. Res. Rec. 2281 (1): 128–132. https://doi.org/10.3141/2281-16.
Pu, Z., Z. Li, R. Ke, X. Hua, and Y. Wang. 2020. “Evaluating the nonlinear correlation between vertical curve features and crash frequency on highways using random forests.” J. Transp. Eng. Part A: Syst. 146 (10): 04020115. https://doi.org/10.1061/JTEPBS.0000410.
Qi, Y., R. Srinivasan, H. Teng, and R. Baker. 2013. “Analysis of the frequency and severity of rear-end crashes in work zones.” Traffic Inj. Prev. 14 (1): 61–72. https://doi.org/10.1080/15389588.2012.675109.
Rahim, M. A., and H. M. Hassan. 2021. “A deep learning based traffic crash severity prediction framework.” Accid. Anal. Prev. 154 (Sep): 106090. https://doi.org/10.1016/j.aap.2021.106090.
Rakotonirainy, A., S. Chen, B. Scott-Parker, S. W. Loke, and S. Krishnaswamy. 2015. “A novel approach to assessing road-curve crash severity.” J. Transp. Saf. Secur. 7 (4): 358–375. https://doi.org/10.1080/19439962.2014.959585.
Russakovsky, O., J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei. 2015. “ImageNet large scale visual recognition challenge.” Int. J. Comput. Vis. 115 (3): 211–252. https://doi.org/10.1007/s11263-015-0816-y.
Sameen, M. I., and B. Pradhan. 2017. “Severity prediction of traffic accidents with recurrent neural networks.” Appl. Sci. 7 (6): 476. https://doi.org/10.3390/app7060476.
Savolainen, P. T., F. L. Mannering, D. Lord, and M. A. Quddus. 2011. “The statistical analysis of highway crash-injury severities: A review and assessment of methodological alternatives.” Accid. Anal. Prev. 43 (5): 1666–1676. https://doi.org/10.1016/j.aap.2011.03.025.
Shabbir, A., N. Ali, J. Ahmed, B. Zafar, A. Rasheed, M. Sajid, A. Ahmed, and S. H. Dar. 2021. “Satellite and scene image classification based on transfer learning and fine tuning of ResNet50.” Math. Probl. Eng. 2021 (Jul): 1–8. https://doi.org/10.1155/2021/5843816.
Sharma, A., E. Vans, D. Shigemizu, K. A. Boroevich, and T. Tsunoda. 2019. “DeepInsight: A methodology to transform a non-image data to an image for convolution neural network architecture.” Sci. Rep. 9 (1): 1–7. https://doi.org/10.1038/s41598-019-47765-6.
Sharmin, S., J. N. Ivan, K. L. Marsh, A. Paxton, and A. Tucker. 2022. “Driver psychology latent classes as predictors of traffic incident occurrence in naturalistic driving study data.” Transp. Res. Rec. 2677 (2): 839–857. https://doi.org/10.1177/03611981221108985.
Sharmin, S., J. N. Ivan, S. Zhao, K. Wang, J. Hossain, N. Ravishanker, and E. Jackson. 2020. “Incorporating demographic proportions into crash count models by quasi-induced exposure method.” Transp. Res. Rec. 2674 (9): 548–560. https://doi.org/10.1177/0361198120930230.
Soleimani, S., S. R. Mousa, J. Codjoe, and M. Leitner. 2019. “A comprehensive railroad-highway grade crossing consolidation model: A machine learning approach.” Accid. Anal. Prev. 128 (Apr): 65–77. https://doi.org/10.1016/j.aap.2019.04.002.
USDOT. 2017. MMUCC guideline: Model minimum uniform crash criteria. 5th ed. Washington, DC: National Highway Traffic Safety Administration.
USDOT. 2021. “Freight analysis framework.” Accessed December 28, 2021. https://www.bts.gov/faf.
van der Maaten, L., and G. Hinton. 2008. “Visualizing data using t-SNE.” J. Mach. Learn. Res. 9 (11): 2579–2605. https://doi.org/10.1007/s10479-011-0841-3.
Weber, A., and D. C. Murray. 2014. Evaluating the impact of commercial motor vehicle enforcement disparities on carrier safety performance. Arlington, VA: American Transportation Research Institute.
Wen, X., Y. Xie, L. Jiang, Z. Pu, and T. Ge. 2021a. “Applications of machine learning methods in traffic crash severity modelling: Current status and future directions.” Transp. Rev. 41 (6): 855–879. https://doi.org/10.1080/01441647.2021.1954108.
Wen, X., Y. Xie, L. Wu, and L. Jiang. 2021b. “Quantifying and comparing the effects of key risk factors on various types of roadway segment crashes with LightGBM and SHAP.” Accid. Anal. Prev. 159 (Sep): 106261. https://doi.org/10.1016/j.aap.2021.106261.
WYDOT (Wyoming Department of Transportation). 2020. 2020 vehicle miles book. Cheyenne, WY: WYDOT.
Xie, Y., Y. Zhang, and F. Liang. 2009. “Crash injury severity analysis using Bayesian ordered probit models.” J. Transp. Eng. 135 (1): 18–25. https://doi.org/10.1061/(ASCE)0733-947X(2009)135:1(18).
Yan, X., J. He, C. Zhang, Z. Liu, B. Qiao, and H. Zhang. 2021. “Single-vehicle crash severity outcome prediction and determinant extraction using tree-based and other non-parametric models.” Accid. Anal. Prev. 153 (Apr): 106034. https://doi.org/10.1016/J.AAP.2021.106034.
Yu, R., and M. Abdel-Aty. 2014. “Analyzing crash injury severity for a mountainous freeway incorporating real-time traffic and weather data.” Saf. Sci. 63 (Mar): 50–56. https://doi.org/10.1016/j.ssci.2013.10.012.
Zeng, Q., and H. Huang. 2014. “A stable and optimized neural network model for crash injury severity prediction.” Accid. Anal. Prev. 73 (Dec): 351–358. https://doi.org/10.1016/j.aap.2014.09.006.
Zhai, G., H. Yang, and J. Liu. 2020. “Is the front passenger seat always the ‘death seat’? An application of a hierarchical ordered probit model for occupant injury severity.” Int. J. Inj. Control Saf. Promot. 27 (4): 438–446. https://doi.org/10.1080/17457300.2020.1810072.
Zhang, J., Z. Li, Z. Pu, and C. Xu. 2018. “Comparing prediction performance for crash injury severity among various machine learning and statistical methods.” IEEE Access 6 (Oct): 60079–60087. https://doi.org/10.1109/ACCESS.2018.2874979.
Zheng, M., T. Li, R. Zhu, J. Chen, Z. Ma, M. Tang, Z. Cui, and Z. Wang. 2019. “Traffic accident’s severity prediction: A deep-learning approach-based CNN network.” IEEE Access 7 (Mar): 39897–39910. https://doi.org/10.1109/ACCESS.2019.2903319.

Information & Authors

Information

Published In

Go to Journal of Transportation Engineering, Part A: Systems
Journal of Transportation Engineering, Part A: Systems
Volume 150Issue 2February 2024

History

Received: Jan 4, 2022
Accepted: Aug 4, 2023
Published online: Nov 20, 2023
Published in print: Feb 1, 2024
Discussion open until: Apr 20, 2024

Permissions

Request permissions for this article.

Authors

Affiliations

Postdoctoral Scholar, Civil Engineering Program Ingram School of Engineering, Texas State Univ., RFM 5224, 601 University Dr., San Marcos, TX 78666. ORCID: https://orcid.org/0000-0001-5996-091X. Email: [email protected]
Postdoctoral Research Associate, Research and Implementation Program, Texas A&M Transportation Institute, 1111 RELLIS Pkwy., Room 3448, Bryan, TX 77807-3135 (corresponding author). ORCID: https://orcid.org/0000-0003-4674-5334. Email: [email protected]
Professor and Director, Dept. of Civil and Architectural Engineering and Construction Management, Transportation Center Baldwin Hall, CEAS - Civil Eng–0071, Univ. of Cincinnati, 2850 Campus Way, Cincinnati, OH 45221-0071. ORCID: https://orcid.org/0000-0002-1921-0724. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share