Technical Papers
Dec 26, 2023

A GAN-Augmented CNN Approach for Automated Roadside Safety Assessment of Rural Roadways

Publication: Journal of Computing in Civil Engineering
Volume 38, Issue 2

Abstract

The prevalence of run-off-road crashes, particularly in rural areas, underscores the significance of roadside characteristics in safety analysis. This paper proposes a novel approach for automated roadside safety assessment using deep convolutional neural networks (CNNs) and Generative Adversarial Networks (GANs) for data augmentation. The CNN models evaluate roadside features through two-dimensional (2D) image analysis, whereas GANs expand the data set by generating additional diverse samples. The proposed framework aligns with the standard rating system of the Federal Highway Administration (FHWA) and encompasses four distinct models for guardrail detection, clear zone width assessment, rigid obstacle detection, and sideslope estimation. The performance of each model is compared against non-GAN augmented models to assess the efficacy of using GANs for data augmentation. The results show that the proposed approach outperforms existing methods in terms of accuracy, which is measured with 96% in detecting guardrails, 88% in detecting clear zones, 80% in detecting rigid obstacles, and 84% in detecting roadside slopes. Compared with manual approaches, the proposed method offers advantages such as cost-effectiveness, ease of implementation, and the ability to rapidly rank state roads. The developed framework can assist departments of transportation (DOTs) in efficiently identifying problematic road segments and prioritizing safety improvement projects based on FHWA standard rating system.

Practical Applications

This research focuses on the development of computer vision models for roadside safety assessment. The models successfully detect and classify important features such as guardrails, clear zones, rigid obstacles, and roadside slopes in images. The practical applications of this research are significant for transportation authorities, engineers, and practitioners involved in roadway safety. By utilizing these computer vision models, they can efficiently analyze large amounts of visual data and identify potential safety hazards along roadways. These models can aid in identifying areas with inadequate clear zones, which are crucial for preventing roadside crashes. They can also detect the presence of guardrails, which play a vital role in redirecting vehicles and minimizing the severity of accidents. Moreover, the models provide insights into the presence and distance of rigid obstacles, such as trees, rocks, and mountains, which are essential for assessing the overall safety of roadside environments. Last, the models assess roadside slopes, allowing practitioners to identify areas with steep inclines that may pose a higher risk to motorists. Overall, the practical applications of these computer vision models enable stakeholders to prioritize safety interventions, implement targeted improvements, and enhance roadway safety for both drivers and pedestrians.

Get full access to this article

View all available purchase options and get full access to this article.

Data Availability Statement

All data and models that support the findings of this study are available from the corresponding author upon reasonable request.

Acknowledgments

This research project has been funded by the Utah Department of Transportation (UDOT) (Contract No. UT21.0315) and Mountain-Plains Consortium (MPC) (Contract No. MPC669). The authors gratefully acknowledge the UDOT and MPC’s support and help. Any opinions, findings, conclusions, and recommendations expressed in this paper are those of the authors and do not reflect the views of the funding agencies.

References

Brkić, I., M. Miler, M. Ševrović, and D. Medak. 2022. “Automatic roadside feature detection based on lidar road cross section images.” Sensors 22 (15): 5510. https://doi.org/10.3390/s22155510.
Chen, M., A. Feng, K. McCullough, P. B. Prasad, R. McAlinden, and L. Soibelman. 2020. “3d photogrammetry point cloud segmentation using a model ensembling framework.” J. Comput. Civ. Eng. 34 (6): 04020048. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000929.
Cheng, R., Y. Pan, and T. Wang. 2021. “A design method for the roadside clear zone based on accident simulation analysis.” Math. Probl. Eng. 2021 (Jun): 1–16. https://doi.org/10.1155/2021/2605095.
Dai, F., A. Rashidi, I. Brilakis, and P. Vela. 2012. “Comparison of image-based and time-of-flight-based technologies for three-dimensional reconstruction of infrastructure.” In Proc., Construction Research Congress, 929–940. Reston, VA: ASCE.
Deng, J., W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. 2009. “Imagenet: A large-scale hierarchical image database.” In Proc., IEEE Conf. on Computer Vision and Pattern Recognition, 248–255. New York: IEEE.
Dewangan, D. K., S. P. Sahu, B. Sairam, and A. Agrawal. 2021. “Vldnet: Vision-based lane region detection network for intelligent vehicle system using semantic segmentation.” Computing 103 (12): 2867–2892. https://doi.org/10.1007/s00607-021-00974-2.
FHWA Roadway Departure Safety. 2022. “Roadway departure safety | FHWA.” Accessed February 27, 2023. https://highways.dot.gov/safety/RwD.
Gao, J., Y. Chen, J. M. Junior, C. Wang, and J. Li. 2020. “Rapid extraction of urban road guardrails from mobile lidar point clouds.” IEEE Trans. Intell. Transp. Syst. 23 (2): 1572–1577. https://doi.org/10.1109/TITS.2020.3025067.
Ghannad, P., and Y.-C. Lee. 2022. “Automated modular housing design using a module configuration algorithm and a coupled generative adversarial network (Cogan).” Autom. Constr. 139 (Feb): 104234. https://doi.org/10.1016/j.autcon.2022.104234.
Guo, Y., C. Wang, S. X. Yu, F. McKenna, and K. H. Law. 2022. “Adaln: Avision transformer for multidomain learning and predisaster building information extraction from images.” J. Comput. Civ. Eng. 36 (5): 04022024. https://doi.org/10.1061/(ASCE)CP.1943-5487.0001034.
Harbaš, I., P. Prentašić, and M. Subašić. 2018. “Detection of roadside vegetation using fully convolutional networks.” Image Vision Comput. 74 (Jun): 1–9. https://doi.org/10.1016/j.imavis.2018.03.008.
Hou, Q., C. Ai, and N. Boudreau. 2022. “Network-level guardrail extraction based on 3d local features from mobile lidar sensor.” J. Comput. Civ. Eng. 36 (6): 04022035. https://doi.org/10.1061/(ASCE)CP.1943-5487.0001049.
Hung, S.-K., and J. Q. Gan. 2021. “Small facial image dataset augmentation using conditional GANs based on incomplete edge feature input.” PeerJ Comput. Sci. 7 (Feb): e760. https://doi.org/10.7717/peerj-cs.760.
Ikiriko, S., E. F. E. Steve, and O. Owolabi. 2021. “Analyzing the impact of roadside features on injury severity.” J. Constr. Project Manage. Innovation 11 (1): 1–7. https://doi.org/10.36615/jcpmi.v11i1.552.
Lau, M. M., K. H. Lim, and A. A. Gopalai. 2015. “Malaysia traffic sign recognition with convolutional neural network.” In Proc., IEEE Int. Conf. on Digital Signal Processing (DSP), 1006–1010. New York: IEEE.
Li, S., and X. Zhao. 2023. “High-resolution concrete damage image synthesis using conditional generative adversarial network.” Autom. Constr. 147 (Aug): 104739. https://doi.org/10.1016/j.autcon.2022.104739.
Matsumoto, H., Y. Mori, and H. Masuda. 2021. “Extraction of guardrails from mms data using convolutional neural network.” Int. J. Autom. Technol. 15 (3): 258–267. https://doi.org/10.20965/ijat.2021.p0258.
Mohammadi, P., A. Rashidi, M. Malekzadeh, and S. Tiwari. 2023. “Evaluating various machine learning algorithms for automated inspection of culverts.” Eng. Anal. Boundary Elem. 148 (Feb): 366–375. https://doi.org/10.1016/j.enganabound.2023.01.007.
Rahman, M. M., A. M. Sainju, D. Yan, and Z. Jiang. 2021. “Mapping road safety barriers across street view image sequences: A hybrid object detection and recurrent model.” In Proc., 4th ACM SIGSPATIAL Int. Workshop on AI for Geographic Knowledge Discovery, 47–50. New York: Association for Computing Machinery.
Rashidi, A., and E. Karan. 2018. “Video to brim: Automated 3d as-built documentation of bridges.” J. Perform. Constr. Facil. 32 (3): 04018026. https://doi.org/10.1061/(ASCE)CF.1943-5509.0001163.
Rezapour, M., and K. Ksaibati. 2021. “Convolutional neural network for roadside barriers detection: Transfer learning versus non-transfer learning.” Signals 2 (1): 72–86. https://doi.org/10.3390/signals2010007.
Shaikh, S., S. M. Daudpota, A. S. Imran, and Z. Kastrati. 2021. “Towards improved classification accuracy on highly imbalanced text dataset using deep neural language models.” Appl. Sci. 11 (2): 869. https://doi.org/10.3390/app11020869.
Sherafat, B., A. Rashidi, and S. Asgari. 2022. “Sound-based multiple-equipment activity recognition using convolutional neural networks.” Autom. Constr. 135 (Aug): 104104. https://doi.org/10.1016/j.autcon.2021.104104.
Tanaka, F. H. K. D. S., and C. Aranha. 2019. “Data augmentation using GANs.” Preprint, submitted April 19, 2019. https://arxiv.org/abs/1904.09135.
Tarko, A. P., K. B. Ariyur, M. Romero, V. K. Bandaru, and C. L. Jimenez. 2016. Guaranteed lidar-aided multi-object tracking at road intersections: USDOT region V regional university transportation center final report. West Lafayette, IN: NEXTRANS Center.
Tay, R., S. M. Rifaat, and H. C. Chin. 2008. “A logistic model of the effects of roadway, environmental, vehicle, crash and driver characteristics on hit-and-run crashes.” Accid. Anal. Prev. 40 (4): 1330–1336. https://doi.org/10.1016/j.aap.2008.02.003.
Woldesellasse, H., and S. Tesfamariam. 2022. “Prediction of lateral spreading displacement using conditional generative adversarial network (cGAN).” Soil Dyn. Earthquake Eng. 156 (Aug): 107214. https://doi.org/10.1016/j.soildyn.2022.107214.
Wu, J., H. Xu, Y. Zheng, and Z. Tian. 2018. “A novel method of vehicle-pedestrian near-crash identification with roadside lidar data.” Accid. Anal. Prev. 121 (Feb): 238–249. https://doi.org/10.1016/j.aap.2018.09.001.
Xie, Q., D. Li, Z. Yu, J. Zhou, and J. Wang. 2019. “Detecting trees in street images via deep learning with attention module.” IEEE Trans. Instrum. Meas. 69 (8): 5395–5406. https://doi.org/10.1109/TIM.2019.2958580.
Yi, H., C. Bizon, D. Borland, M. Watson, M. Satusky, R. Rittmuller, R. Radwan, R. Srinivasan, and A. Krishnamurthy. 2021. “Ai tool with active learning for detection of rural roadside safety features.” In Proc., 2021 IEEE Int. Conf. on Big Data (Big Data), 5317–5326. New York: IEEE.
Yue, Y., M. Gouda, and K. El-Basyouny. 2021. “Automatic detection and mapping of highway guardrails from mobile lidar point clouds.” In Proc., IEEE Int. Geoscience and Remote Sensing Symp. IGARSS, 2520–2523. New York: IEEE.
Zeeger, C. V., J. Hummer, D. Reinfurt, L. Herf, and W. Hunter. 1987. Safety effects of cross-section design for two-lane roads. Volume 1. Washington, DC: Federal Highway Administration.
Zegaoui, Y., M. Chaumont, G. Subsol, P. Borianne, and M. Derras. 2019. “Urban object classification with 3d deep-learning.” In Proc., Joint Urban Remote Sensing Event (JURSE), 1–4. New York: IEEE.
Zhong, M., B. Verma, and J. Affirm. 2019. “Point cloud classification for detecting roadside safety attributes and distances.” In Proc., 2019 IEEE Symp. Series on Computational Intelligence (SSCI), 1078–1084. New York: IEEE.

Information & Authors

Information

Published In

Go to Journal of Computing in Civil Engineering
Journal of Computing in Civil Engineering
Volume 38Issue 2March 2024

History

Received: Mar 6, 2023
Accepted: Nov 1, 2023
Published online: Dec 26, 2023
Published in print: Mar 1, 2024
Discussion open until: May 26, 2024

Permissions

Request permissions for this article.

ASCE Technical Topics:

Authors

Affiliations

Ph.D. Student, Dept. of Civil and Environmental Engineering, Univ. of Utah, Salt Lake City, UT 84112 (corresponding author). ORCID: https://orcid.org/0000-0002-7792-4645. Email: [email protected]
Abbas Rashidi, Ph.D., M.ASCE [email protected]
Associate Professor, Dept. of Civil and Environmental Engineering, Univ. of Utah, Salt Lake City, UT 84112. Email: [email protected]
Nikola Marković, Ph.D., M.ASCE [email protected]
Assistant Professor, Dept. of Civil and Environmental Engineering, Univ. of Utah, Salt Lake City, UT 84112. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share