Raster-Based Point Cloud Mapping of Defective Road Marking: Toward Automated Road Inspection via Airborne LiDAR
Publication: Journal of Transportation Engineering, Part B: Pavements
Volume 150, Issue 2
Abstract
The integrity of road markings has a significant impact on driving safety, especially in the emerging automated driving scenario. Road markings are susceptible to wearing damage; it is therefore important for road agencies to examine and maintain markings periodically. This study presents a novel method for detection of road marking defect via an unmanned aerial vehicle (UAV)–laser radar (LiDAR) platform. The key idea is to evaluate the damage rate of road markings by point reflectivity. The method consists of three major steps: point cloud registration, marking segmentation, and defective marking detection. A high-intensity prioritized raster method is proposed to extract whole marking regions within defect area, and the damage rate of markings is defined to evaluate damage severity. Field test results show that the precision and recall of marking extraction are over 90%, and the precision of marking defect detection is over 93%. The failed detections were attributed to subjectivity of ground truth and neglect of small defects.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
All data, models, or code that support the findings of this study are available from the corresponding author upon reasonable request.
Acknowledgments
This work was supported in part by the National Key R&D Project of China (Grant No. 2021YFB2600603), National Natural Science Foundation of China (Grant No. 52208428).
References
Babi, D., M. Fioli, D. Babi, and T. Gates. 2020. “Road markings and their impact on driver behavior and road safety: A systematic review of current findings.” J. Adv. Transp. 2020 (Aug): 1–19. https://doi.org/10.1155/2020/7843743.
Badrinarayanan, V., A. Kendall, and R. Cipolla. 2017. “SegNet: A deep convolutional encoder-decoder architecture for image segmentation.” IEEE Trans. Pattern Anal. Mach. Intell. 39 (12): 2481–2495. https://doi.org/10.1109/TPAMI.2016.2644615.
Boyko, A., and T. Funkhouser. 2011. “Extracting roads from dense point clouds in large scale urban environment.” ISPRS J. Photogramm. Remote Sens. 66 (6): 2–12. https://doi.org/10.1016/j.isprsjprs.2011.09.009.
Bu, T., J. Zhu, and T. Ma. 2022. “A UAV photography-based detection method for defective road marking.” J. Perform. Constr. Facil. 36 (5): 04022035. https://doi.org/10.1061/(ASCE)CF.1943-5509.0001748.
Cui, Y., J. Wu, H. Xu, and A. Wang. 2020. “Lane change identification and prediction with roadside LiDAR data.” Opt. Laser Technol. 123 (Mar): 105934. https://doi.org/10.1016/j.optlastec.2019.105934.
Deo, C., K. Emmanuel, and O. Mbakisya. 2018. “Evaluating the service life of thermoplastic pavement markings: Stochastic approach.” J. Transp. Eng. Part B Pavements 144 (3): 04018029. https://doi.org/10.1061/JPEODX.0000055.
Geiger, A., P. Lenz, C. Stiller, and R. Urtasun. 2013. “Vision meets robotics: The KITTI dataset.” Int. J. Rob. Res. 32 (11): 1231–1237. https://doi.org/10.1177/0278364913491297.
Guan, H., J. Li, Y. Yu, M. Chapman, and C. Wang. 2015. “Automated road information extraction from mobile laser scanning data.” IEEE Trans. Intell. Transp. Syst. 16 (1): 194–205. https://doi.org/10.1109/TITS.2014.2328589.
Guan, H., J. Li, Y. Yu, W. Cheng, M. Chapman, and B. Yang. 2014. “Using mobile laser scanning data for automated extraction of road markings.” ISPRS J. Photogramm. Remote Sens. 87 (Jan): 93–107. https://doi.org/10.1016/j.isprsjprs.2013.11.005.
Han, C., T. Ma, L. Gu, J. Cao, X. Shi, W. Huang, and Z. Tong. 2022. “Asphalt pavement health prediction based on improved transformer network.” IEEE Trans. Intell. Transp. Syst. 24 (4): 4482–4493. https://doi.org/10.1109/TITS.2022.3229326.
Hata, A., and D. Wolf. 2014. “Road marking detection using LiDAR reflective intensity data and its application to vehicle localization.” In Proc., 17th Int. Conf. on Intelligent Transportation Systems. New York: IEEE.
Jung, J., and S. Bae. 2018. “Real-time road lane detection in urban areas using LiDAR data.” Electronics 7 (11): 276. https://doi.org/10.3390/electronics7110276.
Jung, J., E. Che, M. J. Olsen, and C. Parrish. 2019. “Efficient and robust lane marking extraction from mobile LiDAR point clouds.” ISPRS J. Photogramm. Remote Sens. 147 (Jan): 1–18. https://doi.org/10.1016/j.isprsjprs.2018.11.012.
Kammel, S., and B. Pitzer. 2008. “LiDAR-based lane marker detection and mapping.” In Proc., IEEE Intelligent Vehicles Symp., 1137–1142. New York: IEEE. https://doi.org/10.1109/IVS.2008.4621318.
Kang, Y., C. Roh, S. Suh, and B. Song. 2012. “A LiDAR -based decision-making method for road boundary detection using multiple Kalman filters.” IEEE Trans. Ind. Electron. 59 (11): 4360–4368. https://doi.org/10.1109/TIE.2012.2185013.
Kim, J., J. Kim, G. J. Jang, and M. Lee. 2016. “Fast learning method for convolutional neural networks using extreme learning machine and its application to lane detection.” Neural Networks: Off. J. Int. Neural Network Soc. 87 (Mar): 109–121. https://doi.org/10.1016/j.neunet.2016.12.002.
Ma, L., Y. Li, J. Li, C. Wang, R. Wang, and M. Chapman. 2018. “Mobile laser scanned point-clouds for road object detection and extraction: A review.” Remote Sens. 10 (10): 1531. https://doi.org/10.3390/rs10101531.
Mastin, A., J. Kepner, and J. Fisher. 2009. “Automatic registration of LiDAR and optical images of urban scenes.” In Proc., IEEE Conf. on Computer Vision Pattern Recognition. New York: IEEE.
Rastiveis, H., A. Shams, W. A. Sarasua, and J. Li. 2019. “Automated extraction of lane markings from mobile LiDAR point clouds based on fuzzy inference.” ISPRS J. Photogramm. Remote Sens. 160 (Aug): 149–166. https://doi.org/10.1016/j.isprsjprs.2019.12.009.
Rusinkiewicz, S., and M. Levoy. 2001. “Efficient variants of the ICP algorithm.” In Proc., 3rd Int. Conf. on 3D Digital Imaging and Modeling, 145–152. New York: IEEE. https://doi.org/10.1109/IM.2001.924423.
Soilán, M., B. Riveiro, J. Martínez-Sánchez, and P. Arias. 2017. “Segmentation and classification of road markings using MLS data.” ISPRS J. Photogramm. Remote Sens. 123 (Jan): 94–103. https://doi.org/10.1016/j.isprsjprs.2016.11.011.
Thuy, M., and F. León. 2010. “Lane detection and tracking based on LiDAR data.” In Metrology and measurement systems. Warszawa, Poland: Polska Akad Nauk.
Wang, H., H. Luo, C. Wen, J. Cheng, P. Li, Y. Chen, C. Wang, and J. Li. 2015a. “Road boundaries detection based on local normal saliency from mobile laser scanning data.” IEEE Geosci. Remote Sens. Lett. 12 (24): 2085–2089. https://doi.org/10.1109/LGRS.2015.2449074.
Wang, J., J. Song, M. Chen, and Z. Yang. 2015b. “Road network extraction: A neural-dynamic framework based on deep learning and a finite state machine.” Int. J. Remote Sens. 36 (12): 3134–3159. https://doi.org/10.1080/01431161.2015.1054049.
Wen, C., X. Sun, J. Li, W. Cheng, Y. Guo, and A. Habib. 2019. “A deep learning framework for road marking extraction, classification and completion from mobile laser scanning point clouds.” ISPRS J. Photogramm. Remote Sens. 147 (Jan): 178–192. https://doi.org/10.1016/j.isprsjprs.2018.10.007.
Yan, L., H. Liu, J. Tan, Z. Li, H. Xie, and C. Chen. 2016. “Scan line-based road marking extraction from mobile LiDAR point clouds.” Sensors 16 (6): 903. https://doi.org/10.3390/s16060903.
Yang, B., and C. Chen. 2015. “Automatic registration of UAV-borne sequent images and LiDAR data.” ISPRS J. Photogramm. Remote Sens. 101 (Mar): 262–274. https://doi.org/10.1016/j.isprsjprs.2014.12.025.
Zhang, H., J. Li, M. Cheng, and C. Wang. 2016. “Rapid inspection of pavement markings using mobile LiDAR point clouds.” ISPRS Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci. 2016 (1): 717–723. https://doi.org/10.5194/isprs-archives-XLI-B1-717-2016.
Zhu, J., J. Zhong, T. Ma, X. Huang, W. Zhang, and Y. Zhou. 2022. “Pavement distress detection using convolutional neural networks with images captured via UAV.” Autom. Constr. 133 (Jan): 103991. https://doi.org/10.1016/j.autcon.2021.103991.
Information & Authors
Information
Published In
Journal of Transportation Engineering, Part B: Pavements
Volume 150 • Issue 2 • June 2024
Copyright
© 2024 American Society of Civil Engineers.
History
Received: Mar 12, 2023
Accepted: Dec 26, 2023
Published online: Mar 25, 2024
Published in print: Jun 1, 2024
Discussion open until: Aug 25, 2024
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.