Abstract

Road markings are essential features to convey important information to various roadway users such as pedestrians, bicyclists, and motorists. Although mobile laser scanning (MLS) technology provides dense and spatially accurate data, automated identification of road markings remains a challenge. Although approaches have been developed to detect road markings from point clouds, prior studies have not thoroughly investigated road discretization and road marking clustering, which are essential for effective instance-level identification and management of road markings. To improve road discretization, our approach uses line segmentation to divide the trajectory of MLS data and fit circles to individual segments. By calculating the intersection between the road points and the circle’s center for each trajectory segment, this method ensures no overlap occurs when discretizing roads with sharp turns. To improve road marking clustering, the discretized points are rasterized onto a two-dimensional (2D) image and clustered using connected component labeling. Individual markings are skeletonized to detect junctions and corners, which enables the separation of underclustered road markings. Overclustered road markings are then merged using a rule-based approach optimized with a traffic line manual. The proposed approach was evaluated through extensive experiments using 28 MLS data sets containing 2,340 road marking clusters with complex geometry and wear. Out of these, only 64 instances (2.7%) were falsely clustered, achieving a precision rate of 97.5% and a recall rate of 99.7%.

Practical Applications

Efficient road maintenance and improved road safety rely heavily on the clear visibility of road markings, which guide diverse users, such as pedestrians, cyclists, and drivers. Traditional methods for inspecting these markings are often time-consuming and prone to human error. In this study, we use MLS technology to collect comprehensive and precise data on roadways. We have developed an automated technique that significantly enhances the identification and management of road markings. This method accurately rasterizes and segments roadway lidar data—even in areas with sharp turns—to apply advanced image processing for the recognition of individual markings, including those that are substantially worn or have complex geometries. This simplifies the geometric data in a GIS database such that each line object is more representative of how someone would manually digitize the marking. Tested on numerous data sets, our approach achieved an accuracy rate of over 97% in clustering individual road markings. The developed approach not only streamlines roadway maintenance but also offers potential benefits for intelligent transportation systems. It contributes to safer autonomous vehicle navigation and supports informed decision-making regarding road infrastructure, ultimately improving all road users’ experience.

Get full access to this article

View all available purchase options and get full access to this article.

Data Availability Statement

There is a potential that the code developed during this study may be licensed through a tech-transfer company, making it proprietary. Consequently, we will not be able to share the code. The lidar point clouds and corresponding trajectory data used for the evaluation of the proposed approach are available upon request.

Acknowledgments

This work was supported by Oregon DOT, US, under Grant Nos. SPR-850 and SPR-866. We thank Rhonda Dodge (Oregon DOT) for providing the MLS data utilized in this research, Josh F. Roll (Oregon DOT) for project management and help with the test site selection, and Tyler Clark for data annotation. Maptek I-Site provided software used in this study. We also appreciate the developers of the open-source packages CloudCompare, NumPy, SciPy, and OpenCV, which were utilized in this study.

Disclaimer

Coauthors Erzhuo Che and Michael J. Olsen have financial interests in EZDataMD LLC, a company which commercializes technology of road marking extraction from point cloud data. The conduct, outcomes, or reporting of this research could benefit EZDataMD LLC and could potentially benefit the authors.

References

Che, E., J. Jung, and M. Olsen. 2019a. “Object recognition, segmentation, and classification of mobile laser scanning point clouds: A state of the art review.” Sensors 19 (4): 810. https://doi.org/10.3390/s19040810.
Che, E., M. J. Olsen, and J. Jung. 2021. “Efficient segment-based ground filtering and adaptive road detection from mobile light detection and ranging (LiDAR) data.” Int. J. Remote Sens. 42 (10): 3633–3659. https://doi.org/10.1080/01431161.2020.1871095.
Che, E., M. J. Olsen, C. E. Parrish, and J. Jung. 2019b. “Pavement marking retroreflectivity estimation and evaluation using mobile lidar data.” Photogramm. Eng. Remote Sens. 85 (8): 573–583. https://doi.org/10.14358/PERS.85.8.573.
Cheng, M., H. Zhang, C. Wang, and J. Li. 2017. “Extraction and classification of road markings using mobile laser scanning point clouds.” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 10 (3): 1182–1196. https://doi.org/10.1109/JSTARS.2016.2606507.
Cheng, Y.-T., Y.-C. Lin, and A. Habib. 2022. “Generalized LiDAR intensity normalization and its positive impact on geometric and learning-based lane marking detection.” Remote Sens. 14 (17): 4393. https://doi.org/10.3390/rs14174393.
Fang, L., T. Sun, S. Wang, H. Fan, and J. Li. 2022. “A graph attention network for road marking classification from mobile LiDAR point clouds.” Int. J. Appl. Earth Obs. Geoinf. 108 (Apr): 102735. https://doi.org/10.1016/j.jag.2022.102735.
Gargoum, S. A., and K. El Basyouny. 2019. “A literature synthesis of LiDAR applications in transportation: Feature extraction and geometric assessments of highways.” GIsci. Remote Sens. 56 (6): 864–893. https://doi.org/10.1080/15481603.2019.1581475.
Gong, B., B. Zhao, Y. Wang, C. Lin, and H. Liu. 2023. “Lane marking detection using low-channel roadside LiDAR.” IEEE Sens. J. 23 (13): 14640–14649. https://doi.org/10.1109/JSEN.2023.3280189.
Guan, H., J. Li, Y. Yu, Z. Ji, and C. Wang. 2015. “Using mobile LiDAR data for rapidly updating road markings.” IEEE Trans. Intell. Transp. Syst. 16 (5): 2457–2466. https://doi.org/10.1109/TITS.2015.2409192.
Guo, J., M.-J. Tsai, and J.-Y. Han. 2015. “Automatic reconstruction of road surface features by using terrestrial mobile lidar.” Autom. Constr. 58 (Oct): 165–175. https://doi.org/10.1016/j.autcon.2015.07.017.
Jung, J., E. Che, M. J. Olsen, and C. Parrish. 2019. “Efficient and robust lane marking extraction from mobile lidar point clouds.” J. Photogramm. Remote Sens. 147 (Jun): 1–18. https://doi.org/10.1016/j.isprsjprs.2018.11.012.
Jung, J., M. Olsen, E. Che, and C. Parrish. 2020. “Efficient extraction and evaluation of complex pavement markings from mobile laser scan data.” Accessed September 10, 2023. https://digital.lib.washington.edu/researchworks/handle/1773/46275.
Jung, J., S. Yoon, S. Ju, and J. Heo. 2015. “Development of kinematic 3D laser scanning system for indoor mapping and as-built BIM using constrained SLAM.” Sensors 15 (10): 26430–26456. https://doi.org/10.3390/s151026430.
Kashani, A., M. Olsen, C. Parrish, and N. Wilson. 2015. “A review of LIDAR radiometric processing: From ad hoc intensity correction to rigorous radiometric calibration.” Sensors 15 (11): 28099–28128. https://doi.org/10.3390/s151128099.
Kumar, P., C. P. McElhinney, P. Lewis, and T. McCarthy. 2014. “Automated road markings extraction from mobile laser scanning data.” Int. J. Appl. Earth Obs. Geoinf. 32 (Oct): 125–137. https://doi.org/10.1016/j.jag.2014.03.023.
Lagahit, M. L. R., and Y.-H. Tseng. 2021. “Road marking extraction and classification from mobile LiDAR point clouds derived imagery using transfer learning.” J. Photogramm. Remote Sens. 26 (3): 127–141. https://doi.org/10.6574/JPRS.202109_26(3).0001.
Li, H. T., Z. Todd, N. Bielski, and F. Carroll. 2022. “3D lidar point-cloud projection operator and transfer machine learning for effective road surface features detection and segmentation.” Vis. Comput. 38 (5): 1759–1774. https://doi.org/10.1007/s00371-021-02103-8.
Liu, L., H. Ma, S. Chen, X. Tang, J. Xie, G. Huang, and F. Mo. 2020. “Image-translation-based road marking extraction from mobile laser point clouds.” IEEE Access 8 (Apr): 64297–64309. https://doi.org/10.1109/ACCESS.2020.2985413.
Nguyen, V., S. Gächter, A. Martinelli, N. Tomatis, and R. Siegwart. 2007. “A comparison of line extraction algorithms using 2D range data for indoor mobile robotics.” Auton. Rob. 23 (2): 97–111. https://doi.org/10.1007/s10514-007-9034-y.
ODOT (Oregon DOT). 2023. “Traffic line manual.” Accessed December 26, 2023. https://www.oregon.gov/odot/engineering/documents_trafficstandards/traffic-line-manual.pdf.
Olsen, M. J., C. Parrish, E. Che, J. Jung, and J. Greenwood. 2018. “Lidar for maintenance of pavement reflective markings and retroreflective signs Vol I: Reflective pavement markings final report.” Accessed December 25, 2023. https://rosap.ntl.bts.gov/view/dot/36526.
Otsu, N. 1979. “A threshold selection method from gray-level histograms.” IEEE Trans. Syst. Man Cybern. 9 (1): 62–66. https://doi.org/10.1109/TSMC.1979.4310076.
Pan, Y., B. Yang, S. Li, H. Yang, Z. Dong, and X. Yang. 2019. “Automatic road markings extraction, classification and vectorization from mobile laser scanning data.” Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci. 42 (Jun): 1089–1096. https://doi.org/10.5194/isprs-archives-XLII-2-W13-1089-2019.
Rastiveis, H., A. Shams, W. A. Sarasua, and J. Li. 2020. “Automated extraction of lane markings from mobile LiDAR point clouds based on fuzzy inference.” ISPRS J. Photogramm. Remote Sens. 160 (Feb): 149–166. https://doi.org/10.1016/j.isprsjprs.2019.12.009.
Riveiro, B., H. González-Jorge, J. Martínez-Sánchez, L. Díaz-Vilariño, and P. Arias. 2015. “Automatic detection of zebra crossings from mobile LiDAR data.” Opt. Laser Technol. 70 (Jul): 63–70. https://doi.org/10.1016/j.optlastec.2015.01.011.
SciPy Community. 2014. “SciPy v0.14.0: Scipy ndimage measurements label.” Accessed December 23, 2023. https://docs.scipy.org/doc/scipy-0.14.0/reference/generated/scipy.ndimage.measurements.label.html.
SciPy Community. 2023. “SciPy v1.11.4: Scipy ndimage binary_fill_holes.” Accessed December 23, 2023. https://docs.scipy.org/doc/scipy/reference/generated/scipy.ndimage.binary_fill_holes.html.
Soilán, M., B. Riveiro, J. Martínez-Sánchez, and P. Arias. 2017. “Segmentation and classification of road markings using MLS data.” ISPRS J. Photogramm. Remote Sens. 123 (Jan): 94–103. https://doi.org/10.1016/j.isprsjprs.2016.11.011.
Wen, C., X. Sun, J. Li, C. Wang, Y. Guo, and A. Habib. 2019. “A deep learning framework for road marking extraction, classification and completion from mobile laser scanning point clouds.” ISPRS J. Photogramm. Remote Sens. 147 (Jan): 178–192. https://doi.org/10.1016/j.isprsjprs.2018.10.007.
Williams, K., M. Olsen, G. Roe, and C. Glennie. 2013. “Synthesis of transportation applications of mobile LIDAR.” Remote Sens. 5 (9): 4652–4692. https://doi.org/10.3390/rs5094652.
Yang, B., Y. Liu, Z. Dong, F. Liang, B. Li, and X. Peng. 2017. “3D local feature BKD to extract road information from mobile laser scanning point clouds.” ISPRS J. Photogramm. Remote Sens. 130 (Aug): 329–343. https://doi.org/10.1016/j.isprsjprs.2017.06.007.
Yang, M., Y. Wan, X. Liu, J. Xu, Z. Wei, M. Chen, and P. Sheng. 2018. “Laser data based automatic recognition and maintenance of road markings from MLS system.” Opt. Laser Technol. 107 (Nov): 192–203. https://doi.org/10.1016/j.optlastec.2018.05.027.
Yao, L., C. Qin, Q. Chen, and H. Wu. 2021. “Automatic road marking extraction and vectorization from vehicle-borne laser scanning data.” Remote Sens. 13 (13): 2612. https://doi.org/10.3390/rs13132612.
Yu, Y., J. Li, H. Guan, F. Jia, and C. Wang. 2015. “Learning hierarchical features for automated extraction of road markings from 3-D mobile LiDAR point clouds.” IEEE J. Sel. Top Appl. Earth Obs. Remote Sens. 8 (2): 709–726. https://doi.org/10.1109/JSTARS.2014.2347276.
Zeybek, M. 2021. “Extraction of road lane markings from mobile LiDAR data.” Transp. Res. Rec. 2675 (5): 30–47. https://doi.org/10.1177/0361198120981948.

Information & Authors

Information

Published In

Go to Journal of Computing in Civil Engineering
Journal of Computing in Civil Engineering
Volume 38Issue 4July 2024

History

Received: Sep 20, 2023
Accepted: Feb 12, 2024
Published online: May 14, 2024
Published in print: Jul 1, 2024
Discussion open until: Oct 14, 2024

Permissions

Request permissions for this article.

Authors

Affiliations

Assistant Professor, Dept. of Urban Engineering, Gyeongsang National Univ., 501 Jinju-daero, Jinju, Gyeongnam 52828, South Korea (corresponding author). ORCID: https://orcid.org/0000-0003-1592-1876. Email: [email protected]
Assistant Professor and Senior Research, School of Civil and Construction Engineering, Oregon State Univ., 101 Kearney Hall, Corvallis, OR 97331. Email: [email protected]
Michael J. Olsen, A.M.ASCE [email protected]
Professor, School of Civil and Construction Engineering, Oregon State Univ., 101 Kearney Hall, Corvallis, OR 97331. Email: [email protected]
Professor, School of Civil and Construction Engineering, Oregon State Univ., 101 Kearney Hall, Corvallis, OR 97331. ORCID: https://orcid.org/0000-0002-2681-0090. Email: [email protected]
Associate Professor, School of Civil and Construction Engineering, Oregon State Univ., 101 Kearney Hall, Corvallis, OR 97331. ORCID: https://orcid.org/0000-0002-3224-5462. Email: [email protected]
Assistant Professor, Dept. of Drone and GIS Engineering, Namseoul Univ., 91, Daehak-ro, Seonghwan-eup, Seobuk-gu, Cheonan-si, Chungcheongnam-do 31020, South Korea. ORCID: https://orcid.org/0000-0002-2122-0534. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share