Color Component–Based Road Feature Extraction from Airborne Lidar and Imaging Data Sets
Publication: Journal of Surveying Engineering
Volume 143, Issue 1
Abstract
This paper presents a new framework of road feature extraction from color component–based data fusion of aerial imagery and lidar data. The proposed framework consists of six procedures: (1) removal of elevated objects (e.g., buildings) from lidar data with a flatness index constraint; (2) removal of shadows and vegetation from aerial images using the Otsu segmentation; (3) data fusion of the modified lidar data and aerial images; (4) initial extraction of road features from the fused data; (5) refinement of road features to remove false positives and join up misclosures; and (6) final extraction of road surfaces and centerlines. A new method is proposed for data fusion of aerial images and lidar data to extract road features by utilizing color components, such as luminance, saturation, and hue, in hue/saturation/intensity and brightness/blue difference/red difference color spaces. A series of refinement processes, including hierarchical median filtering and k-nearest-neighborhood, are implemented to remove open areas (e.g., parking lots) of the road extraction results. A local spatial interpolation method is applied to join up misclosures, and curve fitting is used to obtain accurate road centerlines. The results of tests on sample data sets indicate that the proposed framework performs well, with high accuracy, completeness, and quality.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
The authors thank the Land and Property Information Division of the Department of Finance and Services, New South Wales, Australia, for allowing us to use their aerial images.
References
Akel, N. A., Kremeike, K., Filin, S., Sester, M., and Doytsher, Y. (2005). “Dense DTM generlization aided by roads extracted from LIDAR data.” International Archives of the photogrammetry, remote sensing and spatial information science, Vol. 36 (Part 3/W19), ISPRS Conference Publications, Enschede, the Netherlands, 54–59.
Bong, D. B. L., Lai, K. C., and Joseph, A. (2009). “Automatic road network recognition and extraction for urban planning.” Int. J. Comput., Inf., Syst. Control Eng., 3(5), 31–37.
Boyer, K. L., and Unsalan, C. (2005). “A system to detect houses and residential street networks in multispectral satellite images.” Comput. Vision Image Understanding, 98(3), 423–461.
Chin, R. T., and Yeh, C. L. (1983). “Quantitative evaluation of some edge-preserving noise-smoothing techniques.” Comput. Vision, Graphics, Image Process., 23(1), 67–91.
Choi, Y. W., Jang, Y. W., Lee, H. J., and Cho, G. S. (2007). “Heuristic road extraction.” Int. Symp. on Information Technology Convergence, IEEE Conference Publications, New York, 338–342.
Clode, S., Kootsookos, P., and Rottensteiner, F. (2004a). “The automatic extraction of roads from lidar data.” IAPRSIS, XXXV-B3, ISPRS Conference Publications, Hannover, Germany, 231–236.
Clode, S., Rottensteiner, F., Kootsookos, P., and Zelniker, E. (2007). “Detection and vectorisation of roads from lidar data.” Photogramm. Eng. Remote Sens., 73(5), 517–536.
Clode, S., Zelniker, E., Kootsookos, P., and Clarkson, V. (2004b). “A phase coded disk approach to thick curvilinear line detection.” 17th European Signal Processing Conf., IEEE Conference Publications, New York, 1147–1150.
Eid, H. E. E. (2011). “Automated urban features classification and recognition from combines RGB/lidar data.” Ph.D. dissertation, Univ. of Calgary, Calgary, Alberta, Canada.
Elberink, S. J. O., and Vosselman, G. (2006). “3D modelling of topographic objects by fusing 2D maps and lidar data.” IAPRS, Vol. 36, Part 4, ISPRS Conference Publications, Hannover, Germany.
Gecen, R., and Sarp, G. (2008). “Road detection from high and low resolution satellite images.” IAPRS, Vol. XXXVII, Part B4, ISPRS Conference Publications, Hannover, Germany, 355–358.
Gitelson, A. A., Kaufman, Y. J., Stark, R., and Rundquist, D. (2002). “Novel algorithms for remote estimation of vegetation fraction.” Remote Sens. Environ., 80(1), 76–87.
Gonzalez, R. C., and Woods, R. E. (2002). Digital image processing, Prentice Hall, Upper Saddle River, NJ.
Hang, J. (2011). “An integrated approach for precise road reconstruction from aerial imagery and lidar data.” Ph.D. dissertation, Queensland Univ. of Technology, Brisbane, Australia.
Hatger, C., and Brenner, C. (2003). “Extraction of road geometry parameters from laser scanning and existing databases.” Int. Arch. Photogramm., Remote Sens. Spatial Inf. Sci., 34, 225–230.
Heipke, C., Mayer, H., Wiedemann, C., and Jamet, O. (1997). “Evaluation of automatic road extraction.” IAPRS, XXXII, ISPRS Conference Publications, Hannover, Germany, 47–56.
Herumurti, D., Uchimura, K., Koutaki, G., and Uemura, T. (2014). “Urban road extraction based on shadow removal and road clues detection from high resolution RGB aerial image.” SPIE, Image and Signal Processing for Remote Sensing XX, Vol. 9244, SPIE Conference Publications, Bellingham, WA, 92440S-1.
Hu, X., Tao, C. V., and Hu, Y. (2004). “Automatic road extraction from dense urban area by integrated processing of high-resolution imagery and LIDAR data.” IAPRS, 35(Part B3), ISPRS Conference Publications, Hannover, Germany, 288–292.
Hu, X. Y., Li, Y. J., Shan, J., Zhang, J. Q., and Zhang, Y. J. (2014). “Road centerline extraction in complex urban scenes from lidar data based on multiple features.” IEEE Trans. Geosci. Remote Sens., 52(11), 7448–7456.
Huang, T. S., Yang, G. J., and Tang, G. Y. (1979). “A fast two-dimensional median filtering algorithm.” IEEE Trans. Acoustics Speech Signal Process., 27(1), 13–18.
Iraji, M. S., and Yavari, A. (2011). “Skin color segmentation in fuzzy YCBCR color space with the mamdani inference.” Am. J. Sci. Res., July, 131–137.
Jensen, J. R. (2005). Introductory digital image processing: A remote sensing perspective, Prentice Hall, Upper Saddle River, NJ.
Keller, J. M., Gray, M. R., and Givens, J. A. (1985). “A fuzzy k-nearest neighbor algorithm.” IEEE Trans. Syst. Man Cybern., 15(4), 580–584.
Mena, J. B. (2003). “State of the art on automatic road extraction for GIS update: A novel classification.” Pattern Recognit. Lett., 24(16), 3037–3058.
Otsu, N. (1979). “A threshold selection method from gray-level histograms.” IEEE Trans. Syst. Man Cybern., 9(1), 62–66.
Palm, C. (2004). “Color texture classification by integrative co-occurrence matrices.” Pattern Recognit., 37(5), 965–976.
PSMA Australia Ltd. (2008). Transport and topography data, version 1.5. PSMA Australia Ltd, Canberra, Australia.
Quackenbush, L. J. (2004). “A review of techniques for extracting linear features from imagery.” Photogramm. Eng. Remote Sens., 70(12), 1383–1392.
Rodríguez-Cuenca, B., et al. (2014). “Procedure to detect impervious surfaces using satellite images and light detection and ranging (LIDAR) data.” SPIE, Image and Signal Processing for Remote Sensing XX, Vol. 9244, SPIE Conference Publications, Bellingham, WA, 924414-1.
Saarinen, K. (1994). “Comparison of decimation and interpolation methods in case of multiple repeated RGB-YCbCr colour image format conversions.” IEEE Int. Symp. on Circuits and Systems, Vol. 3, IEEE Conference Publications, New York, 269–272.
Salvador, E., Cavallaro, A., and Ebrahimi, T. (2001). “Shadow identification and classification using invariant color models.” IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, Vol. 3, IEEE Conference Publications, New York, 1545–1548.
Shapiro, L., and Stockman, P. (2001). Computer vision, Prentice Hall, Upper Saddle River, NJ.
Shi, W. Z., Zhu, C. Q., and Wang, Y. (2001). “Road feature extraction from remotely sensed image: Review and prospects.” Acta Geod. Cartog. Sin., 30(3), 257–262 (in Chinese).
Shorter, N., and Kasparis, T. (2009). “Automatic vegetation identification and building detection from a single nadir aerial image.” Remote Sens., 1(4), 731–757.
Sirmacek, B., and Unsalan, C. (2008). “Building detection from aerial images using invariant color features and shadow information.” ISCIS, IEEE Conference Publications, New York, 1–5.
Sural, S., Qian, G., and Pramanik, S. (2002). “Segmentation and histogram generation using the HSV color space for image retrieval.” Int. Conf. on Image Processing, IEEE Conference Publications, New York, 589–592.
Vosselman, G. (2003). “3-D reconstruction of roads and trees for city modelling.” IAPRS, Vol. 34, Part 3/W13, ISPRS Conference Publications, Hannover, Germany, 231–236.
Vosselman, G., and Zhou, L. (2009). “Detection of curbstones in airborne laser scanning data.” IAPRS, XXXVIII—3/W8, ISPRS Conference Publications, Hannover, Germany, 111–117.
Weng, Q. H. (2012). “Remote sensing of impervious surfaces in the urban areas: Requirements, methods, and trends.” Remote Sens. Environ., 117, 34–49.
Yang, B. S., Fang, L. N., and Li, J. (2013). “Semi-automated extraction and delineation of 3D roads of street scene from mobile laser scanning point clouds.” ISPRS J. Photogramm. Remote Sens., 79, 80–93.
Zhang, C. (2003). “Updating of cartographic road databases by image analysis.” Ph.D. dissertation, Institute of Geodesy and Photogrammetry ETH, Zurich, Switzerland.
Zhao, J. P., and You, S. Y. (2012). “Road network extraction from airborne lidar data using scene context.” IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, IEEE Conference Publications, New York, 9–16.
Zhao, J. P., You, S. Y., and Huang, J. (2011). “Rapid extraction and updating of road network from airborne LiDAR data.” IEEE Applied Imagery Pattern Recognition Workshop (AIPR), IEEE Conference Publications, New York, 1–7.
Zhou, L., and Vosselman, G. (2012). “Mapping curbstones in airborne and mobile laser scanning data.” Int. J. Appl. Earth Obs. Geoinf., 18, 293–304.
Zhu, P., Lu, Z., Chen, X., Honda, K., and Eiumnoh, A. (2004). “Extraction of city roads through shadow path reconstruction using laser data.” Photogramm. Eng. Remote Sens., 70(12), 1433–1440.
Zhu, Q. H., and Mordohai, P. (2009). “A minimum cover approach for extracting the road network from airborne lidar data.” IEEE 12th Conf. on Computer Vision Workshops, IEEE Conference Publications, New York, 1582–1589.
Information & Authors
Information
Published In
Journal of Surveying Engineering
Volume 143 • Issue 1 • February 2017
Copyright
© 2016 American Society of Civil Engineers.
History
Received: Dec 18, 2015
Accepted: Apr 20, 2016
Published online: Jul 7, 2016
Discussion open until: Dec 7, 2016
Published in print: Feb 1, 2017
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.