Automated Metadata Cataloging for Mobile Terrestrial Laser Scanning Data Management: Case Study
Publication: Journal of Surveying Engineering
Volume 147, Issue 1
Abstract
This case study examines two essential aspects of mobile terrestrial laser scanning (MTLS). First, it provides results of an investigation into key data management issues experienced by a fairly large producer/consumer of MTLS data. Second, it documents the requirements, design, and implementation of a software tool for automated metadata cataloging of MTLS data and projects. This tool, known as LidarCrawl, was developed to directly address data management issues encountered in the distribution and reuse of MTLS data. This tool enables a geospatial-enabled web-based portal to view MTLS data availability and improves data discovery and usage for all MTLS user levels. While the current case study focuses on the management of MTLS data for the Department of Transportation, the tool provides a means for automated metadata cataloging for general geospatial data in various domains.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code generated or used during the study are available from the corresponding author by request. LiDAR data is the property of the California Department of Transportation. This data would be requested by the corresponding author upon external request.
Acknowledgments
The authors thank the California Department of Transportation for its support, including District 4 (D4) Division of Right of Way and Land Surveys, the D4 Information Technology Division, the Office of Land Surveys, and the Division of Research, Innovation, and System Information. This work was supported through the AHMCT Research Center under Caltrans Contract IA65A0560, Task 2996. Kin Yen provided primary MTLS knowledge, as well as most end user interaction. He also developed much of the case study draft content. Travis Swanston was the primary LidarCrawl developer. Ty Lasky managed the overall effort and contributed substantially to the case study development.
References
AHN3 Point Cloud Viewer. 2020. “AHN viewer | AHN.” Accessed March 5, 2020. https://www.ahn.nl/ahn-viewer.
ArcGIS Cloud-Based GIS Mapping. 2019. “AHN ArcGIS online | Cloud-based GIS mapping software.” Accessed March 21, 2019. https://www.esri.com/en-us/arcgis/products/arcgis-online/overview.
Bond, C. E., Z. K. Shipton, R. Jones, R. W. H. Butler, and A. D. Gibbs. 2007. “Knowledge transfer in a digital world: Field data acquisition, uncertainty, visualization, and data management.” Geosphere 3 (6): 568–576. https://doi.org/10.1130/GES00094.1.
Brostow, G. J., J. Shotton, J. Fauqueur, and R. Cipolla. 2008. “Segmentation and recognition using structure from motion point clouds.” In Proc., European Conf. on Computer Vision, 44–57. Berlin: Springer.
Butler, H. 2019. “Greyhound.” Accessed March 18, 2019. https://github.com/hobu/greyhound.
California Department of Transportation. 2020. “Caltrans D4 right of way maps.” Accessed March 5, 2020. https://caltrans.maps.arcgis.com/apps/webappviewer/index.html?id=04efb9a9f14c4da2aabd9ce36b7dda48.
Creative Commons. 2019. “Creative Commons—Attribution 4.0 International—CC BY 4.0.” Accessed September 18, 2019. https://creativecommons.org/licenses/by/4.0/.
Entwine. 2019. “Entwine—entwine.io.” Accessed March 27, 2019. https://entwine.io/.
Esri Geoportal Server. 2019. “Esri geoportal server | Open source metadata management.” Accessed March 26, 2019. https://www.esri.com/en-us/arcgis/products/geoportal-server/overview.
fangyidong/json-simple. 2019. “GitHub.” Accessed March 28, 2019. https://github.com/fangyidong/json-simple.
FHWA. 2019. “UPlan, an interactive, web-based GIS tool developed by the UDOT.” Accessed March 27, 2019. https://connectdot.connectsolutions.com/p7dw13s1vw5/.
GDAL (Geospatial Data Abstraction Library). 2019. “GDAL documentation.” Accessed September 27, 2019. https://gdal.org/.
GRASS (Geographic Resources Analysis Support System) GIS. 2019. “GRASS GIS—Home.” Accessed September 27, 2019. https://grass.osgeo.org/.
GRiD (Geospatial Repository and Data). 2020. “Home—GRiD.” Accessed March 5, 2020. https://grid.nga.mil/grid.
Höfle, B., M. Rutzinger, T. Geist, and J. Stötter. 2006. “Using airborne laser scanning data in urban data management-set up of a flexible information system with open source components.” In Vol. 2006 of Proc., UDMS (Urban Data Management Society), 7.7.11–7.235. Delft, Netherlands: Urban Data Management Society.
Hug, C., P. Krzystek, and W. Fuchs. 2004. “Advanced LiDAR data processing with LasTools.” In Proc., XXth ISPRS Congress, 12–23. Istanbul, Turkey: International Society for Photogrammetry and Remote Sensing.
Jackcess—Java Library for MS Access. 2019. “Jackcess—Java library for MS access.” Accessed March 29, 2019. https://jackcess.sourceforge.io/.
Jaeger-Frank, E., C. J. Crosby, A. Memon, V. Nandigam, J. R. Arrowsmith, J. Conner, I. Altintas, and C. Baru. 2006. “A three tier architecture for LiDAR interpolation and analysis.” In Proc., Int. Conf. on Computational Science, 920–927. Berlin: Springer.
Krishnan, S., C. Crosby, V. Nandigam, M. Phan, C. Cowart, C. Baru, and R. Arrowsmith. 2011. “OpenTopography: A services oriented architecture for community access to LIDAR topography.” In Proc., 2nd Int. Conf. on Computing for Geospatial Research and Applications, 1–8. New York: Association for Computing Machinery.
Lewis, P., C. P. Mc Elhinney, and T. McCarthy. 2012. “Lidar data management pipeline; from spatial database population to web-application visualization.” In Proc., 3rd Int. Conf. on Computing for Geospatial Research and Applications, 1–10. New York: Association for Computing Machinery.
libLAS. 2019. “libLAS—LAS 1.0/1.1/1.2 ASPRS LiDAR data translation toolset—liblas.org.” Accessed March 19, 2019. https://liblas.org/.
Liu, H., Z. Huang, Q. Zhan, and P. Lin. 2008. “A database approach to very large LiDAR data management.” In Vol. 37 of Proc., Int. Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 463–468. Beijing: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.
Meagher, D. 1982. “Geometric modeling using octree encoding.” Comput. Graph. Image Process. 19 (2): 129–147.
MnTOPO. 2019. “Elevation data for the State of Minnesota.” Accessed March 27, 2019. http://arcgis.dnr.state.mn.us/maps/mntopo/.
National Land Survey of Finland. 2019. “File service of open data.” Accessed March 11, 2019. https://tiedostopalvelu.maanmittauslaitos.fi/tp/kartta?lang=en.
Olsen, M. J., G. V. Roe, C. Glennie, F. Persi, M. Reedy, D. Hurwitz, K. Williams, H. Tuss, A. Squellati, and M. Knodler. 2013. Guidelines for the use of mobile LIDAR in transportation applications. Washington, DC: Transportation Research Board, National Cooperative Highway Research Program.
OpenLayers. 2019. “OpenLayers—Welcome.” Accessed Mach. 21, 2019. https://openlayers.org/.
OpenTopography. 2020. “Home | OpenTopography.” Accessed March 5, 2020. https://opentopography.org/.
PDAL (Point Data Abstraction Library). 2019. “PDAL—Point Data Abstraction Library—pdal.io.” Accessed March 26, 2019. https://pdal.io/.
PostGIS. 2019. “PostGIS—Spatial and Geographic Objects for PostgreSQL.” Accessed March 22, 2019. http://www.postgis.net/.
PostgreSQL. 2019. “PostgreSQL: The world’s most advanced open source database.” Accessed March 12, 2019. https://www.postgresql.org/.
Python. 2019. “Python.org.” Accessed March 1, 2019. https://www.python.org/.
QGIS (Quantum GIS). 2019. “Welcome to the QGIS project!” Accessed March 28, 2019. https://www.qgis.org/en/site/.
R Statistical Computing. 2019. “R: The R project for statistical computing.” Accessed March 20, 2019. https://www.r-project.org/.
Utah Department of Transportation. 2019. “UPlan map center.” Accessed March 27, 2019. http://uplan.maps.arcgis.com/home/index.html.
xerial/sqlite-jdbc. 2014. “xerial / sqlite-jdbc—Bitbucket.” Accessed March 22, 2019. https://bitbucket.org/xerial/sqlite-jdbc/src/default/.
Yen, K., B. Ravani, and T. Lasky. 2014. Mobile terrestrial laser scanning workflow development, technical support and evaluation. Sacramento, CA: California DOT.
Information & Authors
Information
Published In
Journal of Surveying Engineering
Volume 147 • Issue 1 • February 2021
Copyright
© 2020 American Society of Civil Engineers.
History
Received: Sep 25, 2019
Accepted: May 5, 2020
Published online: Sep 16, 2020
Published in print: Feb 1, 2021
Discussion open until: Feb 16, 2021
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.