ASCE International Conference on Computing in Civil Engineering 2019
Semantic Segmentation of Building Point Clouds Using Deep Learning: A Method for Creating Training Data Using BIM to Point Cloud Label Transfer
Publication: Computing in Civil Engineering 2019: Visualization, Information Modeling, and Simulation
ABSTRACT
Creating deep learning classifiers requires large labeled datasets; and creating large labeled datasets requires elaborate crowdsourcing systems and many hours of manual human effort applied to classification and data entry. Fortunately, much of this effort can be bypassed in the building industry because of as-built building information models (BIMs), a semantically rich form of facility information. From these BIMs, semantics can be transferred to point clouds. This paper presents a method for creating large labeled datasets for training deep neural networks to semantically segment point clouds of buildings. Geometry and attached semantics are extracted from a BIM. The geometry is registered with the point cloud and the BIM semantics are copied to the points in the point cloud. The presented method enables organizations with access to as-built BIMs to forgo the effort of creating large labeled datasets and instead use the embodied effort in their pre-existing BIMs.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Anagnostopoulos, I., Pătrăucean, V., Brilakis, I., and Vela, P. (2016) “Detection of walls, floors, and ceilings in point cloud data.” Proc., Construction Research Congress 2016, 2302-2311.
Armeni, I., Sax, S., Zamir, A. R., and Savarese, S. (2017). “Joint 2d-3d-semantic data for indoor scene understanding.” arXiv preprint arXiv:1702.01105.
Axelrod, R. (1973). “Schema theory: An information processing model of perception and cognition.” American political science review, 67(4), 1248-1266.
Bassier, M., Vergauwen, M., and Van Genechten, B. (2016) “Automated semantic labelling of 3D vector models for scan-to-BIM.” Proc., Proceedings of the 4th Annual International Conference on Architecture and Civil Engineering (ACE2016), 93-100.
Bhatla, A., Choe, S. Y., Fierro, O., and Leite, F. (2012). “Evaluation of accuracy of as-built 3D modeling from photos taken by handheld digital cameras.” AUTOMATION IN CONSTRUCTION, 28, 116-127.
Bosché, F., Ahmed, M., Turkan, Y., Haas, C. T., and Haas, R. (2015). “The value of integrating Scan-to-BIM and Scan-vs-BIM techniques for construction monitoring using laser scanning and BIM: The case of cylindrical MEP components.” Automation in Construction, 49, 201-213.
Chang, A., Dai, A., Funkhouser, T., Halber, M., Nießner, M., Savva, M., Song, S., Zeng, A., and Zhang, Y. (2017). “Matterport3d: Learning from rgb-d data in indoor environments.” arXiv preprint arXiv:1709.06158.
Czerniawski, T., and Leite, F. (2018) “3DFacilities: annotated 3D reconstructions of building facilities.” Proc., Workshop of the European Group for Intelligent Computing in Engineering, Springer, 186-200.
Dai, A., Chang, A. X., Savva, M., Halber, M., Funkhouser, T. A., and Nießner, M. (2017) “ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes.” Proc., CVPR, 10.
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. (2009) “Imagenet: A large-scale hierarchical image database.” Proc., Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, Ieee, 248-255.
Eastman, C. M. (2011). “BIM handbook a guide to building information modeling for owners, managers, designers, engineers and contractors.” Wiley, Hoboken, NJ, 1 online resource (xiv, 626 p., 628 p. of plates).
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., and Zisserman, A. (2010). “The Pascal Visual Object Classes (VOC) Challenge.” International Journal of Computer Vision, 88(2), 303-338.
Fathi, H., Dai, F., and Lourakis, M. (2015). “Automated as-built 3D reconstruction of civil infrastructure using computer vision: Achievements, opportunities, and challenges.” Advanced Engineering Informatics, 29(2), 149-161.
Hua, B.-S., Pham, Q.-H., Nguyen, D. T., Tran, M.-K., Yu, L.-F., and Yeung, S.-K. (2016) “Scenenn: A scene meshes dataset with annotations.” Proc., 3D Vision (3DV), 2016 Fourth International Conference on, IEEE, 92-101.
Hullo, J. F., Thibault, G., Boucheny, C., Dory, F., and Mas, A. (2015). “Multi-Sensor As-Built Models of Complex Industrial Architectures.” REMOTE SENSING, 7(12), 16339-16362.
Leite, F., Gong, J., and Bogen, C. (2013) “Grand Challenges in Information Modeling for the Architecture, Engineering, Construction, and Facility Management Industries.” Proc., 2013 ASCE Computing in Civil Engineering Conference, 427-434.
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Roamanan, D., Dollár, P., and Zitnick, C. L. (2014). “Microsoft COCO: Common Objects in Context.” European Conference on Computer Vision (ECCV), Springer, Cham, Zurich, Switzerland.
Mura, C., Mattausch, O., and Pajarola, R. (2016) “Piecewise-planar Reconstruction of Multi-room Interiors with Arbitrary Wall Arrangements.” Proc., Computer Graphics Forum, Wiley Online Library, 179-188.
Nahangi, M., and Haas, C. T. (2014). “Automated 3D compliance checking in pipe spool fabrication.” Advanced Engineering Informatics, 28(4), 360-369.
Ochmann, S., Vock, R., Wessel, R., and Klein, R. (2016). “Automatic reconstruction of parametric building models from indoor point clouds.” Computers & Graphics, 54, 94-103.
Pătrăucean, V., Armeni, I., Nahangi, M., Yeung, J., Brilakis, I., and Haas, C. (2015). “State of research in automatic as-built modelling.” Advanced Engineering Informatics, 29(2), 162-171.
Qi, C. R., Su, H., Mo, K., and Guibas, L. J. (2016a). “PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation.” arXiv preprint arXiv:1612.00593.
Qi, C. R., Su, H., Nießner, M., Dai, A., Yan, M., and Guibas, L. J. (2016b) “Volumetric and multi-view cnns for object classification on 3d data.” Proc., Proceedings of the IEEE conference on computer vision and pattern recognition, 5648-5656.
Quijano, A., and Prieto, F. (2016). “3D Semantic modeling of indoor environments based on point clouds and contextual relationships.” Ingeniería, 21(3), 305-323.
Silberman, N., Hoiem, D., Kohli, P., and Fergus, R. (2012) “Indoor segmentation and support inference from rgbd images.” Proc., European Conference on Computer Vision, Springer, 746-760.
Song, S., Lichtenberg, S. P., and Xiao, J. (2015) “Sun rgb-d: A rgb-d scene understanding benchmark suite.” Proc., Proceedings of the IEEE conference on computer vision and pattern recognition, 567-576.
Tang, P., Anil, E. B., Akinci, B., and Huber, D. (2011). “Efficient and effective quality assessment of as-is building information models and 3D laser-scanned data.” Computing in Civil Engineering (2011), 486-493.
Tang, P., Huber, D., Akinci, B., Lipman, R., and Lytle, A. (2010). “Automatic reconstruction of as-built building information models from laser-scanned point clouds: A review of related techniques.” Automation in Construction, 19(7), 829-843.
Turkan, Y., Bosche, F., Haas, C. T., and Haas, R. (2012). “Automated progress tracking using 4D schedule and 3D sensing technologies.” Automation in Construction, 22, 414-421.
Volk, R., Stengel, J., and Schultmann, F. (2014). “Building Information Modeling (BIM) for existing buildings — Literature review and future needs.” Automation in Construction, 38, 109-127.
Xiong, X., Adan, A., Akinci, B., and Huber, D. (2013). “Automatic creation of semantically rich 3D building models from laser scanner data.” Automation in Construction, 31, 325-337.
Information & Authors
Information
Published In
Computing in Civil Engineering 2019: Visualization, Information Modeling, and Simulation
Pages: 410 - 416
Editors: Yong K. Cho, Ph.D., Georgia Institute of Technology, Fernanda Leite, Ph.D., University of Texas at Austin, Amir Behzadan, Ph.D., Texas A&M University, and Chao Wang, Ph.D., Louisiana State University
ISBN (Online): 978-0-7844-8242-1
Copyright
© 2019 American Society of Civil Engineers.
History
Published online: Jun 13, 2019
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.