Technical Papers
Jul 12, 2024

Digitization of Existing Buildings with Arbitrary Shaped Spaces from Point Clouds

Publication: Journal of Computing in Civil Engineering
Volume 38, Issue 5

Abstract

Digital twins for buildings can significantly reduce building operation costs. However, existing methods for constructing geometric digital twins fail to model the complex geometry of indoor environments. To address this problem, this paper proposes a novel method for digitizing building geometry with arbitrary shapes of spaces by detecting empty regions in point clouds and then expanding them to occupy the entire indoor space. The detected spaces are then used to detect structural objects and transition between spaces, such as doors, without assuming their geometric properties. The method reconstructs the volumetric representation of individual spaces, detects walls, windows and doors between them and splits the point cloud data (PCD) into point clusters of individual spaces from large-scale cluttered PCDs of complex environments. We conduct extensive experiments on Stanford 3D Indoor Spaces data set (S3DIS) and TUMCMS data sets and show that the proposed method outperforms existing methods for digitizing Manhattan-world buildings. In contrast to existing approaches, the method allows digitizing buildings with arbitrarily shaped spaces, including complex layouts, nonflat, nonvertical walls, and nonflat, nonhorizontal floors and ceilings.

Get full access to this article

View all available purchase options and get full access to this article.

Data Availability Statement

Some or all data, models, or code generated or used during the study are available in a repository online in accordance with funder data retention policies at http://buildingparser.stanford.edu/dataset.html.

Acknowledgments

This work is funded by the EU Horizon 2020 CBIM project under Agreement No. 860555 and EU Horizon 2020 Bim2Twin project under Agreement No. 958398.

References

Agapaki, E., G. Miatt, and I. Brilakis. 2018. “Prioritizing object types for modelling existing industrial facilities.” Autom. Constr. 96 (Dec): 211–223. https://doi.org/10.1016/j.autcon.2018.09.011.
Agostinho, L. R., N. M. Ricardo, M. I. Pereira, A. Hiolle, and A. M. Pinto. 2022. “A practical survey on visual odometry for autonomous driving in challenging scenarios and conditions.” IEEE Access 10 (Mar): 72182–72205. https://doi.org/10.1109/ACCESS.2022.3188990.
Anagnostopoulos, I., M. Belsky, and I. Brilakis. 2016a. Object boundaries and room detection in As-Is BIM models from point cloud data (July). Osaka, Japan: International Conference on Computing in Civil and Building Engineering.
Anagnostopoulos, I., V. Patraucean, I. Brilakis, and P. Vela. 2016b. Detection of walls, floors, and ceilings in point cloud data, 2302–2311. Reston, VA: ASCE.
Anil, E. B., P. Tang, B. Akinci, and D. Huber. 2013. “Deviation analysis method for the assessment of the quality of the as-is Building Information Models generated from point cloud data.” Autom. Constr. 35 (Dec): 507–516. https://doi.org/10.1016/j.autcon.2013.06.003.
Armeni, I., O. Sener, A. R. Zamir, H. Jiang, I. Brilakis, M. Fischer, and S. Savarese. 2016. “3D semantic parsing of large-scale indoor spaces.” In Proc., Construction Research Congress 2016, 1534–1543. Reston, VA: ASCE.
Badenko, V., D. Volgin, and S. Lytkin. 2018. “Deformation monitoring using laser scanned point clouds and BIM.” MATEC Web Conf. 245 (Mar): 01002. https://doi.org/10.1051/matecconf/201824501002.
Bassier, M., and M. Vergauwen. 2020. “Unsupervised reconstruction of Building Information Modeling wall objects from point cloud data.” Autom. Constr. 120 (Mar): 103338. https://doi.org/10.1016/j.autcon.2020.103338.
Chen, J., C. Liu, J. Wu, and Y. Furukawa. 2019. “Floor-SP: Inverse CAD for floorplans by sequential room-wise shortest path.” In Proc., IEEE/CVF Int. Conf. on Computer Vision (ICCV), 2661–2670. New York: IEEE.
Chen, W., K. Chen, J. C. P. Cheng, Q. Wang, and V. J. L. Gan. 2018. “BIM-based framework for automatic scheduling of facility maintenance work orders.” Autom. Constr. 91 (Mar): 15–30. https://doi.org/10.1016/j.autcon.2018.03.007.
Drobnyi, V., Z. Hu, Y. Fathy, and I. Brilakis. 2023. “Construction and maintenance of building geometric digital twins: State of the art review.” Sensors 23 (9): 4382. https://doi.org/10.3390/s23094382.
Drobnyi, V., S. Li, and I. Brilakis. 2024. “Connectivity detection for automatic construction of building geometric digital twins.” Autom. Constr. 159 (Dec): 105281. https://doi.org/10.1016/j.autcon.2024.105281.
Harris, C. R., et al. 2020. “Array programming with NumPy.” Nature 585 (7825): 357–362. https://doi.org/10.1038/s41586-020-2649-2.
Hübner, P., M. Weinmann, S. Wursthorn, and S. Hinz. 2021. “Automatic voxel-based 3D indoor reconstruction and room partitioning from triangle meshes.” ISPRS J. Photogramm. Remote Sens. 181 (Mar): 254–278. https://doi.org/10.1016/j.isprsjprs.2021.07.002.
Hughes, N., Y. Chang, and L. Carlone. 2022. “Hydra: A real-time spatial perception engine for 3D scene graph construction and optimization.” Preprint, submitted January 31, 2018. http://arxiv.org/abs/2201.13360.
Institute. 2017. Reinventing construction: A route to higher productivity. New York: McKinsey Global Institute.
Liu, C., J. Wu, and Y. Furukawa. 2018. “FloorNet: A unified framework for floorplan reconstruction from 3D scans.” In Proc., European Conf. on Computer Vision (ECCV), 201–217. Berlin: Springer.
Lu, Q., X. Xie, A. K. Parlikad, J. M. Schooling, and E. Konstantinou. 2021. “Moving from building information models to digital twins for operation and maintenance.” Proc. Inst. Civ. Eng. Smart Infrastruct. Constr. 174 (2): 46–56. https://doi.org/10.1680/jsmic.19.00011.
Lu, R., and I. Brilakis. 2019. “Digital twinning of existing reinforced concrete bridges from labelled point clusters.” Autom. Constr. 105 (Mar): 102837. https://doi.org/10.1016/j.autcon.2019.102837.
Macher, H., T. Landes, and P. Grussenmeyer. 2017. “From point clouds to building information models: 3D semi-automatic reconstruction of indoors of existing buildings.” Appl. Sci. 7 (10): 1030. https://doi.org/10.3390/app7101030.
McArthur, J. J. 2015. “A building information management (BIM) framework and supporting case study for existing building operations, maintenance and sustainability.” Procedia Eng. 118 (Mar): 1104–1111. https://doi.org/10.1016/j.proeng.2015.08.450.
Monszpart, A., N. Mellado, G. J. Brostow, and N. J. Mitra. 2015. “RAPter: Rebuilding man-made scenes with regular arrangements of planes.” ACM Trans. Graphics 34 (4): 1–12. https://doi.org/10.1145/2766995.
Motawa, I., and A. Almarshad. 2013. “A knowledge-based BIM system for building maintenance.” Autom. Constr. 29 (Mar): 173–182. https://doi.org/10.1016/j.autcon.2012.09.008.
Mura, C., O. Mattausch, A. Jaspe Villanueva, E. Gobbetti, and R. Pajarola. 2014. “Automatic room detection and reconstruction in cluttered indoor environments with complex room layouts.” Comput. Graphics 44 (Jun): 20–32. https://doi.org/10.1016/j.cag.2014.07.005.
Murali, S., P. Speciale, M. R. Oswald, and M. Pollefeys. 2017. “Indoor Scan2BIM: Building information models of house interiors.” In Proc., 2017 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), 6126–6133. New York: IEEE.
NBS Enterprises. 2020. “Newcastle upon Tyne.” Accessed May 26, 2020. https://www.thenbs.com/knowledge/national-bim-report-2020.
NHBC (National House Building Council). 2016. “The challenge of shape and form.” Accessed November 21, 2023. https://www.nhbc.co.uk/foundation/the-challenge-of-shape-and-form.
Nikoohemat, S., A. A. Diakité, S. Zlatanova, and G. Vosselman. 2020. “Indoor 3D reconstruction from point clouds for optimal routing in complex buildings to support disaster management.” Autom. Constr. 113 (Mar): 103109. https://doi.org/10.1016/j.autcon.2020.103109.
Nummelin, J., K. Sulankivi, M. Kiviniemi, and T. Koppinen. 2011. “Managing building information and client requirements in construction supply chain: Constructor’s view.” In Proc., Conf. of CIB W078—W102 2011 Joint Conf. Delft, Netherlands: International Council for Building/International Council for Research and Innovation in Building and Construction.
Ochmann, S., R. Vock, and R. Klein. 2019. “Automatic reconstruction of fully volumetric 3D building models from oriented point clouds.” ISPRS J. Photogramm. Remote Sens. 151 (Mar): 251–262. https://doi.org/10.1016/j.isprsjprs.2019.03.017.
Oesau, S., F. Lafarge, and P. Alliez. 2013. “Indoor scene reconstruction using primitive-driven space partitioning and graph-cut.” In Eurographics workshop on urban data modelling and visualisation. Berlin: ISPRS Journal of Photogrammetry and Remote Sensing.
Ozturk, G. B. 2021. “Digital twin research in the AECO-FM industry.” J. Build. Eng. 40 (Dec): 102730. https://doi.org/10.1016/j.jobe.2021.102730.
Pan, Y., A. Braun, A. Borrmann, and I. Brilakis. 2023. “3D deep-learning-enhanced void-growing approach in creating geometric digital twins of buildings.” Proc. Inst. Civ. Eng. Smart Infrastruct. Constr. 176 (1): 24–40. https://doi.org/10.1680/jsmic.21.00035.
Pedregosa, F., et al. 2011. “Scikit-learn: Machine learning in Python.” J. Mach. Learn. Res. 12 (Oct): 2825–2830. https://doi.org/10.5555/1953048.2078195.
Perez-Perez, Y., M. Golparvar-Fard, and K. El-Rayes. 2021a. “Scan2BIM-NET: Deep learning method for segmentation of point clouds for scan-to-BIM.” J. Constr. Eng. Manage. 147 (9): 04021107. https://doi.org/10.1061/(ASCE)CO.1943-7862.0002132.
Perez-Perez, Y., M. Golparvar-Fard, and K. El-Rayes. 2021b. “Segmentation of point clouds via joint semantic and geometric features for 3D modeling of the built environment.” Autom. Constr. 125 (Jun): 103584. https://doi.org/10.1016/j.autcon.2021.103584.
Qian, G., Y. Li, H. Peng, J. Mai, H. A. A. K. Hammoud, M. Elhoseiny, and B. Ghanem. 2022. “PointNeXt: Revisiting PointNet++ with improved training and scaling strategies.” Adv. Neural Inf. Process. Syst. 35 (Dec): 23192–23204.
Qu, T., J. Coco, M. Rönnöng, and W. Sun. 2014. Challenges and trends of implementation of 3D point cloud technologies in building information modeling (BIM): Case studies, 809–816. Reston, VA: ASCE.
Rahmani Asl, M., S. Zarrinmehr, M. Bergin, and W. Yan. 2015. “BPOpt: A framework for BIM-based performance optimization.” Energy Build. 108 (Dec): 401–412. https://doi.org/10.1016/j.enbuild.2015.09.011.
Rosinol, A., A. Violette, M. Abate, N. Hughes, Y. Chang, J. Shi, A. Gupta, and L. Carlone. 2021. “Kimera: From SLAM to spatial perception with 3D dynamic scene graphs.” Int. J. Rob. Res. 40 (12–14): 1510–1546. https://doi.org/10.1177/02783649211056674.
Sacks, R., C. Eastman, G. Lee, and P. Teicholz. 2018. BIM handbook: A guide to building information modeling for owners, designers, engineers, contractors, and facility managers. New York: Wiley.
Sanhudo, L., N. M. M. Ramos, J. Poças Martins, R. M. S. F. Almeida, E. Barreira, M. L. Simões, and V. Cardoso. 2018. “Building information modeling for energy retrofitting–A review.” Renewable Sustainable Energy Rev. 89 (Jun): 249–260. https://doi.org/10.1016/j.rser.2018.03.064.
Tang, S., X. Li, X. Zheng, B. Wu, W. Wang, and Y. Zhang. 2022. “BIM generation from 3D point clouds by combining 3D deep learning and improved morphological approach.” Autom. Constr. 141 (Mar): 104422. https://doi.org/10.1016/j.autcon.2022.104422.
Tran, H., K. Khoshelham, A. Kealy, and L. Díaz Vilariño. 2018. “Shape grammar approach to 3D modeling of indoor environments using point clouds.” J. Comput. Civ. Eng. 33 (1): 04018055. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000800.
Trzeciak, M. P., and I. Brilakis. 2021. “Comparison of accuracy and density of static and mobile laser scanners.” In Vol. 2 of Proc., 2021 European Conf. on Computing in Construction, 197–203. Dublin, Ireland: Univ. College Dublin.
Virtanen, P., et al. 2020. “SciPy 1.0: Fundamental algorithms for scientific computing in Python.” Nat. Methods 17 (3): 261–272. https://doi.org/10.1038/s41592-019-0686-2.
Wang, R., L. Xie, and D. Chen. 2017. “Modeling indoor spaces using decomposition and reconstruction of structural elements.” Photogramm. Eng. Remote Sens. 83 (12): 827–841. https://doi.org/10.14358/PERS.83.12.827.
Wu, Y., M. Li, and F. Xue. 2023. “Towards fully automatic Scan-to-BIM: A prototype method integrating deep neural networks and architectonic grammar.” In Vol. 4 of Computing in construction, European council on computing in construction. Athens, Greece: European Council on Computing in Construction.
Xiong, X., A. Adan, B. Akinci, and D. Huber. 2013. “Automatic creation of semantically rich 3D building models from laser scanner data.” Autom. Constr. 31 (May): 325–337. https://doi.org/10.1016/j.autcon.2012.10.006.
Xu, Y., X. Shen, and S. Lim. 2021a. “CorDet: Corner-Aware 3D object detection networks for automated scan-to-BIM.” J. Comput. Civ. Eng. 35 (3): 04021002. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000962.
Xu, Y., X. Shen, S. Lim, and X. Li. 2021b. “Three-dimensional object detection with deep neural networks for automatic As-built reconstruction.” J. Constr. Eng. Manage. 147 (9): 04021098. https://doi.org/10.1061/(ASCE)CO.1943-7862.0002003.
Zhou, Q.-Y., J. Park, and V. Koltun. 2018. “Open3D: A modern library for 3D data processing.” Preprint, submitted January 30, 2018. http://arxiv.org/abs/1801.09847.

Information & Authors

Information

Published In

Go to Journal of Computing in Civil Engineering
Journal of Computing in Civil Engineering
Volume 38Issue 5September 2024

History

Received: Nov 28, 2023
Accepted: Apr 25, 2024
Published online: Jul 12, 2024
Published in print: Sep 1, 2024
Discussion open until: Dec 12, 2024

Permissions

Request permissions for this article.

ASCE Technical Topics:

Authors

Affiliations

Ph.D. Candidate, Dept. of Engineering, Univ. of Cambridge, Civil Engineering Bldg., JJ Thomson Ave. 7a, Cambridge CB3 0FA, UK (corresponding author). ORCID: https://orcid.org/0000-0002-0362-0016. Email: [email protected]
Shuyan Li, Ph.D. [email protected]
Research Associate, Dept. of Engineering, Univ. of Cambridge, Civil Engineering Bldg., JJ Thomson Ave. 7a, Cambridge CB3 0FA, UK. Email: [email protected]
Professor, Dept. of Engineering, Univ. of Cambridge, Civil Engineering Bldg., JJ Thomson Ave. 7a, Cambridge CB3 0FA, UK. ORCID: https://orcid.org/0000-0003-1829-2083. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Article
$35.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share