Chapter 5
From Purpose to Technology: A Requirements-Driven Approach to Designing Digital Twin Implementations
Publication: Digital Twins in Construction and the Built Environment
Abstract
The digital twin (DT) paradigm promises to take permanent, bidirectional data exchange between the physical asset and its digital representation into account at its core. Nevertheless, as with any digital model, a DT is always an abstraction of reality. This chapter introduces a guide to creating purpose-driven, geometric-semantic DTs. It proposes a DT implementation framework with use-case-derived requirements and an integrity metric for evaluation. Potentially involved technologies for implementation are reviewed in three phases: raw data acquisition and processing, data enrichment, and geometry provision. The chapter elaborates requirement-dependent implementations for the use case of “Efficient HVAC maintenance.” A compact variety of further DT use cases across several domains is provided, each along with specific requirements and implementation suggestions to fulfill them. The chapter presents a guide that allows a structured design of successful DT implementations with a sound selection of technologies and processing approaches.
Get full access to this chapter
View all available purchase options and get full access to this chapter.
References
Abualdenien, J., and A. Borrmann. 2022. “Ensemble-learning approach for the classification of levels of geometry (LOG) of building elements.” Adv. Eng. Inf. 51: 101497.
Besl, P. J., and N. D. McKay. 1992. “Method for registration of 3-D shapes. Sensor fusion IV: control paradigms and data structures.” Int. Soc. Opt. Photonics 1611: 586–606.
BIMForum. 2023. “Level of development specification version.” www.bimforum.org/lod.
Bloch, T., and R. Sacks. 2018. “Comparing machine learning and rule-based inferencing for semantic enrichment of BIM models.” Autom. Constr. 91: 256–272.
Boje, C., A. Guerriero, S. Kubicki, and Y. Rezgui. 2020. “Towards a semantic Construction Digital Twin: Directions for future research.” Autom. Constr. 114 (March): 103179.
Borrmann, A., and V. Berkhahn. 2018. “Principles of geometric modeling.” In Building information modeling: Technology foundations and industry practice, edited by A. Borrmann, M. König, C. Koch, and J. Beetz, 27–41. Cham, Switzerland: Springer.
Borrmann, A., M. König, C. Koch, and J. Beetz. 2018. “Building information modeling: Why? what? how?” In Building information modeling, edited by A. Borrmann, M. König, C. Koch, and J. Beetz. Cham, Switzerland: Springer.
Bosché, F. 2010. “Automated recognition of 3D CAD model objects in laser scans and calculation of as-built dimensions for dimensional compliance control in construction.” Adv. Eng. Inf. 24 (1): 107–118.
Bosché, F., M. Ahmed, Y. Turkan, C. T. Haas, et al. 2015. “The value of integrating scan-to-BIM and scan-vs-BIM techniques for construction monitoring using laser scanning and BIM: The case of cylindrical MEP components.” Autom. Constr. 49: 201–213.
Braun, A., S. Tuttas, A. Borrmann, and U. Stilla. 2020. “Improving progress monitoring by fusing point clouds, semantic data and computer vision.” Autom. Constr. 116: 103210.
Brilakis, I., Y. Pan, A. Borrmann, H. G. Mayer, et al. 2020. Built environment digital twinning. Munich, Germany: Technical University of Munich.
Brumana, R., S. D. Torre, M. Previtali, L. Barazzetti, et al. 2018. “Generative HBIM modelling to embody complexity (LOD, LOG, LOA, LOI): Surveying, preservation, site intervention—The Basilica di Collemaggio (L'Aquila).” Appl. Geomatics 10 (4): 545–567.
Chen, W., G. Shang, A. Ji, C. Zhou, et al. 2022. “An overview on visual SLAM: From tradition to semantic.” Remote Sens. 14 (13): 3010. https://doi.org/10.3390/rs14133010.
Collins, F. C., S. M. Mafipour, F. Noichl, Y. Pan, et al. 2021. “Towards applicable scan-to-BIM and scan-to-floorplan: An end-to-end experiment.” In Proc., 32nd Forum Bauinformatik, Darmstadt, Germany, edited by M. Disser, A. Hoffmann, L. Kuhn, and P. Scheich, 98–105. Darmstadt, Germany: Darmstadt University.
Collins, F. C., M. Ringsquandl, A. Braun, D. M. Hall, et al. 2022. “Shape encoding for semantic healing of design models and knowledge transfer to scan-to-BIM.” Proc. Inst. Civ. Eng. Smart Infrastruct. Constr. 175 (3): 1–21.
Crampen, D., and J. Blankenbach. 2023. “LOADt: Towards a concept of level of as-is detail for digital twins of roads.” In Proc., 30th Int. Conf. on Intelligent Computing in Engineering. London: University College.
Eastman, C. M., C. Eastman, P. Teicholz, R. Sacks, et al. 2011. BIM handbook: A guide to building information modeling for owners, managers, designers, engineers and contractors. New York: Wiley.
Eickeler, F., A. Sánchez-Rodríguez, and A. Borrmann. 2021. “Adaptive feature-conserving compression for large scale point clouds.” Adv. Eng. Inf. 48: 101236.
Emunds, C., N. Pauen, V. Richter, J. Frisch, et al. 2022. “SpaRSE-BIM : Classification of IFC-based geometry via sparse convolutional neural networks.” Adv. Eng. Inf. 53 (September 2021): 101641.
Fernandez, N., S. Katipamula, W. Wang, Y. Huang, et al. 2015. “Energy savings modelling of re-tuning energy conservation measures in large office buildings.” J. Build. Perform. Simul. 8 (6): 391–407.
Gao, B., Y. Pan, C. Li, S. Geng, et al. 2021. “Are we hungry for 3D LiDAR data for semantic segmentation? A survey of datasets and methods.” IEEE Trans. Intell. Transp. Syst. 23 (7): 6063–6081.
Gomez, C., and H. Purdie. 2016. “UAV- based photogrammetry and geocomputing for hazards and disaster risk monitoring – A review.” Geoenviron. Disast. 3 (1): 1–11. https://doi.org/10.1186/s40677-016-0060-y.
Hackel, T., J. D. Wegner, and K. Schindler. 2016. “Contour detection in unstructured 3D point clouds.” In Proc., IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, Las Vegas, 1610–1618. New York: IEEE.
Han, X. F., J. S. Jin, M. J. Wang, W. Jiang, et al. 2017. “A review of algorithms for filtering the 3D point cloud.” Signal Process. Image Commun. 57: 103–112.
Hoegner, L., and U. Stilla. 2018. “Mobile thermal mapping for matching of infrared images with 3D building models and 3D point clouds.” Quant. InfraRed Thermogr. J. 15 (2): 252–270.
Hosamo, H. H., P. R. Svennevig, K. Svidt, D. Han, et al. 2022. “A Digital Twin predictive maintenance framework of air handling units based on automatic fault detection and diagnostics.” Energy Build. 261: 111988.
Huang, L. 2021. “Review on LiDAR-based SLAM techniques.” In Proc., 2021 Int. Conf. on Signal Processing and Machine Learning (CONF-SPML), Las Vegas, 163–168. New York: IEEE.
Jaud, Š, A. Donaubauer, O. Heunecke, and A. Borrmann. 2020. “Georeferencing in the context of building information modelling.” Autom. Constr. 118 (August): 103211.
Kritzinger, W., M. Karner, G. Traar, J. Henjes, et al. 2018. “Digital Twin in manufacturing: A categorical literature review and classification.” IFAC-PapersOnLine 51 (11): 1016–1022.
Kulak, D., and E. Guiney. 2012. Use cases: Requirements in context. Boston: Addison-Wesley.
Mafipour, M. S., S. Vilgertshofer, and A. Borrmann. 2023a. “Digital twinning of bridges from point cloud data by deep learning and parametric models.” In Proc., European Conf. on Product and Process Modeling, Trondheim, Norway. Boca Raton, FL: CRC Press.
Mafipour, M. S., S. Vilgertshofer, and A. Borrmann. 2023b. “Automated geometric digital twinning of bridges from segmented point clouds by parametric prototype models.” Autom. Constr. 156: 105101.
Monedero, J. 2000. “Parametric design: A review and some experiences.” Autom. Constr. 9 (4): 369–377.
Mylopoulos, J., and J. Castro. 2000. “Tropos: A framework for requirements-driven software development.” Inf. Syst. Eng.: State Art Res. Themes 8 (June): 261–273.
Noichl, F., A. Braun, and A. Borrmann. 2021. “BIM-to-scan” for scan-to-BIM: Generating realistic synthetic ground truth point clouds based on industrial 3D models.” In Vol. 2 of Proc., 2021 European Conf. on Computing in Construction, online conference, 164–172.
Oesau, S., F. Lafarge, and P. Alliez. 2014. “Indoor scene reconstruction using feature sensitive primitive extraction and graph-cut.” ISPRS J. Photogramm. Remote Sens. 90: 68–82.
Özyeşil, O., V. Voroninski, R. Basri, and A. Singer. 2017. “A survey of structure from motion.” Acta Numer. 26: 305–364.
Pan, Y., A. Braun, I. Brilakis, and A. Borrmann. 2022a. “Enriching geometric digital twins of buildings with small objects by fusing laser scanning and AI-based image recognition.” Autom. Constr. 140 (February): 104375.
Pan, Y., F. Noichl, A. Braun, A. Borrmann, et al. 2022b. “Automatic creation and enrichment of 3D models for pipe systems by co-registration of laser-scanned point clouds and photos.” In Proc., European Conf. on Computing in Construction, Rhodes, Greece.
Park, J. S., P. Kim, Y. K. Cho, and Y. Fang. 2018. “Automated collaboration framework of UAV and UGV for 3D visualization of construction sites.” In Proc., 18th Int. Conf. on Construction Applications of Virtual Reality. Auckland, New Zealnd: University of Auckland.
Patil, A. K., P. Holi, S. K. Lee, and Y. H. Chai. 2017. “An adaptive approach for the reconstruction and modeling of as-built 3D pipelines from point clouds.” Autom. Constr. 75: 65–78.
Pauwels, P., and K. McGlinn. 2022. Buildings and semantics: Data models and web technologies for the built environment. Boca Raton, FL: CRC Press.
Poux, F. 2019. The smart point cloud: Structuring 3D intelligent point data. Liège, Belgique: Université de Liège.
Rausch, C., and C. Haas. 2021. “Automated shape and pose updating of building information model elements from 3D point clouds.” Autom. Constr. 124 (August 2020): 103561.
Remondino, F. 2003. “From point cloud to surface: The modeling and visualization problem.” In Proc., Int. Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Tarasp-Vulpera, Switzerland.
Ricci, A. 1974. “A constructive geometry for computer graphics.” Comput.-Aided Des. 6 (1): 53.
Rvachev, V. L. 1963. “An analytic description of certain geometric objects.” Dokl. Akad. Nauk. 153 (4): 765–767.
Sacks, R., I. Brilakis, E. Pikas, H. S. Xie, et al. 2020. “Construction with digital twin information systems.” Data-Centric Eng. 1: e14.
Salinesi, C. 2004. “Authoring use cases.” In Scenarios, stories, use cases: Through the systems development life-cycle, edited by I. Alexander and N. Maiden. Hoboken, NJ: Wiley.
Schönberger, J. L., and J.-M. Frahm. 2016. “Structure-from-motion revisited.” In Proc., Conf. on Computer Vision and Pattern Recognition, Las Vegas. New York: IEEE.
Schönberger, J. L., E. Zheng, M. Pollefeys, and J.-M. Frahm. 2016. “Pixelwise view selection for unstructured multi-view stereo.” In Proc., European Conf. on Computer Vision, Cham, Switzerland: Springer.
Seitz, S. M., B. Curless, J. Diebel, D. Scharstein, et al. 2006. “A comparison and evaluation of multi-view stereo reconstruction algorithms.” In Vol. 1 of Proc., IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, 519–528. New York: IEEE.
Simmons, R. J. 1990. “The cooperative effort to promote the use of GIS technology at Michigan State University.” In Proc., 18th Annual ACM SIGUCCS Conf. on User Services, 341–344. New York, ACM.
Song, X., and B. Jüttler. 2009. “Modeling and 3D object reconstruction by implicitly defined surfaces with sharp features.” Comput. Graphics 33 (3): 321–330.
Thrun, S. 2008. “Simultaneous localization and mapping.” In Robotics and cognitive approaches to spatial mapping, edited by M.-E. Jefferies and W. K. Yeap, 13–41. Berlin: Springer.
Tuttas, S., A. Braun, A. Borrmann, and U. Stilla. 2017. “Acquisition and consecutive registration of photogrammetric point clouds for construction progress monitoring using a 4D BIM. J. Photogramm. Remote Sens. Geoinf. Sci. 85 (1): 3–15.
Vega-Torres, M. A., A. Braun, and A. Borrmann. 2023. “BIM-SLAM: Integrating BIM models in multi-session SLAM for lifelong mapping using 3D LiDAR.” In Proc., 40th Int. Symp. on Automation and Robotics in Construction, Chennai, India.
Vilgertshofer, S., M. S. Mafipour, A. Borrmann, J. Martens, et al. 2023. “TwinGen: Advanced technologies to automatically generate digital twins for operation and maintenance of existing bridges.” In Proc., European Conf. on Product and Process Modeling 2022, 213–220. Trondheim, Norway. Boca Raton, FL: CRC Press.
Vince, J. 2013. Vol. 112 of Calculus for computer graphics. Cham, Switzerland: Springer.
Weiler, K. J. 1986. Topological structures for geometric modeling (boundary representation, manifold, radial edge structure). Troy, NY: Rensselaer Polytechnic Institute.
Xie, Y., J. Tian, and X. X. Zhu. 2020. “Linking points with labels in 3D: A review of point cloud semantic segmentation.” IEEE Geosci. Remote Sens. Mag. 8 (4): 38–59.
Xu, Y., X. Tong, and U. Stilla. 2021. “Voxel-based representation of 3D point clouds: Methods, applications, and its potential use in the construction industry.” Autom. Constr. 126 (February): 103675.
Yang, Y., A. Wang, D. Bu, Z. Feng, et al. 2022. “AS-Net: An attention-aware downsampling network for point clouds oriented to classification tasks.” J. Visual Commun. Image Represent. 89: 103639.
Yin, T., X. Zhou, and P. Krahenbuhl. 2021. “Center-based 3D object detection and tracking.” In Proc., IEEE/CVF Conf. on Computer Vision and Pattern Recognition, Nashville, TN, 11784–11793. New York: IEEE.
Zhu, J., J. Gehrung, R. Huang, B. Borgmann, et al. 2020. “TUM-MLS-2016: An annotated mobile LiDAR dataset of the TUM city campus for semantic point cloud interpretation in urban areas.” Remote Sens. 12 (11): 1875.
Zou, Z., Z. Shi, Y. Guo, and J. Ye. 2023. “Object detection in 20 years: A survey.” Proc. IEEE 111 (3): 257–276.
Information & Authors
Information
Published In
Digital Twins in Construction and the Built Environment
Pages: 91 - 130
Editors: Houtan Jebelli, Ph.D., Somayeh Asadi, Ph.D., Ivan Mutis, Ph.D., Rui Liu, Ph.D., and Jack Cheng, Ph.D.
ISBN (Online): 978-0-7844-8560-6
Copyright
© 2024 by the American Society of Civil Engineers.
History
Published online: Sep 23, 2024
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.