Constructing Invariant Signatures for AEC Objects to Support BIM-Based Analysis Automation through Object Classification
Publication: Journal of Computing in Civil Engineering
Volume 36, Issue 4
Abstract
Building information modeling (BIM) object classification is a key step in supporting the full automation of architecture, engineering, and construction (AEC) domain tasks such as cost estimation and building code compliance checking. A machine learning approach is designated to address any classification task without requiring the domain knowledge to be explicitly or manually specified in detail. The success of machine learning, however, relies on the quality and suitability of input features. In order to support seamless interoperability of BIM applications, the authors have proposed invariant signatures that uniquely define each AEC object and capture their intrinsic properties. In this paper, the authors combine the use of invariant signatures together with machine learning approach to address BIM object classification. The developed invariant signatures include geometric signatures, locational signatures, and metadata signatures. To test the robustness of their use as machine learning features, the authors created a new BIM object data set with 1,900 AEC objects in five major categories of building elements, including beams, columns, footings, slabs, and walls. The data were manually annotated by independent annotators to ensure the quality. Among those AEC objects in the data set, 1,330 objects (70% of the data) were used as training/development data and 570 objects (30% of the data) were used as testing data. The authors extracted the predefined invariant signatures as features and tested the robustness of them in AEC object classification using different machine learning algorithms. The best-performing algorithm achieved 99.6% F1-measure in the testing data, which outperformed the state of the art (94.9% F1-measure). As a demonstration of the value of such object classification, a comparative experiment was conducted to take off quantities of walls from a student apartment complex, both using the state-of-the-art commercial software and using the object classification–based automation. Consistent results were found between these two quantity takeoff methods, whereas using object classification–based automation further saved time and manual efforts significantly (saved 98.1% of the loading and object selecting time). These results showed that the use of proposed invariant signatures and machine learning algorithms in BIM applications is promising.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some data and models used during the study are available in a repository online in accordance with funder data retention policies:
•
1,900 IFC instances of beams, columns, footings, slabs, and walls labeled with invariant signatures (https://purr.purdue.edu/publications/3832/1).
Acknowledgments
The authors would like to thank the National Science Foundation (NSF). This material is based on work supported by the NSF under Grant No. 1745374. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the NSF.
References
Afsari, K., and C. Eastman. 2016. “A comparison of construction classification systems used for classifying building product models.” In Proc., 2016 ASC Annual Int. Conf., 101–108. Cheyenne, WY: Associated Schools of Construction.
Akanbi, T., J. Zhang, and Y. C. Lee. 2020. “Data-driven reverse engineering algorithm development (D-READ) method for developing interoperable quantity takeoff algorithms using IFC-based BIM.” J. Comput. Civ. Eng. 34 (5): 04020036. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000909.
Alamoudi, E. S., and N. S. Alghamdi. 2021. “Sentiment classification and aspect-based sentiment analysis on yelp reviews using deep learning and word embeddings.” J. Decis. Syst. 30 (2–3): 259–281. https://doi.org/10.1080/12460125.2020.1864106.
Alshabab, M., A. Vysotskiy, T. Khali, and M. Petrochenko. 2017. “BIM-based quantity takeoff.” Constr. Unique Build. Struct. 4 (55): 124–134.
Angermueller, C., T. Pärnamaa, L. Parts, and O. Stegle. 2016. “Deep learning for computational biology.” Mol. Syst. Biol. 12 (7): 878. https://doi.org/10.15252/msb.20156651.
Bethel, E. W. 2009. “Occam’s razor and petascale visual data analysis.” J. Phys. Conf. Ser. 180 (1): 012084. https://doi.org/10.1088/1742-6596/180/1/012084.
Bloch, T., and R. Sacks. 2018. “Comparing machine learning and rule-based inferencing for semantic enrichment of BIM models.” Autom. Constr. 91 (Jul): 256–272. https://doi.org/10.1016/j.autcon.2018.03.018.
BuildingSMART. 2018. “IFC overview summary.” Accessed February 14, 2019. http://www.buildingsmart-tech.org/specifications/ifc-overview.
Cartwright, H. 2015. Artificial neural networks. New York: Springer.
Choi, J., H. Kim, and I. Kim. 2015. “Open BIM-based quantity takeoff system for schematic estimation of building frame in early design stage.” J. Comput. Des. Eng. 2 (1): 16–25. https://doi.org/10.1016/j.jcde.2014.11.002.
David, S., et al. 2016. “Mastering the game of Go with deep neural networks and tree search.” Nature 529 (7587): 484. https://doi.org/10.1038/nature16961.
Dimyadi, J., and S. Henderson. 2012. “Open IFC model repository.” Accessed February 13, 2019. http://openifcmodel.cs.auckland.ac.nz/.
Eastman, C., P. Teicholz, R. Sacks, and K. Liston. 2011. BIM handbook: A guide to building information modeling for owners, managers, designers, engineers and contractors. 2nd ed. Hoboken, NJ: Wiley.
Fraix-Burnet, D., D. Valls-Gabaud, and G. Grégoire. 2014. “Logistic regression.” EAS Publ. Ser. 66 (2014): 89–120. https://doi.org/10.1051/eas/1466008.
GSA (General Service Administration). 2007. “BIM guide overview.” Accessed February 13, 2019. http://www.gsa.gov/portal/getMediaData?mediaId=226771.
Han, K., and M. Golparvar-Fard. 2015. “Appearance-based material classification for monitoring of operation-level construction progress using 4D BIM and site photologs.” Autom. Constr. 53 (May): 44–57. https://doi.org/10.1016/j.autcon.2015.02.007.
Han, P., M. Siu, S. AbouRizk, D. Hu, and U. Hermann. 2017. “3D model-based quantity takeoff for construction estimates.” In Proc., ASCE In. Conf. on Computing in Civil Engineering, 118–124. Reston, VA: ASCE.
Hastie, T., R. Tibshirani, and J. Friedman. 2009. The elements of statistical learning: Data mining, inference, and prediction. New York: Springer.
Hugh, M. C., and K. Nawwaf. 2018. Using artificial intelligence in chemistry and biology a practical guide. Boca Raton, FL: CRC Press.
ISO. 2013. Industry Foundation Classes (IFC) for data sharing in the construction and facility management industries. ISO 16739:2013. Geneva: ISO.
Jensen, F. 1996. An introduction to Bayesian networks. New York: Springer.
Koo, B., S. La, N. W. Cho, and Y. Yu. 2019. “Using support vector machines to classify building elements for checking the semantic integrity of building information models.” Autom. Constr. 98 (Feb): 183–194. https://doi.org/10.1016/j.autcon.2018.11.015.
Kotsiantis, S. B. 2007. “Supervised machine learning: A review of classification techniques.” Informatica 31 (3): 249.
Kuang, D., and B. Xu. 2018. “Predicting kinetic triplets using a 1d convolutional neural network.” Thermochim. Acta 669 (Nov): 8–15. https://doi.org/10.1016/j.tca.2018.08.024.
Lin, T. Y., M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollár, and C. L. Zitnick. 2014. “Microsoft COCO: Common objects in context.” Lect. Notes Comput. Sci. 8693 (5): 740–755.
Liu, H., M. Lu, and M. Al-Hussein. 2016. “Ontology-based semantic approach for construction-oriented quantity take-off from BIM models in the light-frame building industry.” Adv. Eng. Inf. 30 (2): 190–207. https://doi.org/10.1016/j.aei.2016.03.001.
Ma, L., R. Sacks, U. Kattel, and T. Bloch. 2018. “3D object classification using geometric features and pairwise relationships.” Comput.-Aided Civ. Infrastruct. Eng. 33 (2): 152–164. https://doi.org/10.1111/mice.12336.
Mahanta, J. 2017. “Introduction to neural networks, advantages and applications.” Accessed November 18, 2018. https://towardsdatascience.com/introduction-to-neural-networks-advantages-and-applications-96851bd1a207.
Mandava, B., and J. Zhang. 2016. “A new automated quantity takeoff method for BIM-based bridge designs.” In Proc., CIB W78, Conseil International du Bâtiment (CIB). Ottawa: Conseil International du Bâtiment.
NBS of UK. 2018. “NBS national BIM library.” Accessed November 18, 2018. http://www.nationalbimlibrary.com/.
Quinlan, J. R. 1986. “Induction of decision trees.” Mach. Learn. 1 (1): 81–106. https://doi.org/10.1023/A:1022643204877.
Russakovsky, O., et al. 2015. “ImageNet large scale visual recognition challenge.” Int. J. Comput. Vis. 115 (3): 211–252. https://doi.org/10.1007/s11263-015-0816-y.
Ryan, G. R. 1997. Intelligent visual inspection using artificial neural networks. New York: Springer.
Santos, A., A. Costa, and A. Grillo. 2017. “Bibliometric analysis and review of Building Information Modeling literature published between 2005 and 2015.” Autom. Constr. 80 (Aug): 118–136. https://doi.org/10.1016/j.autcon.2017.03.005.
Seeliger, K., U. Güçlü, L. Ambrogioni, Y. Güçlütürk, and M. A. J. Gerven. 2018. “Generative adversarial networks for reconstructing natural images from brain activity.” NeuroImage 181 (Nov): 775–785. https://doi.org/10.1016/j.neuroimage.2018.07.043.
Son, H., C. Kim, and C. Kim. 2012. “Automated color model–based concrete detection in construction-site images by using machine learning algorithms.” J. Comput. Civ. Eng. 26 (3): 421–433. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000141.
Veropoulos, K., C. Campbell, and N. Cristianini. 1999. “Controlling the sensitivity of support vector machines.” In Proc., Int. Joint Conf. on AI, 55–60. Linköping, Sweden: IJCAII and the Scandinavian AI Societies.
Vitasek, S., and P. Matejka. 2017. “Utilization of BIM for automation of quantity takeoffs and cost estimation in transport infrastructure construction projects in the Czech Republic.” IOP Conf. Ser.: Mater. Sci. Eng. 236: 012110. https://doi.org/10.1088/1757-899X/236/1/012110.
Witten, I. H., E. Frank, M. A. Hall, and C. J. Paul. 2016. Data mining. 4th ed. Burlington, MA: Morgan Kaufmann.
Wu, J., H. L. Sadraddin, R. Ren, J. Zhang, and X. Shao. 2021. “Invariant signatures of architecture, engineering, and construction objects to support BIM interoperability between architectural design and structural analysis.” J. Constr. Eng. Manage. 147 (1): 04020148. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001943.
Wu, J., and J. Zhang. 2018. “Automated BIM object classification to support BIM interoperability.” In Proc., Construction Research Congress, 706–715. Reston, VA: ASCE.
Wu, J., and J. Zhang. 2019a. Building information modelling (BIM) data repository with labels. West Lafayette, IN: Purdue Univ. https://doi.org/10.4231/60V2-PJ72.
Wu, J., and J. Zhang. 2019b. “Introducing geometric signatures of architecture, engineering, and construction objects and a new BIM dataset.” In Proc., 2019 ASCE Int. Conf. on Computing in Civil Engineering, 264–271. Reston, VA: ASCE.
Wu, J., and J. Zhang. 2019c. “New automated BIM object classification method to support BIM interoperability.” J. Comput. Civ. Eng. 33 (5): 04019033. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000858.
Wu, J., and J. Zhang. 2021. Invariant signatures of architecture, engineering, and construction (AEC) objects in industry foundation classes (IFC)-based building information modeling. West Lafayette, IN: Purdue Univ. https://doi.org/10.4231/7VW7-0129.
Xue, X., and J. Zhang. 2020a. “Building codes part-of-speech tagging performance improvement by error-driven transformational rules.” J. Comput. Civ. Eng. 34 (5): 04020035. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000917.
Xue, X., and J. Zhang. 2020b. “Erratum for ‘Building codes part-of-speech tagging performance improvement by error-driven transformational rules.’” J. Comput. Civ. Eng. 35 (1): 08220002. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000950.
Yogesh, G. K. V., and L. Vanajakshi. 2018. “Automated tolling solution with novel inductive loop detectors using machine learning techniques.” J. Comput. Civ. Eng. 32 (6): 04018046. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000789.
Zeng, G., R. Song, X. Hu, Y. Chen, and X. Zhou. 2019. “Applying convolutional neural network for military object detection on embedded platform.” In Vol. 994 of Proc., 22nd CCF Conf., Computer Engineering and Technology. NCCET 2018. Communications in Computer and Information Science, 131–141. Singapore: Springer. https://doi.org/10.1007/978-981-13-5919-4_13.
Zhang, J., F. Fogelman-Soulié, and C. Largeron. 2018. “Towards automatic complex feature engineering.” In Vol. 11234 of Proc., Web Information Systems Engineering—WISE 2018. WISE 2018. Lecture Notes in Computer Science, 312–322. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-030-02925-8_22.
Zhou, B., H. Zhao, X. Puig, S. Fidler, A. Barriuso, and A. Torralba. 2017. “Scene parsing through ADE20K dataset.” In Proc., 30th IEEE Conf. on Computer Vision and Pattern Recognition, 5122–5130. New York: IEEE.
Zhou, B., H. Zhao, X. Puig, T. Xiao, S. Fidler, A. Barriuso, and A. Torralba. 2018. “Semantic understanding of scenes through ADE20k dataset.” Int. J. Comput. Vis. 127: 1–20. https://doi.org/10.1007/s11263-018-1140-0.
Information & Authors
Information
Published In
Journal of Computing in Civil Engineering
Volume 36 • Issue 4 • July 2022
Copyright
© 2022 American Society of Civil Engineers.
History
Received: Feb 22, 2021
Accepted: Nov 17, 2021
Published online: Mar 22, 2022
Published in print: Jul 1, 2022
Discussion open until: Aug 22, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
Cited by
- Hang Li, Jiansong Zhang, Information Extraction for Semantic Enrichment of BIM for Bridges, Construction Research Congress 2024, 10.1061/9780784485262.064, (629-638), (2024).
- Hang Li, Fan Yang, Jiansong Zhang, IFC-Based Semantic Segmentation and Semantic Enrichment of BIM for Bridges, Construction Research Congress 2024, 10.1061/9780784485262.061, (597-606), (2024).
- See more