Query Answering System for Building Information Modeling Using BERT NN Algorithm and NLG
Publication: Computing in Civil Engineering 2021
ABSTRACT
The construction industry is generally regarded as information intensive. Building information modeling (BIM) has been developed to provide considerable information support for construction activities. As more data is aggregated in building information models, it is more difficult and time-consuming to extract useful building information for construction project team members with limited BIM experience. In Industry 4.0, deep learning-based conversational artificial intelligence (AI) technologies provide more opportunities to support human daily life. Similarly, for smart construction, a conversational AI information retrieval system is considered important to provide building information support. This research aims to develop a conversational intelligent query answering (QA) system for attribute information retrieval from building information models. The methodology of the QA system for BIM was developed based on the Google pre-trained deep learning language neural network (NN) algorithm—Bidirectional Encoder Representations from Transformers (BERT) and natural language generation (NLG) methods. A Python-based prototype program was developed based on the methodology. Building attribute information-related queries were generated to test the accuracy of the developed QA system for BIM. The preliminary results indicate that the developed prototype achieved an 80.0 accuracy score, meaning 80 predictions exactly matched their ground truths, for providing answers to building attribute information-related queries. The developed QA system methodology for BIM was also found to be valid and relatively accurate. The contribution of this research facilitates the development of conversational AI systems that provide convenient information support for onsite and offsite construction personnel, and the developed QA system for BIM can be extended to other information retrieval areas.
Get full access to this chapter
View all available purchase options and get full access to this chapter.
REFERENCES
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D. M., Wu, J., Winter, C., Hesse, C., Chen, M., Sigler, E., Litwin, M., Gray, S., Chess, B., Clark, J., Berner, C., McCandlish, S., Radford, A., Sutskever, I., and Amodei, D. (2020). “Language Models are Few-Shot Learners.”
buildingSMART. (2019). “Industry Foundation Classes (IFC).” <https://technical.buildingsmart.org/standards/ifc>(Jun. 10, 2019).
Chao, X., Yang, L., and Amin, A. (2018). “Bibliometric Review of Artificial Intelligence (AI) in Construction Engineering and Management.” International Conference on Construction and Real Estate Management 2018, Proceedings, 32–41.
Devlin, J., Chang, M.-W., Lee, K., Google, K. T., and Language, A. I. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding.
Hugging Face. (2020). “BERT.” <https://huggingface.co/transformers/model_doc/bert.html#bertfortokenclassification>(Mar. 10, 2021).
Karan, E. P., Irizarry, J., and Haymaker, J. (2016). “BIM and GIS Integration and Interoperability Based on Semantic Web Technology.” Journal of Computing in Civil Engineering, 30(3), 04015043-1–04015043–11.
Lin, J., Hu, Z., Zhang, J., and Yu, F. (2016). “A Natural-Language-Based Approach to Intelligent Data Retrieval and Representation for Cloud BIM.” Computer-Aided Civil & Infrastructure Engineering, 31(1), 18–33.
Liu, H., Lu, M., and Al-Hussein, M. (2016). “Ontology-based semantic approach for construction-oriented quantity take-off from BIM models in the light-frame building industry.” Advanced Engineering Informatics, Elsevier Ltd, 30(2), 190–207.
Peters, M. E., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., and Zettlemoyer, L. (2018). “Deep contextualized word representations.”.
Sacks, R., Eastman, C. M., Teicholz, P. M., and Lee, G. (2018). BIM handbook: a guide to building information modeling for owners, designers, engineers, contractors, and facility managers. John Wiley & Sons, Inc., Hoboken, New Jersey.
SQuAD. (2021). “SQuAD 2.0.” <https://rajpurkar.github.io/SQuAD-explorer/>(Mar. 10, 2021).
Vlahovic, N. (2011). “Information Retrieval and Information Extraction in Web 2.0 environment.” International Journal of Computers, 5(1), 1–9.
Wang, N., and Issa, R. R. A. (2020). “Natural Language Generation from Building Information Models for Intelligent NLP-based Information Extraction.” EG-ICE 2020 Workshop on Intelligent Computing in Engineering, L. C. Ungureanu and T. Hartmann, eds., Universitätsverlag der TU Berlin, Berlin, 275–284.
Wu, S., Shen, Q., Deng, Y., and Cheng, J. (2019). “Natural-language-based intelligent retrieval engine for BIM object database.” Computers in Industry, Elsevier, 108, 73–88.
Zhong, B., He, W., Huang, Z., Love, P. E. D., Tang, J., and Luo, H. (2020). “A building regulation query answering system: A deep learning methodology.” Advanced Engineering Informatics, 46, 101195.
Information & Authors
Information
Published In
History
Published online: May 24, 2022
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.