Project Requirements Prioritization through NLP-Driven Classification and Adjusted Work Items Analysis
Publication: Journal of Construction Engineering and Management
Volume 150, Issue 3
Abstract
Project requirements indicate specific works, events, or conditions that should be fulfilled to ensure the construction project success within planned budgets and times. To effectively manage project requirements, requirement prioritization allows for the proper allocation of limited project resources by determining the relative importance and urgency of different requirements. However, because project requirements are typically communicated through textual data in documents, the current approach to prioritizing requirements heavily relies on individuals’ expertise, practical knowledge, and experiences. This subjective judgment-based process poses a challenge in ensuring consistent and reliable prioritization, because there may be variations in practitioners’ prioritization results. Moreover, a large amount of text in documents can complicate capturing significant requirements within limited bidding times. To address these issues, this study proposes a novel method using historical data analysis and computational techniques. This study adopts historical change orders in order to evaluate impact levels of adjusted work items during construction and natural language processing (NLP) techniques, which enable the automated classification of requirements by the most-related work items. This study conducts a case study by examining documents from resurfacing projects and validating the feasibility and effectiveness of the proposed method. It will also provide a cornerstone for a smarter review and understanding of project documentation and improved decision-making for project planning.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or codes that support the findings of this study are available from the corresponding authors upon reasonable request.
References
Abdul-Malak, M.-A., and S. Khalife. 2017. “Classification and analysis of notice requirements for construction contract administration.” J. Leg. Aff. Dispute Resolut. Eng. Constr. 9 (3): 04517016. https://doi.org/10.1061/(ASCE)LA.1943-4170.0000241.
Abraham, G. L. 2003. “Critical success factors for the construction industry.” In Proc., Construction Research Congress: Wind of Change: Integration and Innovation, 1–9. Reston, VA: ASCE. https://doi.org/10.1061/40671(2003)63.
Ahmed, S., and I. Arocho. 2021. “Analysis of cost comparison and effects of change orders during construction: Study of a mass timber and a concrete building project.” J. Build. Eng. 33 (Jan): 101856. https://doi.org/10.1016/j.jobe.2020.101856.
Braimah, N. 2014. “Understanding construction delay analysis and the role of preconstruction programming.” J. Manage. Eng. 30 (5): 04014023. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000216.
Cheng, M.-Y., D. Kusoemo, and R. A. Gosno. 2020. “Text mining-based construction site accident classification using hybrid supervised machine learning.” Autom. Constr. 118 (Oct): 103265. https://doi.org/10.1016/j.autcon.2020.103265.
Church, K. W. 2017. “Word2Vec.” Nat. Lang. Eng. 23 (1): 155–162. https://doi.org/10.1017/S1351324916000334.
Devlin, J., M.-W. Chang, K. Lee, and K. Toutanova. 2018. “BERT: Pre-training of deep bidirectional transformers for language understanding.” Preprint, submitted October 11, 2018. http://arxiv.org/abs/1810.04805.
Ding, Y., J. Ma, and X. Luo. 2022. “Applications of natural language processing in construction.” Autom. Constr. 136 (Apr): 104169. https://doi.org/10.1016/j.autcon.2022.104169.
Forcada, N., M. Gangolells, M. Casals, and M. Macarulla. 2017. “Factors affecting rework costs in construction.” J. Constr. Eng. Manage. 143 (8): 04017032. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001324.
Gadekar, H., and N. Bugalia. 2023. “Automatic classification of construction safety reports using semi-supervised YAKE-Guided LDA approach.” Adv. Eng. Inform. 56 (Apr): 101929. https://doi.org/10.1016/j.aei.2023.101929.
Gil, M. Á., and G. González-Rodríguez. 2012. “Fuzzy vs. Likert scale in statistics.” In Combining experimentation and theory: A hommage to Abe Mamdani, 407–420. Berlin: Springer. https://doi.org/10.1007/978-3-642-24666-1_27.
Gou, L., J. Zhang, N. Li, Z. Wang, J. Chen, and L. Qi. 2022. “Weighted assignment fusion algorithm of evidence conflict based on Euclidean distance and weighting strategy, and application in the wind turbine system.” Plos One 17 (1): e0262883. https://doi.org/10.1371/journal.pone.0262883.
Grisot, C. 2017. “A quantitative approach to conceptual, procedural and pragmatic meaning: Evidence from inter-annotator agreement.” J. Pragmatics 117 (Aug): 245–263. https://doi.org/10.1016/j.pragma.2017.06.020.
Hassan, F. U. U., and T. Le. 2020. “Automated requirements identification from construction contract documents using natural language processing.” J. Leg. Aff. Dispute Resolut. Eng. Constr. 12 (2): 04520009. https://doi.org/10.1061/(ASCE)LA.1943-4170.0000379.
Howard, J., and S. Ruder. 2018. “Universal language model fine-tuning for text classification.” Preprint, submitted January 18, 2018. http://arxiv.org/abs/1801.06146.
Ibrahim, A. H., and L. M. Elshwadfy. 2021. “Factors affecting the accuracy of construction project cost estimation in Egypt.” Jordan J. Civ. Eng. 15 (3): 329–343.
Jafari, P., M. Al Hattab, E. Mohamed, and S. AbouRizk. 2021. “Automated extraction and time-cost prediction of contractual reporting requirements in construction using natural language processing and simulation.” Appl. Sci. 11 (13): 6188. https://doi.org/10.3390/app11136188.
Jeon, J., X. Xu, Y. Zhang, L. Yang, and H. Cai. 2021. “Extraction of construction quality requirements from textual specifications via natural language processing.” Transp. Res. Rec. 2675 (9): 222–237. https://doi.org/10.1177/03611981211001385.
Jeon, K., G. Lee, and H. D. Jeong. 2020. “Classification of the requirement sentences of the US DOT standard specification using deep learning algorithms.” In Proc., Int. Conf. on Computing in Civil and Building Engineering, 89–97. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-030-51295-8_8.
Karim Jallow, A., P. Demian, A. N. Baldwin, and C. Anumba. 2014. “An empirical study of the complexity of requirements management in construction projects.” Eng. Constr. Archit. Manage. 21 (5): 505–531. https://doi.org/10.1108/ECAM-09-2013-0084.
Karthick, R., B. Malathi, and C. Umarani. 2015. “Study on change order impact on project lifecycle.” Int. J. Eng. Res. Technol. 4 (5): 691–695. https://doi.org/10.17577/IJERTV4IS050443.
Ko, T., H. David Jeong, and J. Lee. 2023. “Natural language processing–driven similar project determination using project scope statements.” J. Manage. Eng. 39 (3): 04023005. https://doi.org/10.1061/JMENEA.MEENG-5229.
Ko, T., H. D. Jeong, and G. Lee. 2021. “Natural language processing–driven model to extract contract change reasons and altered work items for advanced retrieval of change orders.” J. Constr. Eng. Manage. 147 (11): 04021147. https://doi.org/10.1061/(ASCE)CO.1943-7862.0002172.
Kopeć, M., and M. Ogrodniczuk. 2014. “Inter-annotator agreement in coreference annotation of Polish.” In Vol. 551 of Advanced approaches to intelligent information and database systems. Studies in computational intelligence, edited by J. Sobecki, V. Boonjing, and S. Chittayasothorn. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-319-05503-9_15.
Kopsida, M., I. Brilakis, and P. A. Vela. 2015. “A review of automated construction progress monitoring and inspection methods.” In Proc., 32nd CIB W78 Conf., 421–431. Kanata, ON, Canada: International Council for Research and Innovation in Building and Construction.
Lane, K., and G. Gagnon. 2022. “Comparing quantitative probability of occurrence to a risk matrix approach: A study of chlorine residual data.” Water Res. 218 (Jun): 118480. https://doi.org/10.1016/j.watres.2022.118480.
Le, T., C. Le, H. David Jeong, S. B. Gilbert, and E. Chukharev-Hudilainen. 2019. “Requirement text detection from contract packages to support project definition determination.” In Advances in Informatics and Computing in Civil and Construction Engineering: Proc., 35th CIB W78 2018 Conf.: IT in Design, Construction, and Management, 569–576. Kanata, ON, Canada: International Council for Research and Innovation in Building and Construction. https://doi.org/10.1007/978-3-030-00220-6_68.
Lee, J., Y. Ham, J.-S. Yi, and J. Son. 2020. “Effective risk positioning through automated identification of missing contract conditions from the contractor’s perspective based on FIDIC contract cases.” J. Manage. Eng. 36 (3): 05020003. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000757.
Lee, J., and J.-S. Yi. 2017. “Predicting project’s uncertainty risk in the bidding process by integrating unstructured text data and structured numerical data using text mining. Appl. Sci. 7 (11): 1141. https://doi.org/10.3390/app7111141.
Lee, J., J.-S. Yi, and J. Son. 2019. “Development of automatic-extraction model of poisonous clauses in international construction contracts using rule-based NLP.” J. Comput. Civ. Eng. 33 (3): 04019003. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000807.
Li, Y., C. Wei, and T. Ma. 2019. “Towards explaining the regularization effect of initial large learning rate in training neural networks.” In Advances in neural information processing systems, 32. New York: IEEE. https://doi.org/10.48550/arXiv.1907.04595.
Lin, J.-W., and P. F. Shen. 2014. “Factor-analysis based questionnaire categorization method for reliability improvement of evaluation of working conditions in construction enterprises.” Struct. Eng. Mech. Intl J. 51 (6): 973–988. https://doi.org/10.12989/sem.2014.51.6.973.
Moon, S., S. Chi, and S.-B. Im. 2022. “Automated detection of contractual risk clauses from construction specifications using bidirectional encoder representations from transformers (BERT).” Autom. Constr. 142 (Oct): 104465. https://doi.org/10.1016/j.autcon.2022.104465.
Mosbach, M., M. Andriushchenko, and D. Klakow. 2020. “On the stability of fine-tuning BERT: Misconceptions, explanations, and strong baselines.” Preprint, submitted June 8, 2020. http://arxiv.org/abs/2006.04884.
Nayak, A. S., A. P. Kanive, N. Chandavekar, and R. Balasubramani. 2016. “Survey on pre-processing techniques for text mining.” Int. J. Eng. Comput. Sci. 5 (6): 16875–16879.
Orosoo, M., S. Govindasamy, N. Bayarsaikhan, Y. Rajkumari, G. Fatma, R. Manikandan, and B. K. Bala. 2023. “Performance analysis of a novel hybrid deep learning approach in classification of quality-related English text.” Meas. Sens. 28: 100852. https://doi.org/10.1016/j.measen.2023.100852.
Pan, Y., and L. Zhang. 2021. “Roles of artificial intelligence in construction engineering and management: A critical review and future trends.” Autom. Constr. 122 (Feb): 103517. https://doi.org/10.1016/j.autcon.2020.103517.
Pennington, J., R. Socher, and C. D. Manning. 2014. “Glove: Global vectors for word representation.” In Proc., 2014 Conf. on Empirical Methods in Natural Language Processing, 1532–1543. Stroudsburg, PA: Association for Computational Linguistics.
Samantra, C., S. Datta, and S. S. Mahapatra. 2017. “Fuzzy based risk assessment module for metropolitan construction project: An empirical study.” Eng. Appl. Artif. Intell. 65 (Oct): 449–464. https://doi.org/10.1016/j.engappai.2017.04.019.
Serpella, A. F., X. Ferrada, R. Howard, and L. Rubio. 2014. “Risk management in construction projects: A knowledge-based approach.” Procedia-Soc. Behav. Sci. 119 (Mar): 653–662. https://doi.org/10.1016/j.sbspro.2014.03.073.
Shen, Q., S. Wu, Y. Deng, H. Deng, and J. C. Cheng. 2022. “BIM-based dynamic construction safety rule checking using ontology and natural language processing.” Buildings 12 (5): 564. https://doi.org/10.3390/buildings12050564.
Sinesilassie, E. G., S. Z. S. Tabish, and K. N. Jha. 2018. “Critical factors affecting cost performance: A case of Ethiopian public construction projects.” Int. J. Constr. Manage. 18 (2): 108–119. https://doi.org/10.1080/15623599.2016.1277058.
Taylor, T. R., M. Uddin, P. M. Goodrum, A. McCoy, and Y. Shan. 2012. “Change orders and lessons learned: Knowledge from statistical analyses of engineering change orders on Kentucky highway projects.” J. Constr. Eng. Manage. 138 (12): 1360–1369. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000550.
Tian, D., M. Li, J. Shi, Y. Shen, and S. Han. 2021. “On-site text classification and knowledge mining for large-scale projects construction by integrated intelligent approach.” Adv. Eng. Inform. 49 (Aug): 101355. https://doi.org/10.1016/j.aei.2021.101355.
Vaswani, A., N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin. 2017. “Attention is all you need.” In Advances in neural information processing systems, 30. New York: IEEE. https://doi.org/10.48550/arXiv.1706.03762.
Vieira, J., F. M. Dias, and A. Mota. 2004. “Neuro-fuzzy systems: A survey.” In Proc., 5th WSEAS NNA Int. Conf. on Neural Networks and Applications, Udine, Italia, 1–6. Athens, Greece: World Scientific and Engineering Academy and Society.
Vijayakumar, K., and C. Arun. 2017. “Automated risk identification using NLP in cloud based development environments.” J. Ambient Intell. Humaniz. Comput. 1–13. https://doi.org/10.1007/s12652-017-0503-7.
Vonglao, P. 2017. “Application of fuzzy logic to improve the Likert scale to measure latent variables.” Kasetsart J. Soc. Sci. 38 (3): 337–344. https://doi.org/10.1016/j.kjss.2017.01.002.
Young, T., D. Hazarika, S. Poria, and E. Cambria. 2018. “Recent trends in deep learning based natural language processing.” IEEE Comput. Intell. Mag. 13 (3): 55–75. https://doi.org/10.1109/MCI.2018.2840738.
Yu, A. T., and G. Q. Shen. 2013. “Problems and solutions of requirements management for construction projects under the traditional procurement systems.” Facilities 31 (5/6): 223–237. https://doi.org/10.1108/02632771311307098.
Zeng, J., M. An, and N. J. Smith. 2007. “Application of a fuzzy based decision making methodology to construction project risk assessment.” Int. J. Proj. Manage. 25 (6): 589–600. https://doi.org/10.1016/j.ijproman.2007.02.006.
Zhang, T., F. Wu, A. Katiyar, K. Q. Weinberger, and Y. Artzi. 2020. “Revisiting few-sample BERT fine-tuning.” Preprint, submitted June 10, 2020. http://arxiv.org/abs/2006.05987.
Zhou, P., and N. El-Gohary. 2016. “Automated extraction of environmental requirements from contract specifications.” In Proc., 16th Int. Conf. on Computing in Civil and Building Engineering. Montréal: International Society for Computing in Civil and Building Engineering.
Zou, Y., A. Kiviniemi, and S. W. Jones. 2017. “Retrieving similar cases for construction project risk management using natural language processing techniques.” Autom. Constr. 80 (Aug): 66–76. https://doi.org/10.1016/j.autcon.2017.04.003.
Information & Authors
Information
Published In
Journal of Construction Engineering and Management
Volume 150 • Issue 3 • March 2024
Copyright
© 2023 American Society of Civil Engineers.
History
Received: Feb 11, 2023
Accepted: Oct 12, 2023
Published online: Dec 27, 2023
Published in print: Mar 1, 2024
Discussion open until: May 27, 2024
ASCE Technical Topics:
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.