Joint BERT Model for Intent Classification and Slot Filling Analysis of Natural Language Instructions in Co-Robotic Field Construction Work
Publication: Computing in Civil Engineering 2023
ABSTRACT
As the construction industry faces the challenges of a worker shortage and low productivity rate, there is a growing interest in using human-robot collaboration (HRC) in construction. HRC allows for a combination of the accuracy and repeatability of robots with the flexibility and intelligence of human workers. To take advantage of its potential benefits, it is important for construction workers who are not robotic experts to interact easily with robots through intuitive and natural user interfaces. Even though many studies have been performed on HRC using natural language, little research has been conducted on this topic in construction. This paper conducts natural language understanding of language instructions for pick-and-place operations in construction using the language model Joint BERT. Experimental results show high accuracy on intent classification and slot filling tasks, allowing the robot to perform tasks accurately for a given natural language instruction.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Cai, J., Du, A., Liang, X., and Li, S. (2023). “Prediction-Based Path Planning for Safe and Efficient Human–Robot Collaboration in Construction via Deep Reinforcement Learning.” Journal of Computing in Civil Engineering, 37(1), 04022046.
Chen, Q., Zhuo, Z., and Wang, W. (2019). “Bert for joint intent classification and slot filling.”.
Cupido, G. (2009). “The role of production and teamwork practices in construction safety: A cognitive model and an empirical case study.” Joural of Safety Research, 40(4), 265–275.
Delgado, J. M. D., Oyedele, L., Ajayi, A., Akanbi, L., Akinade, O., Bilal, M., and Owolabi, H. (2019). “Robotics and automated systems in construction: Understanding industry-specific challenges for adoption.” Journal of Building Engineering, 26, 100868.
Devlin, J., Chang, M. W., Lee, K., and Toutanova, K. (2018). “Bert: Pre-training of deep bidirectional transformers for language understanding.”.
Feng, C., Xiao, Y., Willette, A., McGee, W., and Kamat, V. R. (2015). “Vision guided autonomous robotic assembly and as-built scanning on unstructured construction sites.” Automation in Construction, 59, 128–138.
Hatori, J., Kikuchi, Y., Kobayashi, S., Takahashi, K., Tsuboi, Y., Unno, Y., and Tan, J. (2018). “Interactively picking real-world objects with unconstrained spoken language instructions.” In 2018 IEEE International Conference on Robotics and Automation (ICRA), 3774–3781.
Huang, Z., Xu, W., and Yu, K. (2015). “Bidirectional LSTM-CRF models for sequence tagging.”.
Magassouba, A., Sugiura, K., Quoc, A. T., and Kawai, H. (2019). “Understanding natural language instructions for fetching daily objects using gan-based multimodal target–source classification.” IEEE Robotics and Automation Letters, 4(4), 3884–3891.
Maurtua, I., Fernandez, I., Tellaeche, A., Kildal, J., Susperregi, L., Ibarguren, A., and Sierra, B. (2017). “Natural multimodal communication for human–robot collaboration.” International Journal of Advanced Robotic Systems, 14(4), 1729881417716043.
Murray, M., and Cakmak, M. (2022). “Following natural language instructions for household tasks with landmark guided search and reinforced pose adjustment.” IEEE Robotics and Automation Letters, 7(3), 6870–6877.
Park, S., Wang, X., Menassa, C. C., Kamat, V. R., and Chai, J. Y. (2023). “Natural Language Instructions for Intuitive Human Interaction with Robotic Assistants for Pick and Place Construction Operations.” Journal of Computing in Civil Engineering, (Tentatively Accepted; In-Re-Review).
Pan, M., Linner, T., Pan, W., Cheng, H. M., and Bock, T. (2020). “Influencing factors of the future utilisation of construction robots for buildings: A Hong Kong perspective.” Journal of Building Engineering, 30, 101220.
Villani, V., Pini, F., Leali, F., and Secchi, C. (2018). “Survey on human–robot collaboration in industrial settings: Safety, intuitive interfaces and applications.” Mechatronics, 55, 248–266.
Information & Authors
Information
Published In
Computing in Civil Engineering 2023
Pages: 453 - 460
History
Published online: Jan 25, 2024
ASCE Technical Topics:
- Automation and robotics
- Business management
- Construction engineering
- Construction industry
- Construction management
- Employee compensation and benefits
- Employment
- Engineering fundamentals
- Human and behavioral factors
- Joints
- Labor
- Personnel management
- Practice and Profession
- Productivity
- Structural engineering
- Structural members
- Structural systems
- Systems engineering
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.