Socially Appropriate Robot Planning in Dynamic, Unseen Construction Environments
Publication: Computing in Civil Engineering 2023
ABSTRACT
With the advancement of robotic technologies, an increasing number of robots are envisioned to be deployed in various human-occupied environments such as construction job sites. Although navigation in a static environment is well studied, navigation in such a dynamic environment is still a challenging problem. In particular, construction environments present many challenges as they are often densely populated with both static and dynamic objects (e.g., stocked materials, workers, and equipment). Thus, robots in the construction environment should be capable of adapting to frequent layout changes and dynamic human movements and producing efficient paths in unknown, dynamic environments accordingly. Given the safety-critical nature of the construction environment, it is also critical not to collide, distract, or interfere with workers when robots maneuver around human workers in the workplace. To accommodate this need, this study proposes a Reinforcement Learning (RL)-based navigation model that enables robots to adhere to appropriate safety proxemic considerations aligned with the social work convention of construction workplaces while following a globally planned trajectory. The result showed that our model could secure the respective minimum distance in contrast to the baseline model, which suffered in complex environments. These findings will contribute to building future construction mobile robots with social intelligence that can produce socially compliant and safe behaviors.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Afsari, K., S. Halder, M. Ensafi, S. DeVito, and J. Serdakowski. 2021. “Fundamentals and Prospects of Four-Legged Robot Application in Construction Progress Monitoring.” EPiC Series in Built Environment, 274–283. EasyChair.
van den Berg, J., S. J. Guy, M. Lin, and D. Manocha. 2011. “Reciprocal n-Body Collision Avoidance.” Robotics Research, Springer Tracts in Advanced Robotics, C. Pradalier, R. Siegwart, and G. Hirzinger, eds., 3–19. Berlin, Heidelberg: Springer Berlin Heidelberg.
Chen, C., Y. Liu, S. Kreiss, and A. Alahi. 2019. “Crowd-Robot Interaction: Crowd-Aware Robot Navigation With Attention-Based Deep Reinforcement Learning.” 2019 International Conference on Robotics and Automation (ICRA), 6015–6022.
Chen, Y. F., M. Everett, M. Liu, and J. P. How. 2018. “Socially Aware Motion Planning with Deep Reinforcement Learning.” arXiv:1703.08862 [cs].
Chen, Y., C. Liu, B. E. Shi, and M. Liu. 2020. “Robot Navigation in Crowds by Graph Convolutional Networks With Attention Learned From Human Gaze.” IEEE Robotics and Automation Letters, 5 (2): 2754–2761. https://doi.org/10.1109/LRA.2020.2972868.
Davila Delgado, J. M., L. Oyedele, A. Ajayi, L. Akanbi, O. Akinade, M. Bilal, and H. Owolabi. 2019. “Robotics and automated systems in construction: Understanding industry-specific challenges for adoption.” Journal of Building Engineering, 26: 100868. https://doi.org/10.1016/j.jobe.2019.100868.
Daza, M., D. Barrios-Aranibar, J. Diaz-Amado, Y. Cardinale, and J. Vilasboas. 2021. “An Approach of Social Navigation Based on Proxemics for Crowded Environments of Humans and Robots.” Micromachines, 12 (2): 193. Multidisciplinary Digital Publishing Institute. https://doi.org/10.3390/mi12020193.
Everett, M., Y. F. Chen, and J. P. How. 2018. “Motion Planning Among Dynamic, Decision-Making Agents with Deep Reinforcement Learning.” arXiv:1805.01956 [cs].
“From Proxemics Theory to Socially-Aware Navigation: A Survey | SpringerLink.” n.d. Accessed July 22, 2021. https://link.springer.com/article/10.1007/s12369-014-0251-1.
Hall, E. T., et al. 1968. “Proxemics [and Comments and Replies].” Current Anthropology, 9 (2/3): 83–108. [University of Chicago Press, Wenner-Gren Foundation for Anthropological Research].
Hall, E. T. (Edward T., 1914-2009. 1966. The hidden dimension. Garden City, N.Y.: Doubleday.
Helbing, D., and P. Molnar. 1995. “Social Force Model for Pedestrian Dynamics.” Phys. Rev. E, 51 (5): 4282–4286. https://doi.org/10.1103/PhysRevE.51.4282.
Inoue, R., T. Arai, Y. Toda, M. Tsujimoto, K. Taniguchi, and N. Kubota. 2019. “Intelligent Control for Illuminance Measurement by an Autonomous Mobile Robot.” 2019 IEEE International Conference on Advanced Robotics and its Social Impacts (ARSO), 270–274.
Izadi Moud, H., I. Flood, X. Zhang, B. Abbasnejad, P. Rahgozar, and M. McIntyre. 2021. “Quantitative Assessment of Proximity Risks Associated with Unmanned Aerial Vehicles in Construction.” Journal of Management in Engineering, 37 (1): 04020095. American Society of Civil Engineers. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000852.
Kim, Y. S., B. Lee, R. Murphy, and C. R. Ahn. 2021. “Context-appropriate Social Navigation in Various Density Construction Environment using Reinforcement Learning.” ISARC. Proceedings of the International Symposium on Automation and Robotics in Construction, 505–512. Waterloo, Canada: IAARC Publications.
Kollmitz, M., T. Koller, J. Boedecker, and W. Burgard. 2020. “Learning Human-Aware Robot Navigation from Physical Interaction via Inverse Reinforcement Learning.” 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 11025–11031.
Kretzschmar, H., M. Spies, C. Sprunk, and W. Burgard. 2016. “Socially compliant mobile robot navigation via inverse reinforcement learning.” The International Journal of Robotics Research, 35 (11): 1289–1307. SAGE Publications Ltd STM. https://doi.org/10.1177/0278364915619772.
Kruse, T., A. K. Pandey, R. Alami, and A. Kirsch. 2013. “Human-aware robot navigation: A survey.” Robotics and Autonomous Systems, 61 (12): 1726–1743. https://doi.org/10.1016/j.robot.2013.05.007.
Lee, M.-F. R., and T.-W. Chien. 2020. “Intelligent Robot for Worker Safety Surveillance: Deep Learning Perception and Visual Navigation.” 2020 International Conference on Advanced Robotics and Intelligent Systems (ARIS), 1–6.
Li, K., Y. Xu, J. Wang, and M. Q.-H. Meng. 2019. “SARL∗: Deep Reinforcement Learning based Human-Aware Navigation for Mobile Robot in Indoor Environments.” 2019 IEEE International Conference on Robotics and Biomimetics (ROBIO), 688–694.
Lindner, F., and C. Eschenbach. 2011. “Towards a Formalization of Social Spaces for Socially Aware Robots.” Spatial Information Theory, Lecture Notes in Computer Science, M. Egenhofer, N. Giudice, R. Moratz, and M. Worboys, eds., 283–303. Berlin, Heidelberg: Springer.
Moud, H. I., I. Flood, C. Capano, Y. Zhang, and B. Abbasnejad. 2020. “Safety of Ground Robot Operations in Construction Job Sites: A Qualitative Approach.” Construction Research Congress 2020, 1327–1335. Tempe, Arizona: American Society of Civil Engineers.
Moud, H. I., I. Flood, A. Shojaei, Y. Zhang, X. Zhang, M. Tadayon, and M. Hatami. 2019. Qualitative Assessment of Indirect Risks Associated with Unmanned Aerial Vehicle Flights over Construction Job Sites. 83–89. American Society of Civil Engineers. https://doi.org/10.1061/9780784482445.011.
Pérez-D’Arpino, C., C. Liu, P. Goebel, R. Martín-Martín, and S. Savarese. 2020. “Robot Navigation in Constrained Pedestrian Environments using Reinforcement Learning.” arXiv:2010.08600 [cs].
“Robot navigation in dense human crowds: Statistical models and experimental studies of human–robot cooperation - Pete Trautman, Jeremy Ma, Richard M. Murray, Andreas Krause, 2015.” n.d. Accessed July 21, 2021. https://journals.sagepub.com/doi/abs/10.1177/0278364914557874.
“RVO2 Library - Reciprocal Collision Avoidance for Real-Time Multi-Agent Simulation.” n.d. RVO2 Library - Reciprocal Collision Avoidance for Real-Time Multi-Agent Simulation. Accessed May 2, 2021. https://gamma.cs.unc.edu/RVO2/.
Shen, X., E. Marks, N. Pradhananga, and T. Cheng. 2016. “Hazardous Proximity Zone Design for Heavy Construction Excavation Equipment.” Journal of Construction Engineering and Management, 142 (6): 05016001. American Society of Civil Engineers. https://doi.org/10.1061/(ASCE)CO.1943-7862.00u01108.
Information & Authors
Information
Published In
History
Published online: Jan 25, 2024
ASCE Technical Topics:
- Automation and robotics
- Business management
- Construction engineering
- Construction management
- Construction sites
- Employment
- Engineering fundamentals
- Geomatics
- Human and behavioral factors
- Labor
- Navigation (geomatic)
- Occupational safety
- Personnel management
- Practice and Profession
- Public administration
- Public health and safety
- Safety
- Social factors
- Systems engineering
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.