Chapter
Jan 25, 2024

Socially Appropriate Robot Planning in Dynamic, Unseen Construction Environments

Publication: Computing in Civil Engineering 2023

ABSTRACT

With the advancement of robotic technologies, an increasing number of robots are envisioned to be deployed in various human-occupied environments such as construction job sites. Although navigation in a static environment is well studied, navigation in such a dynamic environment is still a challenging problem. In particular, construction environments present many challenges as they are often densely populated with both static and dynamic objects (e.g., stocked materials, workers, and equipment). Thus, robots in the construction environment should be capable of adapting to frequent layout changes and dynamic human movements and producing efficient paths in unknown, dynamic environments accordingly. Given the safety-critical nature of the construction environment, it is also critical not to collide, distract, or interfere with workers when robots maneuver around human workers in the workplace. To accommodate this need, this study proposes a Reinforcement Learning (RL)-based navigation model that enables robots to adhere to appropriate safety proxemic considerations aligned with the social work convention of construction workplaces while following a globally planned trajectory. The result showed that our model could secure the respective minimum distance in contrast to the baseline model, which suffered in complex environments. These findings will contribute to building future construction mobile robots with social intelligence that can produce socially compliant and safe behaviors.

Get full access to this article

View all available purchase options and get full access to this chapter.

REFERENCES

Afsari, K., S. Halder, M. Ensafi, S. DeVito, and J. Serdakowski. 2021. “Fundamentals and Prospects of Four-Legged Robot Application in Construction Progress Monitoring.” EPiC Series in Built Environment, 274–283. EasyChair.
van den Berg, J., S. J. Guy, M. Lin, and D. Manocha. 2011. “Reciprocal n-Body Collision Avoidance.” Robotics Research, Springer Tracts in Advanced Robotics, C. Pradalier, R. Siegwart, and G. Hirzinger, eds., 3–19. Berlin, Heidelberg: Springer Berlin Heidelberg.
Chen, C., Y. Liu, S. Kreiss, and A. Alahi. 2019. “Crowd-Robot Interaction: Crowd-Aware Robot Navigation With Attention-Based Deep Reinforcement Learning.” 2019 International Conference on Robotics and Automation (ICRA), 6015–6022.
Chen, Y. F., M. Everett, M. Liu, and J. P. How. 2018. “Socially Aware Motion Planning with Deep Reinforcement Learning.” arXiv:1703.08862 [cs].
Chen, Y., C. Liu, B. E. Shi, and M. Liu. 2020. “Robot Navigation in Crowds by Graph Convolutional Networks With Attention Learned From Human Gaze.” IEEE Robotics and Automation Letters, 5 (2): 2754–2761. https://doi.org/10.1109/LRA.2020.2972868.
Davila Delgado, J. M., L. Oyedele, A. Ajayi, L. Akanbi, O. Akinade, M. Bilal, and H. Owolabi. 2019. “Robotics and automated systems in construction: Understanding industry-specific challenges for adoption.” Journal of Building Engineering, 26: 100868. https://doi.org/10.1016/j.jobe.2019.100868.
Daza, M., D. Barrios-Aranibar, J. Diaz-Amado, Y. Cardinale, and J. Vilasboas. 2021. “An Approach of Social Navigation Based on Proxemics for Crowded Environments of Humans and Robots.” Micromachines, 12 (2): 193. Multidisciplinary Digital Publishing Institute. https://doi.org/10.3390/mi12020193.
Everett, M., Y. F. Chen, and J. P. How. 2018. “Motion Planning Among Dynamic, Decision-Making Agents with Deep Reinforcement Learning.” arXiv:1805.01956 [cs].
“From Proxemics Theory to Socially-Aware Navigation: A Survey | SpringerLink.” n.d. Accessed July 22, 2021. https://link.springer.com/article/10.1007/s12369-014-0251-1.
Hall, E. T., et al. 1968. “Proxemics [and Comments and Replies].” Current Anthropology, 9 (2/3): 83–108. [University of Chicago Press, Wenner-Gren Foundation for Anthropological Research].
Hall, E. T. (Edward T., 1914-2009. 1966. The hidden dimension. Garden City, N.Y.: Doubleday.
Helbing, D., and P. Molnar. 1995. “Social Force Model for Pedestrian Dynamics.” Phys. Rev. E, 51 (5): 4282–4286. https://doi.org/10.1103/PhysRevE.51.4282.
Inoue, R., T. Arai, Y. Toda, M. Tsujimoto, K. Taniguchi, and N. Kubota. 2019. “Intelligent Control for Illuminance Measurement by an Autonomous Mobile Robot.” 2019 IEEE International Conference on Advanced Robotics and its Social Impacts (ARSO), 270–274.
Izadi Moud, H., I. Flood, X. Zhang, B. Abbasnejad, P. Rahgozar, and M. McIntyre. 2021. “Quantitative Assessment of Proximity Risks Associated with Unmanned Aerial Vehicles in Construction.” Journal of Management in Engineering, 37 (1): 04020095. American Society of Civil Engineers. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000852.
Kim, Y. S., B. Lee, R. Murphy, and C. R. Ahn. 2021. “Context-appropriate Social Navigation in Various Density Construction Environment using Reinforcement Learning.” ISARC. Proceedings of the International Symposium on Automation and Robotics in Construction, 505–512. Waterloo, Canada: IAARC Publications.
Kollmitz, M., T. Koller, J. Boedecker, and W. Burgard. 2020. “Learning Human-Aware Robot Navigation from Physical Interaction via Inverse Reinforcement Learning.” 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 11025–11031.
Kretzschmar, H., M. Spies, C. Sprunk, and W. Burgard. 2016. “Socially compliant mobile robot navigation via inverse reinforcement learning.” The International Journal of Robotics Research, 35 (11): 1289–1307. SAGE Publications Ltd STM. https://doi.org/10.1177/0278364915619772.
Kruse, T., A. K. Pandey, R. Alami, and A. Kirsch. 2013. “Human-aware robot navigation: A survey.” Robotics and Autonomous Systems, 61 (12): 1726–1743. https://doi.org/10.1016/j.robot.2013.05.007.
Lee, M.-F. R., and T.-W. Chien. 2020. “Intelligent Robot for Worker Safety Surveillance: Deep Learning Perception and Visual Navigation.” 2020 International Conference on Advanced Robotics and Intelligent Systems (ARIS), 1–6.
Li, K., Y. Xu, J. Wang, and M. Q.-H. Meng. 2019. “SARL∗: Deep Reinforcement Learning based Human-Aware Navigation for Mobile Robot in Indoor Environments.” 2019 IEEE International Conference on Robotics and Biomimetics (ROBIO), 688–694.
Lindner, F., and C. Eschenbach. 2011. “Towards a Formalization of Social Spaces for Socially Aware Robots.” Spatial Information Theory, Lecture Notes in Computer Science, M. Egenhofer, N. Giudice, R. Moratz, and M. Worboys, eds., 283–303. Berlin, Heidelberg: Springer.
Moud, H. I., I. Flood, C. Capano, Y. Zhang, and B. Abbasnejad. 2020. “Safety of Ground Robot Operations in Construction Job Sites: A Qualitative Approach.” Construction Research Congress 2020, 1327–1335. Tempe, Arizona: American Society of Civil Engineers.
Moud, H. I., I. Flood, A. Shojaei, Y. Zhang, X. Zhang, M. Tadayon, and M. Hatami. 2019. Qualitative Assessment of Indirect Risks Associated with Unmanned Aerial Vehicle Flights over Construction Job Sites. 83–89. American Society of Civil Engineers. https://doi.org/10.1061/9780784482445.011.
Pérez-D’Arpino, C., C. Liu, P. Goebel, R. Martín-Martín, and S. Savarese. 2020. “Robot Navigation in Constrained Pedestrian Environments using Reinforcement Learning.” arXiv:2010.08600 [cs].
“Robot navigation in dense human crowds: Statistical models and experimental studies of human–robot cooperation - Pete Trautman, Jeremy Ma, Richard M. Murray, Andreas Krause, 2015.” n.d. Accessed July 21, 2021. https://journals.sagepub.com/doi/abs/10.1177/0278364914557874.
“RVO2 Library - Reciprocal Collision Avoidance for Real-Time Multi-Agent Simulation.” n.d. RVO2 Library - Reciprocal Collision Avoidance for Real-Time Multi-Agent Simulation. Accessed May 2, 2021. https://gamma.cs.unc.edu/RVO2/.
Shen, X., E. Marks, N. Pradhananga, and T. Cheng. 2016. “Hazardous Proximity Zone Design for Heavy Construction Excavation Equipment.” Journal of Construction Engineering and Management, 142 (6): 05016001. American Society of Civil Engineers. https://doi.org/10.1061/(ASCE)CO.1943-7862.00u01108.

Information & Authors

Information

Published In

Go to Computing in Civil Engineering 2023
Computing in Civil Engineering 2023
Pages: 588 - 596

History

Published online: Jan 25, 2024

Permissions

Request permissions for this article.

ASCE Technical Topics:

Authors

Affiliations

1School of Civil and Environmental Engineering, Georgia Institute of Technology. Email: [email protected]
Andrew Yarovoi [email protected]
2Institute for Robotics and Intelligent Machines, Georgia Institute of Technology. Email: [email protected]
Yong Han Ahn [email protected]
3Professor, Dept. of Smart City Engineering, Hanyang Univ., South Korea. Email: [email protected]
Yong K. Cho [email protected]
4Professor, School of Civil and Environmental Engineering, Georgia Institute of Technology. Email: [email protected]

Metrics & Citations

Metrics

Citations

Download citation

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

View Options

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Paper
$35.00
Add to cart
Buy E-book
$198.00
Add to cart

Get Access

Access content

Please select your options to get access

Log in/Register Log in via your institution (Shibboleth)
ASCE Members: Please log in to see member pricing

Purchase

Save for later Information on ASCE Library Cards
ASCE Library Cards let you download journal articles, proceedings papers, and available book chapters across the entire ASCE Library platform. ASCE Library Cards remain active for 24 months or until all downloads are used. Note: This content will be debited as one download at time of checkout.

Terms of Use: ASCE Library Cards are for individual, personal use only. Reselling, republishing, or forwarding the materials to libraries or reading rooms is prohibited.
ASCE Library Card (5 downloads)
$105.00
Add to cart
ASCE Library Card (20 downloads)
$280.00
Add to cart
Buy Single Paper
$35.00
Add to cart
Buy E-book
$198.00
Add to cart

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share