Safe Human-Drone Interaction in Construction: Using Gesture Communication Modality
Publication: Computing in Civil Engineering 2023
ABSTRACT
The use of drones for construction applications is on the rise, but it also brings about new safety challenges for human workers in an already hazardous environment. To address these safety challenges, one potential solution is to allow workers to actively communicate with drones rather than passively observing them. To explore this idea, a series of gesture-based safety commands were developed. This would enable workers to communicate their safety needs to drones while working in close proximity. A pilot study was conducted with a small group of users to evaluate the feasibility of using gesture communication modality for safe human-drone interaction in a virtual construction scenario. User feedback was also gathered, providing valuable insights for future studies and improvements. The results of the study show that gesture-based communication has great potential for ensuring safety during human-drone interaction in construction environments.
Get full access to this article
View all available purchase options and get full access to this chapter.
REFERENCES
Albeaino, G., M. Gheisari, and R. R. A. Issa. 2022. “Human-Drone Interaction (HDI): Opportunities and Considerations in Construction.” Automation and Robotics in the Architecture, Engineering, and Construction Industry, H. Jebelli, M. Habibnezhad, S. Shayesteh, S. Asadi, and S. Lee, eds., 111–142. Cham: Springer International Publishing.
Cabral, M. C., C. H. Morimoto, and M. K. Zuffo. 2005. “On the usability of gesture interfaces in virtual reality environments.” Proceedings of the 2005 Latin American conference on Human-computer interaction, CLIHC ’05, 100–108. New York, NY, USA: Association for Computing Machinery.
Cauchard, J. R., J. L. E, K. Y. Zhai and J. A. Landay. 2015. “Drone & me: an exploration into natural human-drone interactiosn.” Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing, 361–365.
CPWR (The Center for Construction Research and Training). 2022. “CPWR | Construction Focus Four Dashboard.” CPWR |. Accessed February 23, 2023. https://www.cpwr.com/research/data-center/data-dashboards/construction-focus-four-dashboard/.
DJI. 2017. Spark user manual v1.6.
Hermann, J., M. Plückthun, A. Dogangün, and M. Hesenius. 2022. “User-Defined Gesture and Voice Control in Human-Drone Interaction for Police Operations.” Nordic Human-Computer Interaction Conference, 1–11. Aarhus Denmark: ACM.
Ikeuchi, K., T. Otsuka, A. Yoshii, M. Sakamoto, and T. Nakajima. 2014. “KinecDrone: enhancing somatic sensation to fly in the sky with Kinect and AR.Drone.” Proceedings of the 5th Augmented Human International Conference, AH ’14, 1–2. New York, NY, USA: Association for Computing Machinery.
Jeelani, I., and M. Gheisari. 2021. “Safety challenges of UAV integration in construction: Conceptual analysis and future research roadmap.” Safety Science, 144: 105473. https://doi.org/10.1016/j.ssci.2021.105473.
Mashood, A., H. Noura, I. Jawhar, and N. Mohamed. 2015. “A gesture based kinect for quadrotor control.” 2015 International Conference on Information and Communication Technology Research (ICTRC), 298–301.
Mirri, S., C. Prandi, and P. Salomoni. 2019. “Human-Drone Interaction: state of the art, open issues and challenges.” Proceedings of the ACM SIGCOMM 2019 Workshop on Mobile AirGround Edge Computing, Systems, Networks, and Applications, MAGESys’19, 43–48. New York, NY, USA: Association for Computing Machinery.
Obaid, M., F. Kistler, G. Kasparavičiūtė, A. E. Yantaç, and M. Fjeld. 2016. “How would you gesture navigate a drone? a user-centered approach to control a drone.” Proceedings of the 20th International Academic Mindtrek Conference, AcademicMindtrek ’16, 113–121. New York, NY, USA: Association for Computing Machinery.
Patrona, F., I. Mademlis, and I. Pitas. 2021. “An Overview of Hand Gesture Languages for Autonomous UAV Handling.” 2021 Aerial Robotic Systems Physically Interacting with the Environment (AIRPHARO), 1–7.
Sanna, A., F. Lamberti, G. Paravati, and F. Manuri. 2013. “A Kinect-based natural interface for quadrotor control.” Entertainment Computing, 4 (3): 179–186. https://doi.org/10.1016/j.entcom.2013.01.001.
Shin, S.-Y., Y.-W. Kang, and Y.-G. Kim. 2019. “Hand Gesture-based Wearable Human-Drone Interface for Intuitive Movement Control.” 2019 IEEE International Conference on Consumer Electronics (ICCE), 1–6.
Suárez Fernández, R. A., J. L. Sanchez-Lopez, C. Sampedro, H. Bavle, M. Molina, and P. Campoy. 2016. “Natural user interfaces for human-drone multi-modal interaction.” 2016 International Conference on Unmanned Aircraft Systems (ICUAS), 1013–1022.
Sun, T., S. Nie, D.-Y. Yeung, and S. Shen. 2017. “Gesture-based piloting of an aerial robot using monocular vision.” 2017 IEEE International Conference on Robotics and Automation (ICRA), 5913–5920.
Tezza, D., and M. Andujar. 2019. “The State-of-the-Art of Human–Drone Interaction: A Survey.” IEEE Access, 7: 167438–167454. https://doi.org/10.1109/ACCESS.2019.2953900.
Zhou, S., and M. Gheisari. 2018. “Unmanned aerial system applications in construction: a systematic review.” Construction Innovation, 18 (4): 453–468. Emerald Publishing Limited. https://doi.org/10.1108/CI-02-2018-0010.
Zhu, Z., I. Jeelani, and M. Gheisari. 2022. “Safety Risk Assessment of Drones on Construction Sites using 4D Simulation.” ISARC. Proceedings of the International Symposium on Automation and Robotics in Construction, 344–351. IAARC Publications.
Information & Authors
Information
Published In
Computing in Civil Engineering 2023
Pages: 564 - 570
History
Published online: Jan 25, 2024
ASCE Technical Topics:
- Business management
- Construction engineering
- Construction management
- Disaster risk management
- Employment
- Engineering fundamentals
- Feasibility studies
- Human and behavioral factors
- Labor
- Methodology (by type)
- Occupational safety
- Personnel management
- Practice and Profession
- Public administration
- Public health and safety
- Research methods (by type)
- Risk management
- Safety
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.