Team communication processing and process analytics for supporting robot-assisted emergency response

Christian Willms, Constantin Houy, Jana-Rebecca Rehse, Peter Fettke, Ivana Kruijff-Korbayová

In: Proceedings of 2019 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR). IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR-2019) September 2-4 Würzburg Germany IEEE 9/2019.


Mobile robots can provide significant operational advantages in emergency response missions. With increasing autonomy robots need knowledge of the current mission in order to be able to properly contribute to it. We propose to acquire mission knowledge by interpreting the verbal communication among the human response-team members and to use process mining techniques to ground the interpretations in analyses of mission process data and corresponding reference models. We also present a novel concept of mission assistance that uses the acquired mission knowledge to support the first responders' work processes both during and after the mission. The assistance functions include process assistance for the coordination of human-robot team operations; automatic mission documentation generation; and process modeling for first responder education. We describe the architecture of our system and the design and current implementation state of its components: Speech Processing, Mission-Knowledge Management, Process Mining, and Process Assistance. We build on concepts that were evaluated and validated by first responders in a previous project; our extensions have been assessed qualitatively and will be further evaluated in the course of our current project.


Final_SSRR2019_Supporting_human_robot_teams_in_large_scale_disaster_scenarios.pdf (pdf, 626 KB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence