Homogeneous Multimodal Access to the Digital Home for People with Cognitive Disabilities

Robert Neßelrath, Christian Husodo Schulz, Jan Schehl, Alexander Pfalzgraf, Norbert Pfleger, Verena Stein, Jan Alexandersson

In: Ambient Assisted Living 2009. Deutscher AAL-Kongress (AAL-09) 2. Deutscher AAL-Kongress mit Ausstellung / Technologien - Anwendungen January 27-28 Berlin Germany ISBN 978-3-8007-3138-1 VDE 2009.


This paper introduces a multimodal dialogue system, which facilitates access to the digital home for people who suffer from cognitive disabilities. The user interface is implemented on a smartphone and allows interaction via speech and pointing gestures. A consistent control concept and a meaningful graphical design allow an intuitive handling of the device. The ISO standard URC enables the system to supervise and control heterogeneous home devices. One focal point is collaborative problem solving which supports users with memory deficits in planning and pursuing objectives. Furthermore, the reaction of the system is adapted to user and interaction context.

17.4_Nesselrath-Robert.pdf (pdf, 346 KB )

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz