Multimodal Dialog in the Car: Combining Speech and Turn-And-Push Dial to Control Comfort Functions

Sandro Castronovo, Angela Mahr, Christian Müller

In: Proceedings of Interspeech 2010. Conference in the Annual Series of Interspeech Events (INTERSPEECH-2010) September 26-30 Makuhari Japan ISCA Makuhari, Japan 9/2010.


In this paper, we address the question how speech and tangible interfaces can be combined in order to provide effective multimodal interaction in vehicles, taking into account the special requirements induced by the circumstances of driving. Speech is used to set the interaction context (determine the object as is to be manipulated) and a turn-and-push dial is used to manipulate/ adjust. An experimental study is presented that measures the distraction induced by manual (conventional), speech-only, and multimodal interaction (combination of speech and turnand- push dial). Results show that while subjects where able to perform more tasks in the manual condition, their driving was significantly safer while using speech-only or multimodal dialog. Supplemental contributions of this paper are descriptions of how a multimodal dialog manager as well as a driving simulation software are connected to the CAN (Controller Area Network) vehicle bus as well as how driver distraction caused by interacting with a system are measured using the standardized lane change task (LCT)

p40703_(1).pdf (pdf, 339 KB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence