(Simulated) listener gaze in real-time spoken interaction

Laura Frädrich, Fabrizio Nunnari, Maria Staudte, Alexis Heloir

In: Computer Animation and Virtual Worlds (CAVW) 29 3-4 e Page 1831 Wiley 2018.


Abstract Gaze is an important aspect of social communication. Previous research has concentrated mainly on the role of speaker gaze and listener gaze in isolation, neglecting the effect of the listener's gaze behavior on the speaker's behavior. This paper presents an exploratory eye-tracking study involving an interactive human-like agent following participants' gaze. This study demonstrates that a rather simple gaze-following mechanism convincingly simulates active listening behavior engaging the speaker. The study also highlights how speakers rely on their interlocutors' gaze when establishing common references.

Weitere Links

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz