In the Blink of an Eye: Combining Head Motion and Eye Blink Frequency for Activity Recognition with Google Glass

Shoya Ishimaru, Kai Kunze, Koichi Kise, Jens Weppner, Andreas Dengel, Paul Lukowicz, Andreas Bulling

In: Proceedings of the 5th Augmented Human International Conference. Augmented Human International Conference (AH-14) 5th March 7-9 Kobe Japan Seiten 15-1 ISBN 978-1-4503-2761-9 ACM 2014.


We demonstrate how information about eye blink frequency and head motion patterns derived from Google Glass sensors can be used to distinguish different types of high level activities. While it is well known that eye blink frequency is correlated with user activity, our aim is to show that (1) eye blink frequency data from an unobtrusive, commercial platform which is not a dedicated eye tracker is good enough to be useful and (2) that adding head motion patterns information significantly improves the recognition rates. The method is evaluated on a data set from an experiment containing five activity classes (reading, talking, watching TV, mathematical problem solving, and sawing) of eight participants showing 67% recognition accuracy for eye blinking only and 82% when extended with head motion patterns.

Weitere Links

Augmented_Human_2014_-_In_the_Blink_of_an_Eye.pdf (pdf, 1 MB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence