Tracking Pointing Gestures to Support Sales Conversations

Markus Löchtefeld, Sven Gehring, Johannes Schöning, Florian Daiber, Antonio Krüger

In: Adjunct Proceedings of the 28th International Conference on Human Factors in Computing Systems. Workshop on Performative Interaction in Public Spaces. ACM International Conference on Human Factors in Computing Systems (CHI-11) May 7-12 Vancouver BC Canada ACM 2011.


Meat and cheese counters are among the most important spots in a supermarket where employees interact with customers. Currently a lot of communication problems occur at these counters due to the distance between the customer and the service staff and the separation by the counter. Often it is ambiguous about what product the customer and the employees are talking about. Up to now, there are just a few efforts in HCI research, to enrich communication at the point of sale. In this paper we report and analyze the interactions and communications at a meat counter and introduce a prototype to ease the communication between customer and employees to higher customer satisfaction and decrease service times using a Microsoft Kinect.


Meat_Counter_Interaction.pdf (pdf, 3 MB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence