Exploring Task Performance and User's Preference of Mid-air Hand Interaction in a 3D Docking Task Experiment

Marco Speicher, Florian Daiber, Gian-Luca Kiefer, Antonio Krüger

In: Proceedings of the 5th ACM International Symposium on Spatial User Interaction. ACM Symposium on Spatial User Interaction (SUI-17) SUI '17 ISBN 978-1-4503-5486-8 ACM 10/2017.


While the technology for input (Leap Motion, Kinect, etc.) as well as output (VR headsets, large projection walls, etc.) is market ready, only few solutions for natural interaction with such devices exist. With regard to natural 3D interaction, the human hand seems to be the ideal tool for direct manipulation. But, 3D interaction require more complex interaction techniques, which consequently cause higher levels of user instrumentation~\cite{griffith2001role} and workload, such as physical demand or frustration. Here, a VR approach might be beneficial to the user's preference. Lubos et al. investigated mid-air 3D selection in VR and showed that users performed better when the are in a comfortable pose. In this poster we propose an approach for mid-air hand interaction with 3D content in a furniture arrangement scenario. We evaluate our technique in a 3D docking task on a large projected display versus wearing a VR headset. Our experimental results show that the translation and rotation precision benefits from the usage of a projection wall, whereas the participants preferred the HMD with regard to user experience and task workload.


Weitere Links

exploring-task-performance.pdf (pdf, 576 KB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence