Virtual grasping feedback and virtual hand ownership

Ryan Canales, Aline Normoyle, Yu Sun, Yuting Ye, Max Di Luca, Sophie Joerg

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)


In this work, we investigate the influence of different visualizations on a manipulation task in virtual reality (VR). Without the haptic feedback of the real world, grasping in VR might result in intersections with virtual objects. As people are highly sensitive when it comes to perceiving collisions, it might look more appealing to avoid intersections and visualize non-colliding hand motions. However, correcting the position of the hand or fingers results in a visual-proprioceptive discrepancy and must be used with caution. Furthermore, the lack of haptic feedback in the virtual world might result in slower actions as a user might not know exactly when a grasp has occurred. This reduced performance could be remediated with adequate visual feedback. In this study, we analyze the performance, level of ownership, and user preference of eight different visual feedback techniques for virtual grasping. Three techniques show the tracked hand (with or without grasping feedback), even if it intersects with the grasped object. Another three techniques display a hand without intersections with the object, called outer hand, simulating the look of a real world interaction. One visualization is a compromise between the two groups, showing both a primary outer hand and a secondary tracked hand. Finally, in the last visualization the hand disappears during the grasping activity. In an experiment, users perform a pick-and-place task for each feedback technique. We use high fidelity marker-based hand tracking to control the virtual hands in real time. We found that the tracked hand visualizations result in better performance, however, the outer hand visualizations were preferred. We also find indications that ownership is higher with the outer hand visualizations.

Original languageEnglish
Title of host publicationProceeding SAP '19 ACM Symposium on Applied Perception 2019
ISBN (Electronic)9781450368902
Publication statusPublished - 19 Sept 2019
EventACM Symposium on Applied Perception - University of Barcelona, Barcelona, Spain
Duration: 19 Sept 201920 Sept 2019


ConferenceACM Symposium on Applied Perception
Abbreviated titleSAP 2019


Dive into the research topics of 'Virtual grasping feedback and virtual hand ownership'. Together they form a unique fingerprint.

Cite this