The effect of hand size and interaction modality on the virtual hand illusion

Lorraine Lin; Aline Normoyle; Alexandra Adkins; Yu Sun; Andrew Robb; Yuting Ye; Max Di Luca; Sophie Joerg

The effect of hand size and interaction modality on the virtual hand illusion

Lorraine Lin, Aline Normoyle, Alexandra Adkins, Yu Sun, Andrew Robb, Yuting Ye, Max Di Luca, Sophie Joerg

Psychology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

14 Citations (Scopus)

472 Downloads (Pure)

Abstract

Most commercial virtual reality applications with self avatars provide users with a 'one-size fits all' avatar. While the height of this body may be scaled to the user's height, other body proportions, such as limb length and hand size, are rarely customized to fit an individual user. Prior research has shown that mismatches between users' avatars and their actual bodies can affect size perception and feelings of body ownership. In this paper, we consider how concepts related to the virtual hand illusion, user experience, and task efficiency are influenced by variations between the size of a user's actual hand and their avatar's hand. We also consider how using a tracked controller or tracked gestures affect these concepts. We conducted a 2×3 within-subjects study (n=20), with two levels of input modality: Using tracked finger motion vs. a hand-held controller (Glove vs. Controller), and three levels of hand scaling (Small, Fit, and Large). Participants completed 2 block-assembly trials for each condition (for a total of 12 trials). Time, mistakes, and a user experience survey were recorded for each trial. Participants experienced stronger feelings of ownership and realism in the Glove condition. Efficiency was higher in the Controller condition and supported by play data of more time spent, blocks grabbed, and blocks dropped in the Glove condition. We did not find enough evidence for a change in agency and the intensity of the virtual hand illusion depending on hand size. Over half of the participants indicated preferring the Glove condition over the Controller condition, mentioning fun and efficiency as factors in their choices. Preferences on hand scaling were mixed but often attributed to efficiency. Participants liked the appearance of their virtual hand more while using the Fit instead of Large hands. Several interaction effects were observed between input modality and hand scaling, for example, for smaller hands, tracked hands evoked stronger feelings of ownership compared to using a controller. Our results show that the virtual hand illusion is stronger when participants are able to control a hand directly rather than with a hand-held device, and that the virtual reality task must first be considered to determine which modality and hand size are the most applicable.

Original language	English
Title of host publication	Proceedings of the IEEE Virtual Reality 2019 Conference
Publisher	Institute of Electrical and Electronics Engineers (IEEE)
Pages	510 - 518
Number of pages	9
ISBN (Electronic)	978-1-7281-1377-7
ISBN (Print)	978-1-7281-1378-4 (PoD)
Publication status	Published - 15 Aug 2019
Event	IEEE VR 2019: the 26th IEEE Conference on Virtual Reality and 3D User Interfaces - Osaka, Japan Duration: 23 Mar 2019 → 27 Mar 2019

Publication series

Name	IEEE Conference on Virtual Reality and 3D User Interfaces (VR)
ISSN (Print)	2642-5246
ISSN (Electronic)	2642-5254

Conference

Conference	IEEE VR 2019
Abbreviated title	IEEE VR 2019
Country/Territory	Japan
City	Osaka
Period	23/03/19 → 27/03/19

Keywords

Human-centered computing—Virtual reality Humancentered computing—Gestural inpu
Human-centered computing— Interaction design
Computing methodologies—Perception

Access to Document

Lorraine_Lin_et_al_The_effect_of_hand_size_and_interaction_modality_on_the_virtual_hand_illusion_VR_2019
Checked for eligibility: 22/07/2019 © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. L. Lin et al., "The Effect of Hand Size and Interaction Modality on the Virtual Hand Illusion," 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Osaka, Japan, 2019, pp. 510-518. doi: 10.1109/VR.2019.8797787
Accepted author manuscript, 7.67 MBLicence: Other (please specify with Rights Statement)

Perceptual research - Facebook
Massimiliano Di Luca (Contributor)
1 Jul 2016 → 16 Aug 2019
Activity: Academic and Industrial events › Industry event

Cite this

Lin, L., Normoyle, A., Adkins, A., Sun, Y., Robb, A., Ye, Y., Di Luca, M., & Joerg, S. (2019). The effect of hand size and interaction modality on the virtual hand illusion. In Proceedings of the IEEE Virtual Reality 2019 Conference (pp. 510 - 518). (IEEE Conference on Virtual Reality and 3D User Interfaces (VR)). Institute of Electrical and Electronics Engineers (IEEE).

@inproceedings{e0a8d023bb3040f8af7622b6b7576e0b,

title = "The effect of hand size and interaction modality on the virtual hand illusion",

abstract = "Most commercial virtual reality applications with self avatars provide users with a 'one-size fits all' avatar. While the height of this body may be scaled to the user's height, other body proportions, such as limb length and hand size, are rarely customized to fit an individual user. Prior research has shown that mismatches between users' avatars and their actual bodies can affect size perception and feelings of body ownership. In this paper, we consider how concepts related to the virtual hand illusion, user experience, and task efficiency are influenced by variations between the size of a user's actual hand and their avatar's hand. We also consider how using a tracked controller or tracked gestures affect these concepts. We conducted a 2×3 within-subjects study (n=20), with two levels of input modality: Using tracked finger motion vs. a hand-held controller (Glove vs. Controller), and three levels of hand scaling (Small, Fit, and Large). Participants completed 2 block-assembly trials for each condition (for a total of 12 trials). Time, mistakes, and a user experience survey were recorded for each trial. Participants experienced stronger feelings of ownership and realism in the Glove condition. Efficiency was higher in the Controller condition and supported by play data of more time spent, blocks grabbed, and blocks dropped in the Glove condition. We did not find enough evidence for a change in agency and the intensity of the virtual hand illusion depending on hand size. Over half of the participants indicated preferring the Glove condition over the Controller condition, mentioning fun and efficiency as factors in their choices. Preferences on hand scaling were mixed but often attributed to efficiency. Participants liked the appearance of their virtual hand more while using the Fit instead of Large hands. Several interaction effects were observed between input modality and hand scaling, for example, for smaller hands, tracked hands evoked stronger feelings of ownership compared to using a controller. Our results show that the virtual hand illusion is stronger when participants are able to control a hand directly rather than with a hand-held device, and that the virtual reality task must first be considered to determine which modality and hand size are the most applicable.",

keywords = "Human-centered computing—Virtual reality Humancentered computing—Gestural inpu, Human-centered computing— Interaction design, Computing methodologies—Perception",

author = "Lorraine Lin and Aline Normoyle and Alexandra Adkins and Yu Sun and Andrew Robb and Yuting Ye and {Di Luca}, Max and Sophie Joerg",

year = "2019",

month = aug,

day = "15",

language = "English",

isbn = "978-1-7281-1378-4 (PoD)",

series = "IEEE Conference on Virtual Reality and 3D User Interfaces (VR)",

publisher = "Institute of Electrical and Electronics Engineers (IEEE)",

pages = "510 -- 518",

booktitle = "Proceedings of the IEEE Virtual Reality 2019 Conference",

note = "IEEE VR 2019 : the 26th IEEE Conference on Virtual Reality and 3D User Interfaces, IEEE VR 2019 ; Conference date: 23-03-2019 Through 27-03-2019",

}

Lin, L, Normoyle, A, Adkins, A, Sun, Y, Robb, A, Ye, Y, Di Luca, M & Joerg, S 2019, The effect of hand size and interaction modality on the virtual hand illusion. in Proceedings of the IEEE Virtual Reality 2019 Conference. IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Institute of Electrical and Electronics Engineers (IEEE), pp. 510 - 518, IEEE VR 2019, Osaka, Japan, 23/03/19.

The effect of hand size and interaction modality on the virtual hand illusion. / Lin, Lorraine; Normoyle, Aline; Adkins, Alexandra et al.
Proceedings of the IEEE Virtual Reality 2019 Conference. Institute of Electrical and Electronics Engineers (IEEE), 2019. p. 510 - 518 (IEEE Conference on Virtual Reality and 3D User Interfaces (VR)).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - The effect of hand size and interaction modality on the virtual hand illusion

AU - Lin, Lorraine

AU - Normoyle, Aline

AU - Adkins, Alexandra

AU - Sun, Yu

AU - Robb, Andrew

AU - Ye, Yuting

AU - Di Luca, Max

AU - Joerg, Sophie

PY - 2019/8/15

Y1 - 2019/8/15

N2 - Most commercial virtual reality applications with self avatars provide users with a 'one-size fits all' avatar. While the height of this body may be scaled to the user's height, other body proportions, such as limb length and hand size, are rarely customized to fit an individual user. Prior research has shown that mismatches between users' avatars and their actual bodies can affect size perception and feelings of body ownership. In this paper, we consider how concepts related to the virtual hand illusion, user experience, and task efficiency are influenced by variations between the size of a user's actual hand and their avatar's hand. We also consider how using a tracked controller or tracked gestures affect these concepts. We conducted a 2×3 within-subjects study (n=20), with two levels of input modality: Using tracked finger motion vs. a hand-held controller (Glove vs. Controller), and three levels of hand scaling (Small, Fit, and Large). Participants completed 2 block-assembly trials for each condition (for a total of 12 trials). Time, mistakes, and a user experience survey were recorded for each trial. Participants experienced stronger feelings of ownership and realism in the Glove condition. Efficiency was higher in the Controller condition and supported by play data of more time spent, blocks grabbed, and blocks dropped in the Glove condition. We did not find enough evidence for a change in agency and the intensity of the virtual hand illusion depending on hand size. Over half of the participants indicated preferring the Glove condition over the Controller condition, mentioning fun and efficiency as factors in their choices. Preferences on hand scaling were mixed but often attributed to efficiency. Participants liked the appearance of their virtual hand more while using the Fit instead of Large hands. Several interaction effects were observed between input modality and hand scaling, for example, for smaller hands, tracked hands evoked stronger feelings of ownership compared to using a controller. Our results show that the virtual hand illusion is stronger when participants are able to control a hand directly rather than with a hand-held device, and that the virtual reality task must first be considered to determine which modality and hand size are the most applicable.

AB - Most commercial virtual reality applications with self avatars provide users with a 'one-size fits all' avatar. While the height of this body may be scaled to the user's height, other body proportions, such as limb length and hand size, are rarely customized to fit an individual user. Prior research has shown that mismatches between users' avatars and their actual bodies can affect size perception and feelings of body ownership. In this paper, we consider how concepts related to the virtual hand illusion, user experience, and task efficiency are influenced by variations between the size of a user's actual hand and their avatar's hand. We also consider how using a tracked controller or tracked gestures affect these concepts. We conducted a 2×3 within-subjects study (n=20), with two levels of input modality: Using tracked finger motion vs. a hand-held controller (Glove vs. Controller), and three levels of hand scaling (Small, Fit, and Large). Participants completed 2 block-assembly trials for each condition (for a total of 12 trials). Time, mistakes, and a user experience survey were recorded for each trial. Participants experienced stronger feelings of ownership and realism in the Glove condition. Efficiency was higher in the Controller condition and supported by play data of more time spent, blocks grabbed, and blocks dropped in the Glove condition. We did not find enough evidence for a change in agency and the intensity of the virtual hand illusion depending on hand size. Over half of the participants indicated preferring the Glove condition over the Controller condition, mentioning fun and efficiency as factors in their choices. Preferences on hand scaling were mixed but often attributed to efficiency. Participants liked the appearance of their virtual hand more while using the Fit instead of Large hands. Several interaction effects were observed between input modality and hand scaling, for example, for smaller hands, tracked hands evoked stronger feelings of ownership compared to using a controller. Our results show that the virtual hand illusion is stronger when participants are able to control a hand directly rather than with a hand-held device, and that the virtual reality task must first be considered to determine which modality and hand size are the most applicable.

KW - Human-centered computing—Virtual reality Humancentered computing—Gestural inpu

KW - Human-centered computing— Interaction design

KW - Computing methodologies—Perception

UR - https://research.fb.com/publications/the-effect-of-hand-size-and-interaction-modality-on-the-virtual-hand-illusion/

UR - http://ieeevr.org/2019/program/papers.html#papers2

M3 - Conference contribution

SN - 978-1-7281-1378-4 (PoD)

T3 - IEEE Conference on Virtual Reality and 3D User Interfaces (VR)

SP - 510

EP - 518

BT - Proceedings of the IEEE Virtual Reality 2019 Conference

PB - Institute of Electrical and Electronics Engineers (IEEE)

T2 - IEEE VR 2019

Y2 - 23 March 2019 through 27 March 2019

ER -

The effect of hand size and interaction modality on the virtual hand illusion

Abstract

Publication series

Conference

Keywords

Access to Document

Fingerprint

Activities

Perceptual research - Facebook

Cite this