User study on 3D multitouch interaction (3DMi) and gaze on surface computing

Eugene Ch’ng; Neil Cooke

doi:10.1007/978-3-319-20898-5_41

User study on 3D multitouch interaction (3DMi) and gaze on surface computing

Eugene Ch’ng^*, Neil Cooke

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

On a multitouch table, user’s interactions with 3D virtual representations of real objects should be influenced by task and their perceived physical characteristics. This article explores the development and user study of an interactive 3D application that allows users to explore virtual heritage objects on a surface device. To-date, most multitouch has focused on 2D or 2.5D systems. A user-study is reported where we analyse their multimodal behaviour – specifically how they interact on a surface device with objects that have similar properties to physical versions and the users’ associated gaze patterns with touch.The study reveals that gaze characteristics are different according to their interaction intention in terms of position and duration of visual attention. We discovered that virtual objects afford the perception of haptic attributes ascribed to their equivalent physical objects, and that differences in the summary statistics of gaze showed consistent characteristics between people and differences between natural and task based activities. An awareness of user behaviours using natural gestures can inform the design of interactive 3D applications which complements the user’s model of past experience with physical objects and with GUI interaction.

Original language	English
Title of host publication	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Publisher	Springer
Pages	425-433
Number of pages	9
Volume	9187
ISBN (Print)	9783319208978
DOIs	https://doi.org/10.1007/978-3-319-20898-5_41
Publication status	Published - 21 Jul 2015
Event	4th International Conference on Design, User Experience and Usability, DUXU 2015 Held as Part of 17th International Conference on Human-Computer Interaction, HCI International 2015 - Los Angeles, United States Duration: 2 Aug 2015 → 7 Aug 2015

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	9187
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	4th International Conference on Design, User Experience and Usability, DUXU 2015 Held as Part of 17th International Conference on Human-Computer Interaction, HCI International 2015
Country/Territory	United States
City	Los Angeles
Period	2/08/15 → 7/08/15

Keywords

Digital heritage
Gaze tracking
Interactive 3D
Multitouch
Surface computing

ASJC Scopus subject areas

General Computer Science
Theoretical Computer Science

Access to Document

10.1007/978-3-319-20898-5_41

1 Citations
1 Conference contribution

User Study on 3D Multitouch interaction (3DMi) and Gaze on Surface Computing
Cooke, N. & Ch'ng, E., 2015, Design, User Experience, and Usability: Users and Interactions: 4th International Conference, DUXU 2015, Held as Part of HCI International 2015, Los Angeles, CA, USA, August 2-7, 2015, Proceedings, Part II. Springer, p. 425-433
Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Cite this

Ch’ng, E., & Cooke, N. (2015). User study on 3D multitouch interaction (3DMi) and gaze on surface computing. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 9187, pp. 425-433). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9187). Springer. https://doi.org/10.1007/978-3-319-20898-5_41

Ch’ng, Eugene ; Cooke, Neil. / User study on 3D multitouch interaction (3DMi) and gaze on surface computing. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 9187 Springer, 2015. pp. 425-433 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{ace01e5c0e96419697ca8fa3c96851bb,

title = "User study on 3D multitouch interaction (3DMi) and gaze on surface computing",

abstract = "On a multitouch table, user{\textquoteright}s interactions with 3D virtual representations of real objects should be influenced by task and their perceived physical characteristics. This article explores the development and user study of an interactive 3D application that allows users to explore virtual heritage objects on a surface device. To-date, most multitouch has focused on 2D or 2.5D systems. A user-study is reported where we analyse their multimodal behaviour – specifically how they interact on a surface device with objects that have similar properties to physical versions and the users{\textquoteright} associated gaze patterns with touch.The study reveals that gaze characteristics are different according to their interaction intention in terms of position and duration of visual attention. We discovered that virtual objects afford the perception of haptic attributes ascribed to their equivalent physical objects, and that differences in the summary statistics of gaze showed consistent characteristics between people and differences between natural and task based activities. An awareness of user behaviours using natural gestures can inform the design of interactive 3D applications which complements the user{\textquoteright}s model of past experience with physical objects and with GUI interaction.",

keywords = "Digital heritage, Gaze tracking, Interactive 3D, Multitouch, Surface computing",

author = "Eugene Ch{\textquoteright}ng and Neil Cooke",

year = "2015",

month = jul,

day = "21",

doi = "10.1007/978-3-319-20898-5_41",

language = "English",

isbn = "9783319208978",

volume = "9187",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer",

pages = "425--433",

booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

note = "4th International Conference on Design, User Experience and Usability, DUXU 2015 Held as Part of 17th International Conference on Human-Computer Interaction, HCI International 2015 ; Conference date: 02-08-2015 Through 07-08-2015",

}

Ch’ng, E & Cooke, N 2015, User study on 3D multitouch interaction (3DMi) and gaze on surface computing. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 9187, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9187, Springer, pp. 425-433, 4th International Conference on Design, User Experience and Usability, DUXU 2015 Held as Part of 17th International Conference on Human-Computer Interaction, HCI International 2015, Los Angeles, United States, 2/08/15. https://doi.org/10.1007/978-3-319-20898-5_41

User study on 3D multitouch interaction (3DMi) and gaze on surface computing. / Ch’ng, Eugene; Cooke, Neil.
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 9187 Springer, 2015. p. 425-433 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9187).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - User study on 3D multitouch interaction (3DMi) and gaze on surface computing

AU - Ch’ng, Eugene

AU - Cooke, Neil

PY - 2015/7/21

Y1 - 2015/7/21

N2 - On a multitouch table, user’s interactions with 3D virtual representations of real objects should be influenced by task and their perceived physical characteristics. This article explores the development and user study of an interactive 3D application that allows users to explore virtual heritage objects on a surface device. To-date, most multitouch has focused on 2D or 2.5D systems. A user-study is reported where we analyse their multimodal behaviour – specifically how they interact on a surface device with objects that have similar properties to physical versions and the users’ associated gaze patterns with touch.The study reveals that gaze characteristics are different according to their interaction intention in terms of position and duration of visual attention. We discovered that virtual objects afford the perception of haptic attributes ascribed to their equivalent physical objects, and that differences in the summary statistics of gaze showed consistent characteristics between people and differences between natural and task based activities. An awareness of user behaviours using natural gestures can inform the design of interactive 3D applications which complements the user’s model of past experience with physical objects and with GUI interaction.

AB - On a multitouch table, user’s interactions with 3D virtual representations of real objects should be influenced by task and their perceived physical characteristics. This article explores the development and user study of an interactive 3D application that allows users to explore virtual heritage objects on a surface device. To-date, most multitouch has focused on 2D or 2.5D systems. A user-study is reported where we analyse their multimodal behaviour – specifically how they interact on a surface device with objects that have similar properties to physical versions and the users’ associated gaze patterns with touch.The study reveals that gaze characteristics are different according to their interaction intention in terms of position and duration of visual attention. We discovered that virtual objects afford the perception of haptic attributes ascribed to their equivalent physical objects, and that differences in the summary statistics of gaze showed consistent characteristics between people and differences between natural and task based activities. An awareness of user behaviours using natural gestures can inform the design of interactive 3D applications which complements the user’s model of past experience with physical objects and with GUI interaction.

KW - Digital heritage

KW - Gaze tracking

KW - Interactive 3D

KW - Multitouch

KW - Surface computing

UR - http://www.scopus.com/inward/record.url?scp=84947260747&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-20898-5_41

DO - 10.1007/978-3-319-20898-5_41

M3 - Conference contribution

AN - SCOPUS:84947260747

SN - 9783319208978

VL - 9187

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 425

EP - 433

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

PB - Springer

T2 - 4th International Conference on Design, User Experience and Usability, DUXU 2015 Held as Part of 17th International Conference on Human-Computer Interaction, HCI International 2015

Y2 - 2 August 2015 through 7 August 2015

ER -

Ch’ng E, Cooke N. User study on 3D multitouch interaction (3DMi) and gaze on surface computing. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 9187. Springer. 2015. p. 425-433. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-20898-5_41

User study on 3D multitouch interaction (3DMi) and gaze on surface computing

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Fingerprint

Research output

User Study on 3D Multitouch interaction (3DMi) and Gaze on Surface Computing

Cite this