Decoding gestural iconicity

Research output: Contribution to journalArticlepeer-review

Standard

Decoding gestural iconicity. / Hassemer, Julius; Winter, Bodo.

In: Cognitive Science, Vol. 42, No. 8, 23.11.2018, p. 3034-3049.

Research output: Contribution to journalArticlepeer-review

Harvard

APA

Vancouver

Author

Hassemer, Julius ; Winter, Bodo. / Decoding gestural iconicity. In: Cognitive Science. 2018 ; Vol. 42, No. 8. pp. 3034-3049.

Bibtex

@article{c456975098ec46d0bb642a65f1a6e6fe,
title = "Decoding gestural iconicity",
abstract = "Representational gestures are used ubiquitously to depict ideas in an iconic fashion, such as when holding up the thumb and the index finger at a certain distance to indicate the size of a matchstick. However, the process by which a physical hand configuration is mentally transformed into abstract spatial information is not well understood. We present a series of experiments that investigate how people decode the physical form of an articulator to derive imaginary geometrical constructs, which are embraced in our use of “gesture form”. We provide quantitative evidence for several key properties that play a role in this process. First, “profiling”, the ability to focus on a structural sub-unit within the complex form of the gesturing hand. Second, “perspective”, for which we show that one and the same handshape seen from different perspectives can lead to different spatial interpretations. Third, “selectivity”, the fact that gestures focus on certain spatial features at the expense of others. Our results provide a first step toward mapping out the process of how representational gestures make the communication of spatial information possible.",
keywords = "gesture, selective depiction, profiling, perspective, visual perception",
author = "Julius Hassemer and Bodo Winter",
year = "2018",
month = nov,
day = "23",
doi = "10.1111/cogs.12680",
language = "English",
volume = "42",
pages = "3034--3049",
journal = "Cognitive Science",
issn = "0364-0213",
publisher = "Wiley",
number = "8",
note = "11th International Symposium on Iconicity in Language & Literature ; Conference date: 06-04-2017 Through 08-04-2017",
url = "https://delegate.brighton.ac.uk/Registration/Welcome.aspx?e=DA336F593D5030889B575309505BF638",

}

RIS

TY - JOUR

T1 - Decoding gestural iconicity

AU - Hassemer, Julius

AU - Winter, Bodo

PY - 2018/11/23

Y1 - 2018/11/23

N2 - Representational gestures are used ubiquitously to depict ideas in an iconic fashion, such as when holding up the thumb and the index finger at a certain distance to indicate the size of a matchstick. However, the process by which a physical hand configuration is mentally transformed into abstract spatial information is not well understood. We present a series of experiments that investigate how people decode the physical form of an articulator to derive imaginary geometrical constructs, which are embraced in our use of “gesture form”. We provide quantitative evidence for several key properties that play a role in this process. First, “profiling”, the ability to focus on a structural sub-unit within the complex form of the gesturing hand. Second, “perspective”, for which we show that one and the same handshape seen from different perspectives can lead to different spatial interpretations. Third, “selectivity”, the fact that gestures focus on certain spatial features at the expense of others. Our results provide a first step toward mapping out the process of how representational gestures make the communication of spatial information possible.

AB - Representational gestures are used ubiquitously to depict ideas in an iconic fashion, such as when holding up the thumb and the index finger at a certain distance to indicate the size of a matchstick. However, the process by which a physical hand configuration is mentally transformed into abstract spatial information is not well understood. We present a series of experiments that investigate how people decode the physical form of an articulator to derive imaginary geometrical constructs, which are embraced in our use of “gesture form”. We provide quantitative evidence for several key properties that play a role in this process. First, “profiling”, the ability to focus on a structural sub-unit within the complex form of the gesturing hand. Second, “perspective”, for which we show that one and the same handshape seen from different perspectives can lead to different spatial interpretations. Third, “selectivity”, the fact that gestures focus on certain spatial features at the expense of others. Our results provide a first step toward mapping out the process of how representational gestures make the communication of spatial information possible.

KW - gesture

KW - selective depiction

KW - profiling

KW - perspective

KW - visual perception

U2 - 10.1111/cogs.12680

DO - 10.1111/cogs.12680

M3 - Article

VL - 42

SP - 3034

EP - 3049

JO - Cognitive Science

JF - Cognitive Science

SN - 0364-0213

IS - 8

T2 - 11th International Symposium on Iconicity in Language & Literature

Y2 - 6 April 2017 through 8 April 2017

ER -