Decoding gestural iconicity

Research output: Contribution to journalArticle

Authors

Colleges, School and Institutes

External organisations

  • Universidade de São Paulo (USP)
  • Humboldt-Universität zu Berlin

Abstract

Representational gestures are used ubiquitously to depict ideas in an iconic fashion, such as when holding up the thumb and the index finger at a certain distance to indicate the size of a matchstick. However, the process by which a physical hand configuration is mentally transformed into abstract spatial information is not well understood. We present a series of experiments that investigate how people decode the physical form of an articulator to derive imaginary geometrical constructs, which are embraced in our use of “gesture form”. We provide quantitative evidence for several key properties that play a role in this process. First, “profiling”, the ability to focus on a structural sub-unit within the complex form of the gesturing hand. Second, “perspective”, for which we show that one and the same handshape seen from different perspectives can lead to different spatial interpretations. Third, “selectivity”, the fact that gestures focus on certain spatial features at the expense of others. Our results provide a first step toward mapping out the process of how representational gestures make the communication of spatial information possible.

Details

Original languageEnglish
Pages (from-to)3034-3049
Number of pages25
JournalCognitive Science
Volume42
Issue number8
Publication statusPublished - 23 Nov 2018
Event11th International Symposium on Iconicity in Language & Literature - University of Brighton, Brighton, United Kingdom
Duration: 6 Apr 20178 Apr 2017
https://delegate.brighton.ac.uk/Registration/Welcome.aspx?e=DA336F593D5030889B575309505BF638

Keywords

  • gesture, selective depiction, profiling, perspective, visual perception