Systematic mappings between semantic categories and types of iconic representations in the manual modality: A normed database of silent gesture

Research output: Contribution to journalArticlepeer-review

Authors

Colleges, School and Institutes

External organisations

  • English Language and Applied Linguistics, University of Birmingham, Birmingham, UK. g.ortega@bham.ac.uk.
  • Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands; Max-Planck Institute for Psycholinguistics, Nijmegen, The Netherlands.

Abstract

An unprecedented number of empirical studies have shown that iconic gestures-those that mimic the sensorimotor attributes of a referent-contribute significantly to language acquisition, perception, and processing. However, there has been a lack of normed studies describing generalizable principles in gesture production and in comprehension of the mappings of different types of iconic strategies (i.e., modes of representation; Müller, 2013). In Study 1 we elicited silent gestures in order to explore the implementation of different types of iconic representation (i.e., acting, representing, drawing, and personification) to express concepts across five semantic domains. In Study 2 we investigated the degree of meaning transparency (i.e., iconicity ratings) of the gestures elicited in Study 1. We found systematicity in the gestural forms of 109 concepts across all participants, with different types of iconicity aligning with specific semantic domains: Acting was favored for actions and manipulable objects, drawing for nonmanipulable objects, and personification for animate entities. Interpretation of gesture-meaning transparency was modulated by the interaction between mode of representation and semantic domain, with some couplings being more transparent than others: Acting yielded higher ratings for actions, representing for object-related concepts, personification for animate entities, and drawing for nonmanipulable entities. This study provides mapping principles that may extend to all forms of manual communication (gesture and sign). This database includes a list of the most systematic silent gestures in the group of participants, a notation of the form of each gesture based on four features (hand configuration, orientation, placement, and movement), each gesture's mode of representation, iconicity ratings, and professionally filmed videos that can be used for experimental and clinical endeavors.

Bibliographic note

Publisher Copyright: © 2019, The Author(s). Copyright: Copyright 2019 Elsevier B.V., All rights reserved.

Details

Original languageEnglish
Pages (from-to)51–67
JournalBehaviour Research Methods
Volume52
Early online date20 Feb 2019
Publication statusPublished - 20 Feb 2019

Keywords

  • Iconicity, Modes of representation, Normed database, Perception of iconicity, Silent gesture