The neural mechanisms of reliability weighted integration of shape information from vision and touch

Research output: Contribution to journalArticle

Authors

  • Hannah B. Helbig
  • Marc O. Ernst
  • Emiliano Ricciardi
  • Pietro Pietrini
  • Axel Thielscher
  • Katja M. Mayer
  • Johannes Schultz
  • Uta Noppeney

Colleges, School and Institutes

External organisations

  • Max Planck Institute for Biological Cybernetics
  • Laboratory of Clinical Biochemistry and Molecular Biology
  • University of Pisa

Abstract

Behaviourally, humans have been shown to integrate multisensory information in a statistically-optimal fashion by averaging the individual unisensory estimates according to their relative reliabilities. This form of integration is optimal in that it yields the most reliable (i.e. least variable) multisensory percept. The present study investigates the neural mechanisms underlying integration of visual and tactile shape information at the macroscopic scale of the regional BOLD response. Observers discriminated the shapes of ellipses that were presented bimodally (visual-tactile) or visually alone. A 2. × 5 factorial design manipulated (i) the presence vs. absence of tactile shape information and (ii) the reliability of the visual shape information (five levels). We then investigated whether regional activations underlying tactile shape discrimination depended on the reliability of visual shape. Indeed, in primary somatosensory cortices (bilateral BA2) and the superior parietal lobe the responses to tactile shape input were increased when the reliability of visual shape information was reduced. Conversely, tactile inputs suppressed visual activations in the right posterior fusiform gyrus, when the visual signal was blurred and unreliable. Somatosensory and visual cortices may sustain integration of visual and tactile shape information either via direct connections from visual areas or top-down effects from higher order parietal areas.

Details

Original languageEnglish
Pages (from-to)1063-1072
Number of pages10
JournalNeuroImage
Volume60
Issue number2
Publication statusPublished - 2 Apr 2012

Keywords

  • FMRI, Maximum Likelihood Estimation, Multisensory integration, Postcentral sulcus, Shape, Touch, Vision

ASJC Scopus subject areas