Early effects of word surprisal on pupil size during reading

Stefan L. Frank; Robin L. Thompson

Early effects of word surprisal on pupil size during reading

Psychology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This study investigated the relation between word surprisal and pupil dilation during reading. Participants’ eye movements and pupil size were recorded while they read single sentences. Surprisal values for each word in the sentence stimuli were estimated by both a recurrent neural network and a phrase-structure grammar. Higher surprisal corresponded to longer word-reading time, and this effect was stronger when surprisal values were estimated by the neural network. In addition, there was an early, positive effect of surprisal on pupil size, from about 250 ms before word fixation until 100 ms after fixation. This early effect, which was only significant for the network-based surprisal estimates, is suggestive of a preparation-based account of surprisal.

Original language	English
Title of host publication	Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012
Editors	Naomi Miyake, David Peebles, Richard P. Cooper
Publisher	The Cognitive Science Society
Pages	1554-1559
Number of pages	6
ISBN (Electronic)	9780976831884
Publication status	Published - 2012
Event	34th Annual Meeting of the Cognitive Science Society: Building Bridges Across Cognitive Sciences Around the World, CogSci 2012 - Sapporo, Japan Duration: 1 Aug 2012 → 4 Aug 2012

Publication series

Name	Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012

Conference

Conference	34th Annual Meeting of the Cognitive Science Society: Building Bridges Across Cognitive Sciences Around the World, CogSci 2012
Country/Territory	Japan
City	Sapporo
Period	1/08/12 → 4/08/12

Bibliographical note

Funding Information:
The research presented here was funded by the European Union Seventh Framework Programme (FP7/2007-2013) under grant number 253803, and by a grant from the Economic and Social Resesarch Council of Great Britain (RES-620-28-6001) awarded to the Deafness Cognition and Language Research Centre. We are grateful to Naima Ansari for her assistance with data collection.

Publisher Copyright:
© CogSci 2012.All rights reserved.

Keywords

Eye tracking
Phrase-structure grammar
Pupillometry
Reading
Recurrent neural network
Sentence comprehension
Surprisal

ASJC Scopus subject areas

Artificial Intelligence
Computer Science Applications
Human-Computer Interaction
Cognitive Neuroscience

Cite this

Frank, S. L., & Thompson, R. L. (2012). Early effects of word surprisal on pupil size during reading. In N. Miyake, D. Peebles, & R. P. Cooper (Eds.), Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012 (pp. 1554-1559). (Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012). The Cognitive Science Society.

Frank, Stefan L. ; Thompson, Robin L. / Early effects of word surprisal on pupil size during reading. Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012. editor / Naomi Miyake ; David Peebles ; Richard P. Cooper. The Cognitive Science Society, 2012. pp. 1554-1559 (Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012).

@inproceedings{2510466e5926489bbe5331c7714ad73d,

title = "Early effects of word surprisal on pupil size during reading",

abstract = "This study investigated the relation between word surprisal and pupil dilation during reading. Participants{\textquoteright} eye movements and pupil size were recorded while they read single sentences. Surprisal values for each word in the sentence stimuli were estimated by both a recurrent neural network and a phrase-structure grammar. Higher surprisal corresponded to longer word-reading time, and this effect was stronger when surprisal values were estimated by the neural network. In addition, there was an early, positive effect of surprisal on pupil size, from about 250 ms before word fixation until 100 ms after fixation. This early effect, which was only significant for the network-based surprisal estimates, is suggestive of a preparation-based account of surprisal.",

keywords = "Eye tracking, Phrase-structure grammar, Pupillometry, Reading, Recurrent neural network, Sentence comprehension, Surprisal",

author = "Frank, {Stefan L.} and Thompson, {Robin L.}",

note = "Funding Information: The research presented here was funded by the European Union Seventh Framework Programme (FP7/2007-2013) under grant number 253803, and by a grant from the Economic and Social Resesarch Council of Great Britain (RES-620-28-6001) awarded to the Deafness Cognition and Language Research Centre. We are grateful to Naima Ansari for her assistance with data collection. Publisher Copyright: {\textcopyright} CogSci 2012.All rights reserved.; 34th Annual Meeting of the Cognitive Science Society: Building Bridges Across Cognitive Sciences Around the World, CogSci 2012 ; Conference date: 01-08-2012 Through 04-08-2012",

year = "2012",

language = "English",

series = "Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012",

publisher = "The Cognitive Science Society",

pages = "1554--1559",

editor = "Naomi Miyake and David Peebles and Cooper, {Richard P.}",

booktitle = "Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012",

}

Frank, SL & Thompson, RL 2012, Early effects of word surprisal on pupil size during reading. in N Miyake, D Peebles & RP Cooper (eds), Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012. Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012, The Cognitive Science Society, pp. 1554-1559, 34th Annual Meeting of the Cognitive Science Society: Building Bridges Across Cognitive Sciences Around the World, CogSci 2012, Sapporo, Japan, 1/08/12.

Early effects of word surprisal on pupil size during reading. / Frank, Stefan L.; Thompson, Robin L.
Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012. ed. / Naomi Miyake; David Peebles; Richard P. Cooper. The Cognitive Science Society, 2012. p. 1554-1559 (Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Early effects of word surprisal on pupil size during reading

AU - Frank, Stefan L.

AU - Thompson, Robin L.

N1 - Funding Information: The research presented here was funded by the European Union Seventh Framework Programme (FP7/2007-2013) under grant number 253803, and by a grant from the Economic and Social Resesarch Council of Great Britain (RES-620-28-6001) awarded to the Deafness Cognition and Language Research Centre. We are grateful to Naima Ansari for her assistance with data collection. Publisher Copyright: © CogSci 2012.All rights reserved.

PY - 2012

Y1 - 2012

N2 - This study investigated the relation between word surprisal and pupil dilation during reading. Participants’ eye movements and pupil size were recorded while they read single sentences. Surprisal values for each word in the sentence stimuli were estimated by both a recurrent neural network and a phrase-structure grammar. Higher surprisal corresponded to longer word-reading time, and this effect was stronger when surprisal values were estimated by the neural network. In addition, there was an early, positive effect of surprisal on pupil size, from about 250 ms before word fixation until 100 ms after fixation. This early effect, which was only significant for the network-based surprisal estimates, is suggestive of a preparation-based account of surprisal.

AB - This study investigated the relation between word surprisal and pupil dilation during reading. Participants’ eye movements and pupil size were recorded while they read single sentences. Surprisal values for each word in the sentence stimuli were estimated by both a recurrent neural network and a phrase-structure grammar. Higher surprisal corresponded to longer word-reading time, and this effect was stronger when surprisal values were estimated by the neural network. In addition, there was an early, positive effect of surprisal on pupil size, from about 250 ms before word fixation until 100 ms after fixation. This early effect, which was only significant for the network-based surprisal estimates, is suggestive of a preparation-based account of surprisal.

KW - Eye tracking

KW - Phrase-structure grammar

KW - Pupillometry

KW - Reading

KW - Recurrent neural network

KW - Sentence comprehension

KW - Surprisal

UR - http://www.scopus.com/inward/record.url?scp=84867523159&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84867523159

T3 - Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012

SP - 1554

EP - 1559

BT - Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012

A2 - Miyake, Naomi

A2 - Peebles, David

A2 - Cooper, Richard P.

PB - The Cognitive Science Society

T2 - 34th Annual Meeting of the Cognitive Science Society: Building Bridges Across Cognitive Sciences Around the World, CogSci 2012

Y2 - 1 August 2012 through 4 August 2012

ER -

Frank SL, Thompson RL. Early effects of word surprisal on pupil size during reading. In Miyake N, Peebles D, Cooper RP, editors, Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012. The Cognitive Science Society. 2012. p. 1554-1559. (Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012).

Early effects of word surprisal on pupil size during reading

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Fingerprint

Cite this