Tracking eye gaze during interpretation of endoluminal three-dimensional CT colonography: visual perception of experienced and inexperienced readers

Susan Mallett; Peter Phillips; Thomas R Fanshawe; Emma Helbren; Darren Boone; Alastair Gale; Stuart A Taylor; David Manning; Douglas G Altman; Steve Halligan

doi:10.1148/radiol.14132896

Tracking eye gaze during interpretation of endoluminal three-dimensional CT colonography: visual perception of experienced and inexperienced readers

Susan Mallett, Peter Phillips, Thomas R Fanshawe, Emma Helbren, Darren Boone, Alastair Gale, Stuart A Taylor, David Manning, Douglas G Altman, Steve Halligan

Applied Health Research

Research output: Contribution to journal › Article › peer-review

39 Citations (Scopus)

Abstract

PURPOSE: To identify and compare key stages of the visual process in experienced and inexperienced readers and to examine how these processes are used to search a moving three-dimensional ( 3D three-dimensional ) image and their relationship to false-negative errors.

MATERIALS AND METHODS: Institutional review board research ethics approval was granted to use anonymized computed tomographic (CT) colonographic data from previous studies and to obtain eye-tracking data from volunteers. Sixty-five radiologists (27 experienced, 38 inexperienced) interpreted 23 endoluminal 3D three-dimensional CT colonographic videos. Eye movements were recorded by using eye tracking with a desk-mounted tracker. Readers indicated when they saw a polyp by clicking a computer mouse. Polyp location and boundary on each video frame were quantified and gaze data were related to the polyp boundary for each individual reader and case. Predefined metrics were quantified and used to describe and compare visual search patterns between experienced and inexperienced readers by using multilevel modeling.

RESULTS: Time to first pursuit was significantly shorter in experienced readers (hazard ratio, 1.22 [95% confidence interval: 1.04, 1.44]; P = .017) but other metrics were not significantly different. Regardless of expertise, metrics such as assessment, identification period, and pursuit times were extended in videos where polyps were visible on screen for longer periods of time. In 97% (760 of 787) of observations, readers correctly pursued polyps.

CONCLUSION: Experienced readers had shorter time to first eye pursuit, but many other characteristics of eye tracking were similar between experienced and inexperienced readers. Readers pursued polyps in 97% of observations, which indicated that errors during interpretation of 3D three-dimensional CT colonography in this study occurred in either the discovery or the recognition phase, but rarely in the scanning phase of radiologic image inspection.

Original language	English
Pages (from-to)	783-92
Number of pages	10
Journal	Radiology
Volume	273
Issue number	3
DOIs	https://doi.org/10.1148/radiol.14132896
Publication status	Published - Dec 2014

Bibliographical note

Keywords

Adult
Clinical Competence
Colonic Polyps
Colonography, Computed Tomographic
Eye Movements
Female
Humans
Imaging, Three-Dimensional
Male
Reproducibility of Results
Video Recording
Visual Perception

Access to Document

10.1148/radiol.14132896

Cite this

@article{cd9dc3cbdf6b4ceeb322aa25738e6c44,

title = "Tracking eye gaze during interpretation of endoluminal three-dimensional CT colonography: visual perception of experienced and inexperienced readers",

abstract = "PURPOSE: To identify and compare key stages of the visual process in experienced and inexperienced readers and to examine how these processes are used to search a moving three-dimensional ( 3D three-dimensional ) image and their relationship to false-negative errors.MATERIALS AND METHODS: Institutional review board research ethics approval was granted to use anonymized computed tomographic (CT) colonographic data from previous studies and to obtain eye-tracking data from volunteers. Sixty-five radiologists (27 experienced, 38 inexperienced) interpreted 23 endoluminal 3D three-dimensional CT colonographic videos. Eye movements were recorded by using eye tracking with a desk-mounted tracker. Readers indicated when they saw a polyp by clicking a computer mouse. Polyp location and boundary on each video frame were quantified and gaze data were related to the polyp boundary for each individual reader and case. Predefined metrics were quantified and used to describe and compare visual search patterns between experienced and inexperienced readers by using multilevel modeling.RESULTS: Time to first pursuit was significantly shorter in experienced readers (hazard ratio, 1.22 [95% confidence interval: 1.04, 1.44]; P = .017) but other metrics were not significantly different. Regardless of expertise, metrics such as assessment, identification period, and pursuit times were extended in videos where polyps were visible on screen for longer periods of time. In 97% (760 of 787) of observations, readers correctly pursued polyps.CONCLUSION: Experienced readers had shorter time to first eye pursuit, but many other characteristics of eye tracking were similar between experienced and inexperienced readers. Readers pursued polyps in 97% of observations, which indicated that errors during interpretation of 3D three-dimensional CT colonography in this study occurred in either the discovery or the recognition phase, but rarely in the scanning phase of radiologic image inspection.",

keywords = "Adult, Clinical Competence, Colonic Polyps, Colonography, Computed Tomographic, Eye Movements, Female, Humans, Imaging, Three-Dimensional, Male, Reproducibility of Results, Video Recording, Visual Perception",

author = "Susan Mallett and Peter Phillips and Fanshawe, {Thomas R} and Emma Helbren and Darren Boone and Alastair Gale and Taylor, {Stuart A} and David Manning and Altman, {Douglas G} and Steve Halligan",

note = "{\textcopyright} RSNA, 2014.",

year = "2014",

month = dec,

doi = "10.1148/radiol.14132896",

language = "English",

volume = "273",

pages = "783--92",

journal = "Radiology",

issn = "0033-8419",

publisher = "Radiological Society of North America",

number = "3",

}

TY - JOUR

T1 - Tracking eye gaze during interpretation of endoluminal three-dimensional CT colonography

T2 - visual perception of experienced and inexperienced readers

AU - Mallett, Susan

AU - Phillips, Peter

AU - Fanshawe, Thomas R

AU - Helbren, Emma

AU - Boone, Darren

AU - Gale, Alastair

AU - Taylor, Stuart A

AU - Manning, David

AU - Altman, Douglas G

AU - Halligan, Steve

N1 - © RSNA, 2014.

PY - 2014/12

Y1 - 2014/12

N2 - PURPOSE: To identify and compare key stages of the visual process in experienced and inexperienced readers and to examine how these processes are used to search a moving three-dimensional ( 3D three-dimensional ) image and their relationship to false-negative errors.MATERIALS AND METHODS: Institutional review board research ethics approval was granted to use anonymized computed tomographic (CT) colonographic data from previous studies and to obtain eye-tracking data from volunteers. Sixty-five radiologists (27 experienced, 38 inexperienced) interpreted 23 endoluminal 3D three-dimensional CT colonographic videos. Eye movements were recorded by using eye tracking with a desk-mounted tracker. Readers indicated when they saw a polyp by clicking a computer mouse. Polyp location and boundary on each video frame were quantified and gaze data were related to the polyp boundary for each individual reader and case. Predefined metrics were quantified and used to describe and compare visual search patterns between experienced and inexperienced readers by using multilevel modeling.RESULTS: Time to first pursuit was significantly shorter in experienced readers (hazard ratio, 1.22 [95% confidence interval: 1.04, 1.44]; P = .017) but other metrics were not significantly different. Regardless of expertise, metrics such as assessment, identification period, and pursuit times were extended in videos where polyps were visible on screen for longer periods of time. In 97% (760 of 787) of observations, readers correctly pursued polyps.CONCLUSION: Experienced readers had shorter time to first eye pursuit, but many other characteristics of eye tracking were similar between experienced and inexperienced readers. Readers pursued polyps in 97% of observations, which indicated that errors during interpretation of 3D three-dimensional CT colonography in this study occurred in either the discovery or the recognition phase, but rarely in the scanning phase of radiologic image inspection.

AB - PURPOSE: To identify and compare key stages of the visual process in experienced and inexperienced readers and to examine how these processes are used to search a moving three-dimensional ( 3D three-dimensional ) image and their relationship to false-negative errors.MATERIALS AND METHODS: Institutional review board research ethics approval was granted to use anonymized computed tomographic (CT) colonographic data from previous studies and to obtain eye-tracking data from volunteers. Sixty-five radiologists (27 experienced, 38 inexperienced) interpreted 23 endoluminal 3D three-dimensional CT colonographic videos. Eye movements were recorded by using eye tracking with a desk-mounted tracker. Readers indicated when they saw a polyp by clicking a computer mouse. Polyp location and boundary on each video frame were quantified and gaze data were related to the polyp boundary for each individual reader and case. Predefined metrics were quantified and used to describe and compare visual search patterns between experienced and inexperienced readers by using multilevel modeling.RESULTS: Time to first pursuit was significantly shorter in experienced readers (hazard ratio, 1.22 [95% confidence interval: 1.04, 1.44]; P = .017) but other metrics were not significantly different. Regardless of expertise, metrics such as assessment, identification period, and pursuit times were extended in videos where polyps were visible on screen for longer periods of time. In 97% (760 of 787) of observations, readers correctly pursued polyps.CONCLUSION: Experienced readers had shorter time to first eye pursuit, but many other characteristics of eye tracking were similar between experienced and inexperienced readers. Readers pursued polyps in 97% of observations, which indicated that errors during interpretation of 3D three-dimensional CT colonography in this study occurred in either the discovery or the recognition phase, but rarely in the scanning phase of radiologic image inspection.

KW - Adult

KW - Clinical Competence

KW - Colonic Polyps

KW - Colonography, Computed Tomographic

KW - Eye Movements

KW - Female

KW - Humans

KW - Imaging, Three-Dimensional

KW - Male

KW - Reproducibility of Results

KW - Video Recording

KW - Visual Perception

U2 - 10.1148/radiol.14132896

DO - 10.1148/radiol.14132896

M3 - Article

C2 - 25028782

SN - 0033-8419

VL - 273

SP - 783

EP - 792

JO - Radiology

JF - Radiology

IS - 3

ER -

Tracking eye gaze during interpretation of endoluminal three-dimensional CT colonography: visual perception of experienced and inexperienced readers

Abstract

Bibliographical note

Keywords

Access to Document

Fingerprint

Cite this