How pictures in picture storybooks support young children's story comprehension: An eye-tracking experiment.

Published on Oct 1, 2018in Journal of Experimental Child Psychology
· DOI :10.1016/J.JECP.2018.04.013
Zsofia K. Takacs9
Estimated H-index: 9
(ELTE: Eötvös Loránd University),
Adriana G. Bus5
Estimated H-index: 5
(ELTE: Eötvös Loránd University),
Adriana G. Bus22
Estimated H-index: 22
(ELTE: Eötvös Loránd University)
Abstract In a within-participant design, 41 children (mean age = 64 months, range = 50–81) listened to brief stories in four conditions. Written text was present on the screen in all conditions (similar to the typical storybook experience) but combined with other sources of information: (a) only oral narration, (b) oral narration and a picture that was congruent with the narration, (c) oral narration and an incongruent picture, and (d) only a picture but no oral narration. Children’s eye movements while looking at the screen were recorded with an eye-tracker. An important finding was that a congruent picture contributed substantially to children’s story retellings, more so than a picture that was incongruent with the narration. The eye-tracking data showed that children explored pictures in a way that they could maximally integrate the narration and the picture. Consequences for interactive reading and picture storybook format are discussed.
📖 Papers frequently viewed together
4 Authors (Linhui Li, ..., Xiaomei Gao)
18 Citations
40 Citations
#1Zoe M. Flack (University of Sussex)H-Index: 3
#2Jessica S. Horst (University of Sussex)H-Index: 22
Two experiments tested how the number of illustrations in storybooks influences 3.5-year-old children's word learning from shared reading. In Experiment 1, children encountered stories with two regular-sized A4 illustrations, one regular-sized A4 illustration, or one large-sized A3 illustration (in the control group) per spread. Children learned significantly fewer words when they had to find the referent within two illustrations presented at the same time. In Experiment 2, a gesture was added t...
25 CitationsSource
#1Virginia Tompkins (The Ohio State University at Lima)H-Index: 13
#2Alain Bengochea (OSU: Ohio State University)H-Index: 3
Last. Laura M. Justice (OSU: Ohio State University)H-Index: 86
view all 4 authors...
Researchers have consistently found a link between the quality of early parent–child book-reading interactions and children's language skill. Two aspects of quality (level of abstraction and utterance function) were examined simultaneously in the current study to further refine our understanding of how parents’ talk during shared reading predicts children's vocabulary growth and elicits children's participation in book reading. To achieve this aim, the authors examined mothers’ extratextual utte...
17 CitationsSource
#1Zsofia K. Takacs (ELTE: Eötvös Loránd University)H-Index: 9
#2Adriana G. Bus (LEI: Leiden University)H-Index: 22
The present study provides experimental evidence regarding 4-6-year-old children’s visual processing of animated versus static illustrations in storybooks. 39 participants listened to an animated and a static book, both three times, while eye movements were registered with an eye-tracker. Outcomes corroborate the hypothesis that specifically motion is what attracts children’s attention while looking at illustrations. It is proposed that animated illustrations that are well matched to the text of...
35 CitationsSource
#1Jessica L. MontagH-Index: 8
#2Michael Jones (IU: Indiana University)H-Index: 86
Last. Linda B. SmithH-Index: 96
view all 3 authors...
Young children learn language from the speech they hear. Previous work suggests that greater statistical diversity of words and of linguistic contexts is associated with better language outcomes. One potential source of lexical diversity is the text of picture books that caregivers read aloud to children. Many parents begin reading to their children shortly after birth, so this is potentially an important source of linguistic input for many children. We constructed a corpus of 100 children’s pic...
108 CitationsSource
#1Adriana G. Bus (LEI: Leiden University)H-Index: 22
#1Adriana G. Bus (LEI: Leiden University)H-Index: 7
Last. Cornelia A. T. Kegel (LEI: Leiden University)H-Index: 8
view all 3 authors...
Abstract Stories presented on phones, tablets and e-readers now offer an alternative to print books. The fundamental challenge has become to specify when and for whom the manner in which children retain information from stories has been changed by electronic storybooks, for better and for worse. We review the effects of digitized presentations of narratives that include oral text as well as multimedia information sources (e.g., animations and other visual and sound effects, background music, hot...
173 CitationsSource
The major purpose of this study was to test how preliterate learners use illustrations in storybooks to understand a story. Subjects were 23 five-year-old low-SES children, learning Dutch as a second language. Each child was exposed four times to a digital picture storybook. Five books were used and counterbalanced over children and repetitions. During book exposure, eye movements were registered using a remote eye-tracking system. To test whether eye fixations matched the text we scored how oft...
40 CitationsSource
#1Suzanne E. Mol (LEI: Leiden University)H-Index: 9
#2Adriana G. Bus (LEI: Leiden University)H-Index: 22
Last. Adriana G. Bus (LEI: Leiden University)H-Index: 7
view all 2 authors...
This research synthesis examines whether the association between print exposure and components of reading grows stronger across development. We meta-analyzed 99 studies (N = 7,669) that focused on leisure time reading of (a) preschoolers and kindergartners, (b) children attending Grades 1-12, and (c) college and university students. For all measures in the outcome domains of reading comprehension and technical reading and spelling, moderate to strong correlations with print exposure were found. ...
620 CitationsSource
#1Michael K. Tanenhaus (UR: University of Rochester)H-Index: 85
Publisher Summary This chapter provides an overview of recent research that uses eye movements to investigate both spoken language comprehension and language production. Issues of data analysis and linking hypotheses are addressed in what is now commonly referred to as the “visual world” paradigm, including issues that arise in comparing results to those from eye-tracking reading studies. Psycholinguists now use the visual-world eye-movement method to study both language production and language ...
27 CitationsSource
#1Elizabeth T. Davis (Georgia Institute of Technology)H-Index: 10
1 CitationsSource
#1Laurent IttiH-Index: 69
#2Geraint ReesH-Index: 98
Last. John K. TsotsosH-Index: 58
view all 3 authors...
A key property of neural processing in higher mammals is the ability to focus resources by selectively directing attention to relevant perceptions, thoughts or actions. Research into attention has grown rapidly over the past two decades, as new techniques have become available to study higher brain function in humans, non-human primates, and other mammals. Neurobiology of Attention is the first encyclopedic volume to summarize the latest developments in attention research. An authoritative colle...
375 Citations
Cited By13
#1Malpaleni Satriana (Mulawarman University)H-Index: 3
#2Masnurrima Heriansyah (Mulawarman University)
Last. Febry Maghfirah (Mulawarman University)
view all 3 authors...
This article outlines the collective reading tasks using interactive book media. Due to the importance of stimulating aspects of child development, the writers attempt to report a qualitative case ...
#1Kaitlin McCormick-Huhn (UNLV: University of Nevada, Las Vegas)H-Index: 1
#2Stephanie A. Shields (PSU: Pennsylvania State University)H-Index: 30
As perceivers, we need to understand context to make social judgments about emotion, such as judging whether emotion is appropriate. We propose a graphic novel-like method, the emotion storyboard, for use in research on social judgments of emotion. Across two studies, participants were randomly assigned to read emotion storyboards or written vignettes to compare the efficacy of the emotion storyboard to that of vignettes in studies on social judgments of emotion. In Study 1, undergraduates (N = ...
#1Dilek Altun (Yıldırım Beyazıt University)H-Index: 1
Advanced technology and the shift to a digital childhood have dramatically reshaped children’s early life experiences. Children’s literacy experiences are also evolving; in addition to printed storybooks, children are now exposed to electronic stories (e-stories). While previous studies have addressed the effects of e-stories on children’s comprehension, little attention has been devoted to the roles of theory of mind (ToM) and executive functions (EF) in this process. The goal of the present st...
1 CitationsSource
#1Ying Xu (UCI: University of California, Irvine)H-Index: 5
#2Dakuo Wang (IBM)H-Index: 16
Last. Mark Warschauer (UCI: University of California, Irvine)H-Index: 73
view all 5 authors...
Abstract Storybook reading accompanied by adult-guided conversation provides a stimulating context for children’s language development. Conversational agents powered by artificial intelligence, such as smart speakers, are prevalent in children’s homes and have the potential to engage children in storybook reading as language partners. However, little research has explored the effectiveness of using conversational agents to support children’s language development. This study examined how an autom...
12 CitationsSource
#1Lufri LufriH-Index: 6
Last. Azwir AnharH-Index: 3
view all 3 authors...
Last. Rebeca Cerezo Menéndez (UBU: University of Burgos)H-Index: 6
view all 5 authors...
The use of learning environments that apply Advanced Learning Technologies (ALTs) and Self-Regulated Learning (SRL) is increasingly frequent. In this study, eye-tracking technology was used to analyze scan-path differences in a History of Art learning task. The study involved 36 participants (students versus university teachers with and without previous knowledge). The scan-paths were registered during the viewing of video based on SRL. Subsequently, the participants were asked to solve a crossw...
6 CitationsSource
#1Zehui Zhan (SCNU: South China Normal University)H-Index: 1
#1Zehui ZhanH-Index: 9
Last. Patrick S.W. FongH-Index: 3
view all 5 authors...
This paper aims to investigate the individual difference on digital reading, by examining the eye-tracking records of male and female readers with different reading ability (including their pupil size, blink rate, fixation rate, fixation duration, saccade rate, saccade duration, saccade amplitude and regression rate).,A total of 74 participants were selected according to 6,520 undergraduate students’ university entrance exam scores and the follow-up reading assessments. Half of them are men and ...
1 CitationsSource