Can the computer replace the adult for storybook reading? A meta-analysis on the effects of multimedia stories as compared to sharing print stories with an adult

The present meta-analysis challenges the notion that young children necessarily need adult scaffolding in order to understand a narrative story and learn words as long as they encounter optimally designed multimedia stories. Including 29 studies and 1272 children, multimedia stories were found more beneficial than encounters with traditional story materials that did not include the help of an adult for story comprehension (g+ = 0.40, k = 18) as well as vocabulary (g+ = 0.30, k = 11). However, no significant differences were found between the learning outcomes of multimedia stories and sharing traditional print-like stories with an adult. It is concluded that multimedia features like animated illustrations, background music and sound effects provide similar scaffolding of story comprehension and word learning as an adult

Affordances and limitations of electronic storybooks for young children's emergent literacy

AbstractStories presented on phones, tablets and e-readers now offer an alternative to print books. The fundamental challenge has become to specify when and for whom the manner in which children retain information from stories has been changed by electronic storybooks, for better and for worse. We review the effects of digitized presentations of narratives that include oral text as well as multimedia information sources (e.g., animations and other visual and sound effects, background music, hotspots, games, dictionaries) on children's emergent literacy. Research on preschool and kindergarten children has revealed both positive and negative effects of electronic stories conditional upon whether materials are consistent with the way that the human information processing system works. Adding certain information to electronic storybooks can facilitate multimedia learning, especially in children at-risk for language or reading difficulty. Animated pictures, sometimes enriched with music and sound, that match the simultaneously presented story text, can help integrate nonverbal information and language and thus promote storage of those in memory. On the other hand, stories enhanced with hypermedia interactive features like games and “hotspots” may lead to poor performance on tests of vocabulary and story comprehension. Using those features necessitates task switching, and like multitasking in general, seems to cause cognitive overload. However, in accordance with differential susceptibility theory, well-designed technology-enhanced books may be particularly suited to improve learning conditions for vulnerable children and turn putative risk groups into successful learners. This new line of research may have far-reaching consequences for the use of technology-enhanced materials in education

Picture this:A review of research relating to narrative processing by moving image versus language

Reading fiction for pleasure is robustly correlated with improved cognitive attainment and other benefits. It is also in decline among young people in developed nations, in part because of competition from moving image fiction. We review existing research on the differences between reading or hearing verbal fiction and watching moving image fiction, as well as looking more broadly at research on image or text interactions and visual versus verbal processing. We conclude that verbal narrative generates more diverse responses than moving image narrative. We note that reading and viewing narrative are different tasks, with different cognitive loads. Viewing moving image narrative mostly involves visual processing with some working memory engagement, whereas reading narrative involves verbal processing, visual imagery, and personal memory (Xu et al., 2005). Attempts to compare the two by creating equivalent stimuli and task demands face a number of challenges. We discuss the difficulties of such comparative approaches. We then investigate the possibility of identifying lower level processing mechanisms that might distinguish cognition of the two media and propose internal scene construction and working memory as foci for future research. Although many of the sources we draw on concentrate on English-speaking participants in European or North American settings, we also cover material relating to speakers of Dutch, German, Hebrew, and Japanese in their respective countries, and studies of a remote Turkish mountain community