Exploring "Associative Talk": When German Mothers Instruct Their Two Year Olds about Spatial Tasks

In this study, maternal input was analyzed during a task, in which German mothers instructed their two-year-old children to put two objects together in a particular way. In the setting, the spatial relation (ON and UNDER) and the canonicality of these relations (canonical such as ‘a pot on a table’ and noncanonical like ‘a train on a tunnel’) were varied. Two kinds of discourse strategies are proposed that characterize mothers’ input in this task: bring-in and follow-in. For the analysis, an automatic procedure was developed, in which the amount of words spent on a strategy was related to the overall word amount. The data suggest that the canonicality of the task can change the discourse: Bring-in strategies dominated the discourse in tasks with canonical spatial relations while in more difficult tasks with non-canonical relations, German-speaking mothers used follow-ins significantly more often than in the canonical tasks. Together, the results of this study shed light on the process of an on-line adaptation of the mother to her child and give us insight into how a situated understanding in a task-oriented discourse emerges

The use of synchrony in parent-child interaction can be measured on a signal-level

In our approach, we aim at an objective measurement of synchrony in multimodal tutoring behavior. The use of signal correlation provides a well formalized method that yields gradual information about the degree of synchrony. For our analysis, we used and extended an algorithm proposed by Hershey & Movellan (2000) that correlates single-pixel values of a video signal with the loudness of the corresponding audio track over time. The results of all pixels are integrated over the video to achieve a scalar estimate of synchrony

An Alternative to Mapping a Word onto a Concept in Language Acquisition: Pragmatic Frames

International audienceThe classic mapping metaphor posits that children learn a word by mapping it onto a concept of an object or event. However, we believe that a mapping metaphor cannot account for word learning, because even though children focus attention on objects, they do not necessarily remember the connection between the word and the referent unless it is framed pragmatically, that is, within a task. Our theoretical paper proposes an alternative mechanism for word learning. Our main premise is that word learning occurs as children accomplish a goal in cooperation with a partner. We follow Bruner's (1983) idea and further specify pragmatic frames as the learning units that drive language acquisition and cognitive development. These units consist of a sequence of actions and verbal behaviors that are co-constructed with a partner to achieve a joint goal. We elaborate on this alternative, offer some initial parametrizations of the concept, and embed it in current language learning approaches

Pragmatic Frames for Teaching and Learning in Human-Robot interaction: Review and Challenges

Vollmer A-L, Wrede B, Rohlfing KJ, Oudeyer P-Y. Pragmatic Frames for Teaching and Learning in Human-Robot interaction: Review and Challenges. FRONTIERS IN NEUROROBOTICS. 2016;10: 10.One of the big challenges in robotics today is to learn from human users that are inexperienced in interacting with robots but yet are often used to teach skills flexibly to other humans and to children in particular. A potential route toward natural and efficient learning and teaching in Human-Robot Interaction (HRI) is to leverage the social competences of humans and the underlying interactional mechanisms. In this perspective, this article discusses the importance of pragmatic frames as flexible interaction protocols that provide important contextual cues to enable learners to infer new action or language skills and teachers to convey these cues. After defining and discussing the concept of pragmatic frames, grounded in decades of research in developmental psychology, we study a selection of HRI work in the literature which has focused on learning-teaching interaction and analyze the interactional and learning mechanisms that were used in the light of pragmatic frames. This allows us to show that many of the works have already used in practice, but not always explicitly, basic elements of the pragmatic frames machinery. However, we also show that pragmatic frames have so far been used in a very restricted way as compared to how they are used in human-human interaction and argue that this has been an obstacle preventing robust natural multi-task learning and teaching in HRI. In particular, we explain that two central features of human pragmatic frames, mostly absent of existing HRI studies, are that (1) social peers use rich repertoires of frames, potentially combined together, to convey and infer multiple kinds of cues; (2) new frames can be learnt continually, building on existing ones, and guiding the interaction toward higher levels of complexity and expressivity. To conclude, we give an outlook on the future research direction describing the relevant key challenges that need to be solved for leveraging pragmatic frames for robot learning and teaching

The Role of Saliency in Learning First Words

In word learning, one key accomplishment is the reference, that is, the linking of a word to its referent. According to classical theories, the term reference captures a mental event: A person uses a word to mentally recall a concept of an entity (an object or event) in order to bring it into the mental focus of an interaction. The developmental literature proposes different approaches regarding how children accomplish this link. Although researchers agree that multiple processes (within and across phonological, lexical, and semantic areas) are responsible for word learning, recent research has highlighted the role of saliency and perception as crucial factors in the early phases of word learning. Generally speaking, whereas some approaches to solving the reference problem attribute a greater role to the referent’s properties being salient, others emphasize the social context that is needed to select the appropriate referent. In this review, we aim to systematize terminology and propose that the reason why assessments of the impact of saliency on word learning are controversial is that definitions of the term saliency reveal different weightings of the importance that either perceptual or social stimuli have for the learning process. We propose that defining early word learning in terms of paying attention to salient stimuli is too narrow. Instead, we emphasize that a new link between a word and its referent will succeed if a stimulus is relevant for the child

Robots show us how to teach them: Feedback from robots shapes tutoring behavior during action learning

Vollmer A-L, Mühlig M, Steil JJ, et al. Robots show us how to teach them: Feedback from robots shapes tutoring behavior during action learning. PLoS ONE. 2014;9(3): e91349.Robot learning by imitation requires the detection of a tutor's action demonstration and its relevant parts. Current approaches implicitly assume a unidirectional transfer of knowledge from tutor to learner. The presented work challenges this predominant assumption based on an extensive user study with an autonomously interacting robot. We show that by providing feedback, a robot learner influences the human tutor's movement demonstrations in the process of action learning. We argue that the robot's feedback strongly shapes how tutors signal what is relevant to an action and thus advocate a paradigm shift in robot action learning research toward truly interactive systems learning in and benefiting from interaction

Benefits of repeated book readings in children with SLI

In this pilot study, we ask whether repeated storybook reading is also beneficial for word learning in children diagnosed with specific language impairment (SLI). We compared 3-year-old German learning children diagnosed with SLI to typically developing children matched on age and socioeconomic status (SES). One week later, children with SLI retained the target words from the stories just as well as their peers, although they did perform significantly worse on immediate recall

Taking Up an Active Role: Emerging Participation in Early Mother–Infant Interaction during Peekaboo Routines

Dynamical systems approaches to social coordination underscore how participants' local actions give rise to and maintain global interactive patterns and how, in turn, they are also shaped by them. Developmental research can deliver important insights into both processes: (1) the stabilization of ways of interacting, and (2) the gradual shaping of the agentivity of the individuals. In this article we propose that infants' agentivity develops out of participation, i.e., acting a part in an interaction system. To investigate this development this article focuses on the ways in which participation in routinized episodes may shape infant's agentivity in social events. In contrast to existing research addressing more advanced forms of participating in social routines, our goal was to assess infants' early participation as evidence of infants' agentivity. In our study, 19 Polish mother–infant dyads were filmed playing peekaboo when the infants were 4 and 6 months of age. We operationalized infants' participation in the peekaboo in terms of their use of various behaviors across modalities during specific phases of the game: We included smiles, vocalizations, and attempts to cover and uncover themselves or their mothers. We hypothesized that infants and mothers would participate actively in the routine by regulating their behavior so as to adhere to the routine format. Furthermore, we hypothesized that infants who experienced more scaffolding would be able to adopt a more active role in the routine. We operationalized scaffolding as mothers' use of specific peekaboo structures that allowed infants to anticipate when it was their turn to act. Results suggested that infants as young as 4 months of age engaged in peekaboo and took up turns in the game, and that their participation increased at 6 months of age. Crucially, our results suggest that infants' behavior was organized by the global structure of the peekaboo game, because smiles, vocalizations, and attempts to uncover occurred significantly more often during specific phases rather than being evenly distributed across the whole interaction. Furthermore, the way mothers structured the game at 4 months predicted infant participation at both 4 and 6 months of age

Social/dialogical roles of social robots in supporting children's learning of language and literacy - A review and analysis of innovative roles

One of the many purposes for which social robots are designed is education, and there have been many attempts to systematize their potential in this field. What these attempts have in common is the recognition that learning can be supported in a variety of ways because a learner can be engaged in different activities that foster learning. Up to now, three roles have been proposed when designing these activities for robots: as a teacher or tutor, a learning peer, or a novice. Current research proposes that deciding in favor of one role over another depends on the content or preferred pedagogical form. However, the design of activities changes not only the content of learning, but also the nature of a human–robot social relationship. This is particularly important in language acquisition, which has been recognized as a social endeavor. The following review aims to specify the differences in human–robot social relationships when children learn language through interacting with a social robot. After proposing categories for comparing these different relationships, we review established and more specific, innovative roles that a robot can play in language-learning scenarios. This follows Mead’s (1946) theoretical approach proposing that social roles are performed in interactive acts. These acts are crucial for learning, because not only can they shape the social environment of learning but also engage the learner to different degrees. We specify the degree of engagement by referring to Chi’s (2009) progression of learning activities that range from active, constructive, toward interactive with the latter fostering deeper learning. Taken together, this approach enables us to compare and evaluate different human–robot social relationships that arise when applying a robot in a particular social role

Tutoring in adult-child-interaction: On the loop of the tutor's action modification and the recipient's gaze

Pitsch K, Vollmer A-L, Rohlfing K, Fritsch J, Wrede B. Tutoring in adult-child-interaction: On the loop of the tutor's action modification and the recipient's gaze. Interaction Studies. 2014;15(1):55-98.Research of tutoring in parent-infant interaction has shown that tutors - when presenting some action - modify both their verbal and manual performance for the learner (‘motherese’, ‘motionese’). Investigating the sources and effects of the tutors’ action modifications, we suggest an interactional account of ‘motionese’. Using video-data from a semi-experimental study in which parents taught their 8 to 11 month old infants how to nest a set of differently sized cups, we found that the tutors’ action modifications (in particular: high arches) functioned as an orienting device to guide the infant’s visual attention (gaze). Action modification and the recipient’s gaze can be seen to have a reciprocal sequential relationship and to constitute a constant loop of mutual adjustments. Implications are discussed for developmental research and for robotic ‘Social Learning’. We argue that a robot system could use on-line feedback strategies (e.g. gaze) to pro-actively shape a tutor’s action presentation as it emerges