Gaze-contingent reinforcement learning reveals incentive value of social signals in young children and adults

While numerous studies have demonstrated that infants and adults preferentially orient to social stimuli, it remains unclear as to what drives such preferential orienting. It has been suggested that the learned association between social cues and subsequent reward delivery might shape such social orienting. Using a novel, spontaneous indication of reinforcement learning (with the use of a gaze contingent reward-learning task), we investigated whether children and adults' orienting towards social and non-social visual cues can be elicited by the association between participants' visual attention and a rewarding outcome. Critically, we assessed whether the engaging nature of the social cues influences the process of reinforcement learning. In the current study, both children and adults learned to orient more often to the visual cues associated with reward delivery, demonstrating that cue-reward association reinforced visual orienting. More importantly, when the reward-predictive cue was social and engaging, both children and adults learned the cue-reward association faster and more efficiently than when the reward-predictive cue was social but non-engaging. These new findings indicate that social engaging cues have a positive incentive value. This could possibly be because they usually coincide with positive outcomes in real life, which could partly drive the development of social orienting

Cultural background modulates how we look at other persons' gaze

The current study investigated the role of cultural norms on the development of face-scanning. British and Japanese adults’ eye movements were recorded while they observed avatar faces moving their mouth, and then their eyes toward or away from the participants. British participants fixated more on the mouth, which contrasts with Japanese participants fixating mainly on the eyes. Moreover, eye fixations of British participants were less affected by the gaze shift of the avatar than Japanese participants, who shifted their fixation to the corresponding direction of the avatar’s gaze. Results are consistent with the Western cultural norms that value the maintenance of eye contact, and the Eastern cultural norms that require flexible use of eye contact and gaze aversion

Simulating interaction: Using gaze-contingent eye-tracking to measure the reward value of social signals in toddlers with and without autism.

Several accounts have been proposed to explain difficulties with social interaction in autism spectrum disorder (ASD), amongst which atypical social orienting, decreased social motivation or difficulties with understanding the regularities driving social interaction. This study uses gaze-contingent eye-tracking to tease apart these accounts by measuring reward related behaviours in response to different social videos. Toddlers at high or low familial risk for ASD took part in this study at age 2 and were categorised at age 3 as low risk controls (LR), high-risk with no ASD diagnosis (HR-no ASD), or with a diagnosis of ASD (HR-ASD). When the on-demand social interaction was predictable, all groups, including the HR-ASD group, looked longer and smiled more towards a person greeting them compared to a mechanical Toy (Condition 1) and also smiled more towards a communicative over a non-communicative person (Condition 2). However, all groups, except the HR-ASD group, selectively oriented towards a person addressing the child in different ways over an invariant social interaction (Condition 3). These findings suggest that social interaction is intrinsically rewarding for individuals with ASD, but the extent to which it is sought may be modulated by the specific variability of naturalistic social interaction

Belief-based action prediction in preverbal infants

Successful mindreading entails both the ability to think about what others know or believe, and to use this knowledge to generate predictions about how mental states will influence behavior. While previous studies have demonstrated that young infants are sensitive to others’ mental states, there continues to be much debate concerning how to characterize early theory of mind abilities. In the current study, we asked whether 6-month-old infants appreciate the causal role that beliefs play in action. Specifically, we tested whether infants generate action predictions that are appropriate given an agent’s current belief. We exploited a novel, neural indication of action prediction: motor cortex activation as measured by sensorimotor alpha suppression, to ask whether infants would generate differential predictions depending on an agent’s belief. After first verifying our paradigm and measure with a group of adult participants, we found that when an agent had a false belief that a ball was in the box, motor activity indicated that infants predicted she would reach for the box, but when the agent had a false belief that a ball was not in the box, infants did not predict that she would act. In both cases, infants based their predictions on what the agent, rather than the infant, believed to be the case, suggesting that by 6 months of age, infants can exploit their sensitivity to other minds for action prediction

Supplementary information S2 (pdf): Additional analyses. from Gaze-contingent reinforcement learning reveals incentive value of social signals in young children and adults

The supplementary information S2 includes additional analyses investigating the initial exposure to both engaging and non-engaging cues, the proportion of looking time on the reward-predictive cue at pre-test and post-test, the side bias at pre-test and post- test, the children and adults’ impression of the task and the viewing time of the reward (cartoon)

Supplementary information S1 (video): Visualization of the task. from Gaze-contingent reinforcement learning reveals incentive value of social signals in young children and adults

The supplementary information S1 includes a video displaying the task in the four different conditions investigated in the study (social and engaging reward predictive cue; social and non-engaging reward predictive cue; non-social and engaging reward predictive cue and non-social and non-engaging reward predictive cue)