Multivariate model for cooperation: bridging Social Physiological Compliance and Hyperscanning

The neurophysiological analysis of cooperation has evolved over the past 20 years, moving towards the research of common patterns in neurophysiological signals of people interacting. Social Physiological Compliance (SPC) and Hyperscanning represent two frameworks for the joint analysis of autonomic and brain signals respectively. Each of the two approaches allows to know about a single layer of cooperation according to the nature of these signals: SPC provides information mainly related to emotions, and Hyperscanning that related to cognitive aspects. In this work, after the analysis of the state of the art of SPC and Hyperscanning, we explored the possibility to unify the two approaches creating a complete neurophysiological model for cooperation considering both affective and cognitive mechanisms. We synchronously recorded electrodermal activity, cardiac and brain signals of 14 cooperative dyads. Time series from these signals were extracted and Multivariate Granger Causality was computed. The results showed that only when subjects in a dyad cooperate there is a statistically significant causality between the multivariate variables representing each subject. Moreover, the entity of this statistical relationship correlates with the dyad's performance. Finally, given the novelty of this approach and its exploratory nature, we provided its strengths and limitations

Donate or receive? Social hyperscanning application with fNIRS

Recent research in social neuroscience has shown how prosocial behavior can increase perceived self-efficacy, perception of cognitive abilitites and social interactions. The present research explored the effect of prosocial behavior, that is giving a gift during an interpersonal exchange, measuring the hyperscanning among two brains. The experiment aimed to analyze the behavioral performance and the brain-to-brain prefrontal neural activity of 16 dyads during a joint action consisting in a cooperative game, which took place in a laboratory setting controlled by an experimenter, to play before and after a gift exchange. Two different types of gift exchange were compared: experiential and material. Functional Near Infrared Spectroscopy (fNIRS) was applied to record brain activity. Inter-brain connectivity was calculated before and after the gift exchange. In behavioral data, a behavioral performance increase was observed after gift exchange, with accuracy improvement and response times decrease. Regarding intra-brain analyses, an increase in oxygenated hemoglobin was detected, especially in the dorsolateral prefrontal cortex (DLPFC) in both donor and receiver; and in the dorsal part of the premotor cortex (DPMC) in the donor. Moreover, as regards the gift type, greater activation in the DPLFC emerged in both the donor and the receiver after receiving an experiential gift. Finally, the results of the inter-brain connectivity analysis showed that after gift exchange, the donor and receiver brain activity was more synchronized in the DPMC and Frontal Eye Fields (FEF) areas. The present study provides a contribution to the identification of inter-brain functional connectivity when prosocial behaviors are played out

Social Consumer Neuroscience: Neurophysiological Measures of Advertising Effectiveness in a Social Context

The application of neurophysiological methods to study the effects of advertising on consumer purchase behavior has seen an enormous growth in recent years. However, little is known about the role social settings have on shaping the human brain during the processing of advertising stimuli. To address this issue, we first review previous key findings of neuroscience research on advertising effectiveness. Next, we discuss traditional advertising research into the effects social context has on the way consumers experience advertising messages and explain why marketers, who aim to predict advertising effectiveness, should place participants in social settings, in addition to the traditional ways of studying consumer brain responses to advertising in social isolation. This article contributes to the literature by offering advertising researchers a series of research agendas on the key indicators of advertising effectiveness (attention, emotion, memory, and preference). It aims to improve understanding of the impact social context has on consumers' neurophysiological responses to advertising messages

Connecting Brains and Bodies: Applying Physiological Computing to Support Social Interaction

Physiological and affective computing propose methods to improve human-machine interactions by adapting machines to the users' states. Recently, social signal processing (SSP) has proposed to apply similar methods to human-human interactions with the hope of better understanding and modeling social interactions. Most of the social signals employed are facial expressions, body movements and speech, but studies using physiological signals remain scarce. In this paper, we motivate the use of physiological signals in the context of social interactions. Specifically, we review studies which have investigated the relationship between various physiological indices and social interactions. We then propose two main directions to apply physiological SSP: using physiological signals of individual users as new social cues displayed in the group and using inter-user physiology to measure properties of the interactions such as conflict and social presence. We conclude that physiological measures have the potential to enhance social interactions and to connect peopl

Interpersonal Neural Entrainment during Early Social Interaction

Currently, we understand much about how children’s brains attend to and learn from information presented while they are alone, viewing a screen – but less about how interpersonal social influences are substantiated in the brain. Here, we consider research that examines how social behaviors affect not one, but both partners in a dyad. We review studies that measured interpersonal neural entrainment during early social interaction, considering two ways of measuring entrainment: concurrent entrainment (e.g., ‘when A is high, B is high’ – also known as synchrony) and sequential entrainment (‘changes in A forward-predict changes in B’). We discuss possible causes of interpersonal neural entrainment, and consider whether it is merely an epiphenomenon, or whether it plays an independent, mechanistic role in early attention and learning

Neural foundations of cooperative social interactions

The embodied-embedded-enactive-extended (4E) approach to study cognition suggests that interaction with the world is a crucial component of our cognitive processes. Most of our time, we interact with other people. Therefore, studying cognition without interaction is incomplete. Until recently, social neuroscience has only focused on studying isolated human and animal brains, leaving interaction unexplored. To fill this gap, we studied interacting participants, focusing on both intra- and inter-brain (hyperscanning) neural activity. In the first study, we invited dyads to perform a visual task in both a cooperative and a competitive context while we measured EEG. We found that mid-frontal activity around 200-300 ms after receiving monetary rewards was sensitive to social context and differed between cooperative and competitive situations. In the second study, we asked participants to coordinate their movements with each other and with a robotic partner. We found significantly stronger EEG amplitudes at frontocentral electrodes when people interacted with a robotic partner. Lastly, we performed a comprehensive literature review and the first meta-analysis in the emerging field of hyperscanning that validated it as a method to study social interaction. Taken together, our results showed that adding a second participant (human or AI/robotic) fostered our understanding of human cognition. We learned that the activity at frontocentral electrodes is sensitive to social context and type of partner (human or robotic). In both studies, the participants’ interaction was required to show these novel neural processes involved in action monitoring. Similarly, studying inter-brain neural activity allows for the exploration of new aspects of cognition. Many cognitive functions involved in successful social interactions are accompanied by neural synchrony between brains, suggesting the extended form of our cognition

Exploring the Connected Brain by fNIRS: Human-to-Human Interactions Engineering

Functional Near Infrared Spectroscopy (fNIRS) is a relatively new neuroimaging technique adequate and useful for exploring neural activity in social contexts involving human interactions. Compared to functional Magnetic Resonance Imaging (fMRI), fNIRS is easy-to-use safe, noninvasive, silent, relatively low cost and portable, and applicable to subjects of all ages, thus resulting in a good option for ecological studies involving humans in their real-life context. Moreover, by using hyperscanning technique, fNIRS allows recording the hemodynamic cerebral activity of two interacting subjects in an ecological context or during a shared performance. Thus, moving from a simple analysis about each subject\u2019s neural response during joint actions towards more complex computations makes possible to investigate brain synchrony, that is the if and how one\u2019s brain activity is related to that of another interacting partner simultaneously recorded. Here, we discuss how connectivity analyses, with respect to both time and frequency domain procedures, permitted to deepen some aspects of inter-brain synchrony in relation to emotional closeness, and to highlight how concurrent, cooperative actions can lead to interpersonal synchrony and bond construction

Quantification of inter-brain coupling: A review of current methods used in haemodynamic and electrophysiological hyperscanning studies

Hyperscanning is a form of neuroimaging experiment where the brains of two or more participants are imaged simultaneously whilst they interact. Within the domain of social neuroscience, hyperscanning is increasingly used to measure inter-brain coupling (IBC) and explore how brain responses change in tandem during social interaction. In addition to cognitive research, some have suggested that quantification of the interplay between interacting participants can be used as a biomarker for a variety of cognitive mechanisms aswell as to investigate mental health and developmental conditions including schizophrenia, social anxiety and autism. However, many different methods have been used to quantify brain coupling and this can lead to questions about comparability across studies and reduce research reproducibility. Here, we review methods for quantifying IBC, and suggest some ways moving forward. Following the PRISMA guidelines, we reviewed 215 hyperscanning studies, across four different brain imaging modalities: functional near-infrared spectroscopy (fNIRS), functional magnetic resonance (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). Overall, the review identified a total of 27 different methods used to compute IBC. The most common hyperscanning modality is fNIRS, used by 119 studies, 89 of which adopted wavelet coherence. Based on the results of this literature survey, we first report summary statistics of the hyperscanning field, followed by a brief overview of each signal that is obtained from each neuroimaging modality used in hyperscanning. We then discuss the rationale, assumptions and suitability of each method to different modalities which can be used to investigate IBC. Finally, we discuss issues surrounding the interpretation of each method