A Gaze into politics. The role of ideology, personality and political group processing in shaping automatic social behaviors

Studies in human and non-human primates indicate that basic socio-cognitive operations are inherently linked to the power of gaze in capturing reflexively the attention of an observer. Here I report a series of behavioral and neural investigation studies that I and my collaborators have conducted on the modulation of this automatic social behavior by high order factors as politics. In particular, we showed that Gaze following behavior is permeable to social identities within the political domain, individual differences in ideology and personality and low level facial features that drive our inferences on the personality of a character. Furthermore I discussed which are the social processes that underly this basic social cognitive behavior and sketched future directions to better clarify this issue

Virtual vs Digital: Examples of Netnography and Digital Ethnography in Tourism Studies for a Comparison between Methods

With this paper our goal is to formalize the main differences between the applicationsof ethnographic techniques when they are framed in Virtual or Digital Methods. To be more systematic in presenting these differences, a synoptic table is offered. This table examines the main breaking points between the methods and is used to organize a marked comparison between two tourism studies chosen as being representative; one for the ethnographic application of Virtual Methods, and one for the ethnographic application of Digital Methods. In addition to testing the effectiveness of the proposed classification scheme, the purpose of the comparison conducted between the two tourism studies is to highlight where the changes that have occurred can lead to advances in the method and where these changes have become new limits on which it is necessary to continue to reflect in order to develop the methods involved and place them clearly in line with the evolution of the digital scenario

The Experience of Physical and Social Presence in a Virtual Learning Environment as Impacted by the Affordance of Movement Enabled by Motion Tracking

This research synthesizes existing research findings that social presence (sense of connection with others) and physical presence (sense of being there) increase learning outcomes in Virtual Learning Environments (VLEs) with findings that traditional motion tracking of participants wearing head mounted displays in virtual reality increases both physical and social presence. This information suggests that motion tracking in mixed reality VLEs has a positive impact on social presence and on physical presence. For this study, the affordance of free movement among virtual objects is enabled by Microsoft Kinect tracking of the user\u27s position that is translated to movement of the virtual camera to simulate user movement and proximity to elements of the virtual environment. This study used a mixed method, multimodal approach including qualitative, subjective, objective, and physiological data to measure social and physical presence. The testbed for this research was TLE TeachLivE™, a mixed reality classroom populated with virtual students. The subjective measures are 1) modified Witmer and Singer Questionnaire and 2) Social Presence Instrument (Bailenson, 2002b). The objective measure is a literature based Social Presence Behavioral Coding sheet used to record frequency of occurrences of factors of social presence. Finally, the physiological measure is heart rate as recorded by the MIO Alpha. The primary contribution of this study was that the hypotheses that the affordance of movement in a mixed reality classroom has a positive impact on user perception and experience of a) physical presence and b) social presence in a VLE were supported. This hypothesis was supported in all three measures. The secondary contribution of this research is the literature based Social Presence Behavioral Coding. The final contribution of this research is a research framework that integrates subjective, objective, and physiological measures of social presence in one study. This approach can be applied to various user experience research studies of various VLEs. Finally, in addition to general alignment of the physiological, objective, and subjective measures, there were anecdotal instances of factors of social presence occurring simultaneously with increased heart rate

The association of early touchscreen media use with the development of visual attention and executive function

Attention plays a pivotal role in information processing by filtering the potential information available based on individual goals, states, and past experiences. Early attention control is thought to underpin and support executive functions (EFs), which in turn are predictive of later behavioural outcomes. The development of attention and EF is partly subject to environmental influences, such as the use of digital media. There is a rapid increase in accessibility and usability of mobile touchscreen devices (i.e. smartphones and tablets) in the family environment, but rigorous scientific research investigating the impact on the developing mind lags behind the widespread usage. To address this, children with different levels of touchscreen use were followed longitudinally at 12 months, 18 months, and 3.5 years, and tested on attention control (bottom-up, and top-down), and EF (updating, shifting, and inhibiting). Children with high touchscreen use were faster on single (i.e. pop-out) visual search, with the amount of concurrent use associated with the speed of bottom-up attention in a linear manner. This saliency bias was repeatedly found on saccadic control tasks, where steady longitudinal high use was associated with a quickening of attention to peripheral salient onsets with a resulting detriment to top-down performance, i.e. disengagement and inhibition of attention. Finally, top-down difficulties were also seen in EF tasks in high users at 3.5 years, particularly in processes of updating and shifting between abstract mental sets. These results point to an influence of touchscreens use on the emerging attention and EF systems, in a way that experience of salient and contingent digital content elicits automatic biases to bottom-up processing, and displaces competency of top-down control and/or increases reliance on stimulus-response pairings. Future studies are needed to demonstrate causality, and to understand long-term trajectories and the interplay between bottom-up and top-down processes over time

Humanoid-based protocols to study social cognition

Social cognition is broadly defined as the way humans understand and process their interactions with other humans. In recent years, humans have become more and more used to interact with non-human agents, such as technological artifacts. Although these interactions have been restricted to human-controlled artifacts, they will soon include interactions with embodied and autonomous mechanical agents, i.e., robots. This challenge has motivated an area of research related to the investigation of human reactions towards robots, widely referred to as Human-Robot Interaction (HRI). Classical HRI protocols often rely on explicit measures, e.g., subjective reports. Therefore, they cannot address the quantification of the crucial implicit social cognitive processes that are evoked during an interaction. This thesis aims to develop a link between cognitive neuroscience and human-robot interaction (HRI) to study social cognition. This approach overcomes methodological constraints of both fields, allowing to trigger and capture the mechanisms of real-life social interactions while ensuring high experimental control. The present PhD work demonstrates this through the systematic study of the effect of online eye contact on gaze-mediated orienting of attention. The study presented in Publication I aims to adapt the gaze-cueing paradigm from cognitive science to an objective neuroscientific HRI protocol. Furthermore, it investigates whether the gaze-mediated orienting of attention is sensitive to the establishment of eye contact. The study replicates classic screen-based findings of attentional orienting mediated by gaze both at behavioral and neural levels, highlighting the feasibility and the scientific value of adding neuroscientific methods to HRI protocols. The aim of the study presented in Publication II is to examine whether and how real-time eye contact affects the dual-component model of joint attention orienting. To this end, cue validity and stimulus-to-onset asynchrony are also manipulated. The results show an interactive effect of strategic (cue validity) and social (eye contact) top-down components on the botton-up reflexive component of gaze-mediated orienting of attention. The study presented in Publication III aims to examine the subjective engagement and attribution of human likeness towards the robot depending on established eye contact or not during a joint attention task. Subjective reports show that eye contact increases human likeness attribution and feelings of engagement with the robot compared to a no-eye contact condition. The aim of the study presented in Publication IV is to investigate whether eye contact established by a humanoid robot affects objective measures of engagement (i.e. joint attention and fixation durations), and subjective feelings of engagement with the robot during a joint attention task. Results show that eye contact modulates attentional engagement, with longer fixations at the robot’s face and cueing effect when the robot establishes eye contact. In contrast, subjective reports show that the feeling of being engaged with the robot in an HRI protocol is not modulated by real-time eye contact. This study further supports the necessity for adding objective methods to HRI. Overall, this PhD work shows that embodied artificial agents can advance the theoretical knowledge of social cognitive mechanisms by serving as sophisticated interactive stimuli of high ecological validity and excellent experimental control. Moreover, humanoid-based protocols grounded in cognitive science can advance the HRI community by informing about the exact cognitive mechanisms that are present during HRI