A Classification Model for Sensing Human Trust in Machines Using EEG and GSR

Today, intelligent machines \emph{interact and collaborate} with humans in a way that demands a greater level of trust between human and machine. A first step towards building intelligent machines that are capable of building and maintaining trust with humans is the design of a sensor that will enable machines to estimate human trust level in real-time. In this paper, two approaches for developing classifier-based empirical trust sensor models are presented that specifically use electroencephalography (EEG) and galvanic skin response (GSR) measurements. Human subject data collected from 45 participants is used for feature extraction, feature selection, classifier training, and model validation. The first approach considers a general set of psychophysiological features across all participants as the input variables and trains a classifier-based model for each participant, resulting in a trust sensor model based on the general feature set (i.e., a "general trust sensor model"). The second approach considers a customized feature set for each individual and trains a classifier-based model using that feature set, resulting in improved mean accuracy but at the expense of an increase in training time. This work represents the first use of real-time psychophysiological measurements for the development of a human trust sensor. Implications of the work, in the context of trust management algorithm design for intelligent machines, are also discussed.Comment: 20 page

Using Noninvasive Brain Measurement to Explore the Psychological Effects of Computer Malfunctions on Users during Human-Computer Interactions

In today’s technologically driven world, there is a need to better understand the ways that common computer malfunctions affect computer users. These malfunctions may have measurable influences on computer user’s cognitive, emotional, and behavioral responses. An experiment was conducted where participants conducted a series of web search tasks while wearing functional nearinfrared spectroscopy (fNIRS) and galvanic skin response sensors. Two computer malfunctions were introduced during the sessions which had the potential to influence correlates of user trust and suspicion. Surveys were given after each session to measure user’s perceived emotional state, cognitive load, and perceived trust. Results suggest that fNIRS can be used to measure the different cognitive and emotional responses associated with computer malfunctions. These cognitive and emotional changes were correlated with users’ self-report levels of suspicion and trust, and they in turn suggest future work that further explores the capability of fNIRS for the measurement of user experience during human-computer interactions

Acute and Chronic Effects of Green Oat (Avena sativa) Extract on Cognitive Function and Mood during a Laboratory Stressor in Healthy Adults: A Randomised, Double-Blind, Placebo-Controlled Study in Healthy Humans

Green oat (Avena sativa) extracts contain several groups of potentially psychoactive phytochemicals. Previous research has demonstrated improvements in cognitive function following a single dose of these extracts, but not following chronic supplementation. Additionally, whilst green oat extracts contain phytochemicals that may improve mood or protect against stress, for instance species-specific triterpene saponins, to date this possibility has not been examined. The current study investigated the effects of a single dose and four weeks of administration of a novel, Avena sativa herbal extract (cognitaven®) on cognitive function and mood, and changes in psychological state during a laboratory stressor. The study adopted a dose-ranging, double-blind, randomised, parallel groups design in which 132 healthy males and females (35 to 65 years) received either 430 mg, 860 mg, 1290 mg green oat extract or placebo for 29 days. Assessments of cognitive function, mood and changes in psychological state during a laboratory stressor (Observed Multitasking Stressor) were undertaken pre-dose and at 2 h and 4 h post-dose on the first (Day 1) and last days (Day 29) of supplementation. The results showed that both a single dose of 1290 mg and, to a greater extent, supplementation for four weeks with both 430 mg and 1290 mg green oat extract resulted in significantly improved performance on a computerised version of the Corsi Blocks working memory task and a multitasking task (verbal serial subtractions and computerised tracking) in comparison to placebo. After four weeks, the highest dose also decreased the physiological response to the stressor in terms of electrodermal activity. There were no treatment-related effects on mood. These results confirm the acute cognitive effects of Avena sativa extracts and are the first to demonstrate that chronic supplementation can benefit cognitive function and modulate the physiological response to a stressor

Noninvasive vagus nerve stimulation alters neural response and physiological autonomic tone to noxious thermal challenge.

The mechanisms by which noninvasive vagal nerve stimulation (nVNS) affect central and peripheral neural circuits that subserve pain and autonomic physiology are not clear, and thus remain an area of intense investigation. Effects of nVNS vs sham stimulation on subject responses to five noxious thermal stimuli (applied to left lower extremity), were measured in 30 healthy subjects (n = 15 sham and n = 15 nVNS), with fMRI and physiological galvanic skin response (GSR). With repeated noxious thermal stimuli a group × time analysis showed a significantly (p < .001) decreased response with nVNS in bilateral primary and secondary somatosensory cortices (SI and SII), left dorsoposterior insular cortex, bilateral paracentral lobule, bilateral medial dorsal thalamus, right anterior cingulate cortex, and right orbitofrontal cortex. A group × time × GSR analysis showed a significantly decreased response in the nVNS group (p < .0005) bilaterally in SI, lower and mid medullary brainstem, and inferior occipital cortex. Finally, nVNS treatment showed decreased activity in pronociceptive brainstem nuclei (e.g. the reticular nucleus and rostral ventromedial medulla) and key autonomic integration nuclei (e.g. the rostroventrolateral medulla, nucleus ambiguous, and dorsal motor nucleus of the vagus nerve). In aggregate, noninvasive vagal nerve stimulation reduced the physiological response to noxious thermal stimuli and impacted neural circuits important for pain processing and autonomic output

Good news or bad news, which do you want first? The importance of the sequence and organization of Information for financial decision-making: a neuro-electrical imaging study

Investment decisions are largely based on the information investors received from the target firm. Thaler introduced the hedonic editing framework, in which suggests that integration/segregation of information influence individual's perceived value. Meanwhile, when evaluating the evidence and information in a sequence, order effect and biases have been found to have an impact in various areas. In this research, the influence of the Organization of Information (Integration vs. Segregation) and the Sequence of Information (Negative-Positive order vs. Positive-Negative order) on individual's investment decision-making both at the behavioral level (decision) and neurometrix level (measured by an individual's emotion and Approach Withdraw tendency) was assessed for the three groups of information: a piece of Big Positive Information and a piece of Small Negative Information, a piece of Big Negative Information and a piece of Small Positive Information, and a piece of Small Negative information. The behavioral results, which are an individual's final investment decision, were consistent for all three scenarios. In general, individuals will invest more/retire less when receiving two pieces of information in a Negative-Positive order. However, the neurometric results (Emotional Index, Approach Withdraw Index and results from LORETA) show differences among information groups. An effect of the Sequence of Information and the Organization of Information was found for the different scenarios. The results suggest that in the scenarios that involve large-scale information, the organization of information (Integration vs. Segregation) influences the emotion and Approach Withdraw tendency. The results of this investigation should provide insight for effective communication of information, especially when large-scale information is involved

Proximity and gaze influences facial temperature:a thermal infrared imaging study

Direct gaze and interpersonal proximity are known to lead to changes in psycho-physiology, behaviour and brain function. We know little, however, about subtler facial reactions such as rise and fall in temperature, which may be sensitive to contextual effects and functional in social interactions. Using thermal infrared imaging cameras 18 female adult participants were filmed at two interpersonal distances (intimate and social) and two gaze conditions (averted and direct). The order of variation in distance was counterbalanced: half the participants experienced a female experimenter’s gaze at the social distance first before the intimate distance (a socially ‘normal’ order) and half experienced the intimate distance first and then the social distance (an odd social order). At both distances averted gaze always preceded direct gaze. We found strong correlations in thermal changes between six areas of the face (forehead, chin, cheeks, nose, maxilliary and periorbital regions) for all experimental conditions and developed a composite measure of thermal shifts for all analyses. Interpersonal proximity led to a thermal rise, but only in the ‘normal’ social order. Direct gaze, compared to averted gaze, led to a thermal increase at both distances with a stronger effect at intimate distance, in both orders of distance variation. Participants reported direct gaze as more intrusive than averted gaze, especially at the intimate distance. These results demonstrate the powerful effects of another person’s gaze on psycho-physiological responses, even at a distance and independent of context

Modeling and Characterization of Acute Stress under Dynamic Task Conditions

Stress can be defined as the mental, physical, and emotional response of humans to stressors encountered in their personal or professional environment. Stressors are introduced in various activities, especially those found in dynamic task conditions when multiple task requirements must be performed. Stress and stressors have been described as activators and inhibitors of human performance. The ability to manage high levels of acute stress is an important determinant of successful performance in any occupation. In situations where performance is critical, personnel must be prepared to operate successfully under hostile or extreme stress conditions; therefore training programs and engineered systems must be tailored to assist humans in fulfilling these demands. To effectively design appropriate training programs for these conditions, it is necessary to quantitatively describe stress. A series of theoretical stress models have been developed in previous research studies; however, these do not provide quantification of stress levels nor the impact on human performance. By modeling acute stress under dynamic task conditions, quantitative values for stress and its impact on performance can be assessed. Thus, this research was designed to develop a predictive model for acute stress as a function of human performance and task demand. Initially, a four factor two level experimental design (2 (Noise) x 2 (Temperature) x 2 (Time Awareness) x 2 (Workload)) was performed to identify reliable physiological, cognitive and behavioral responses to stress. Next, multivariate analysis of variance (n=108) tests were performed, which showed statistically significant differences for physiological, cognitive and behavioral responses. Finally, fuzzy set theory techniques were used to develop a comprehensive stress index model. Thus, the resulting stress index model was constructed using input on physiological, cognitive and behavioral responses to stressors as well as characteristics inherent to the type of task performed and personal factors that interact as mediators (competitiveness, motivation, coping technique and proneness to boredom). Through using this stress index model to quantify and characterize the affects of acute stress on human performance, these research findings can inform proper training protocols and help to redesign tasks and working conditions that are prone to create levels of acute stress that adversely affect human performance