Using Noninvasive Brain Measurement to Explore the Psychological Effects of Computer Malfunctions on Users during Human-Computer Interactions

In today’s technologically driven world, there is a need to better understand the ways that common computer malfunctions affect computer users. These malfunctions may have measurable influences on computer user’s cognitive, emotional, and behavioral responses. An experiment was conducted where participants conducted a series of web search tasks while wearing functional nearinfrared spectroscopy (fNIRS) and galvanic skin response sensors. Two computer malfunctions were introduced during the sessions which had the potential to influence correlates of user trust and suspicion. Surveys were given after each session to measure user’s perceived emotional state, cognitive load, and perceived trust. Results suggest that fNIRS can be used to measure the different cognitive and emotional responses associated with computer malfunctions. These cognitive and emotional changes were correlated with users’ self-report levels of suspicion and trust, and they in turn suggest future work that further explores the capability of fNIRS for the measurement of user experience during human-computer interactions

Using fNIRS to Identify Transparency- and Reliability-Sensitive Markers of Trust Across Multiple Timescales in Collaborative Human-Human-Agent Triads

Intelligent agents are rapidly evolving from assistants into teammates as they perform increasingly complex tasks. Successful human-agent teams leverage the computational power and sensory capabilities of automated agents while keeping the human operator's expectation consistent with the agent's ability. This helps prevent over-reliance on and under-utilization of the agent to optimize its effectiveness. Research at the intersection of human-computer interaction, social psychology, and neuroergonomics has identified trust as a governing factor of human-agent interactions that can be modulated to maintain an appropriate expectation. To achieve this calibration, trust can be monitored continuously and unobtrusively using neurophysiological sensors. While prior studies have demonstrated the potential of functional near-infrared spectroscopy (fNIRS), a lightweight neuroimaging technology, in the prediction of social, cognitive, and affective states, few have successfully used it to measure complex social constructs like trust in artificial agents. Even fewer studies have examined the dynamics of hybrid teams of more than 1 human or 1 agent. We address this gap by developing a highly collaborative task that requires knowledge sharing within teams of 2 humans and 1 agent. Using brain data obtained with fNIRS sensors, we aim to identify brain regions sensitive to changes in agent behavior on a long- and short-term scale. We manipulated agent reliability and transparency while measuring trust, mental demand, team processes, and affect. Transparency and reliability levels are found to significantly affect trust in the agent, while transparency explanations do not impact mental demand. Reducing agent communication is shown to disrupt interpersonal trust and team cohesion, suggesting similar dynamics as human-human teams. Contrasts of General Linear Model analyses identify dorsal medial prefrontal cortex activation specific to assessing the agent's transparency explanations and characterize increases in mental demand as signaled by dorsal lateral prefrontal cortex and frontopolar activation. Short scale event-level data is analyzed to show that predicting whether an individual will trust the agent, with data from 15 s before their decision, is feasible with fNIRS data. Discussing our results, we identify targets and directions for future neuroergonomics research as a step toward building an intelligent trust-modulation system to optimize human-agent collaborations in real time. &nbsp;</p

Interdisciplinary views of fNIRS: Current advancements, equity challenges, and an agenda for future needs of a diverse fNIRS research community

Functional Near-Infrared Spectroscopy (fNIRS) is an innovative and promising neuroimaging modality for studying brain activity in real-world environments. While fNIRS has seen rapid advancements in hardware, software, and research applications since its emergence nearly 30 years ago, limitations still exist regarding all three areas, where existing practices contribute to greater bias within the neuroscience research community. We spotlight fNIRS through the lens of different end-application users, including the unique perspective of a fNIRS manufacturer, and report the challenges of using this technology across several research disciplines and populations. Through the review of different research domains where fNIRS is utilized, we identify and address the presence of bias, specifically due to the restraints of current fNIRS technology, limited diversity among sample populations, and the societal prejudice that infiltrates today's research. Finally, we provide resources for minimizing bias in neuroscience research and an application agenda for the future use of fNIRS that is equitable, diverse, and inclusive

The Construct of State-Level Suspicion: A Model and Research Agenda for Automated and Information Technology (IT) Contexts

Objective: The objective was to review and integrate available research about the construct of state-level suspicion as it appears in social science literatures and apply the resulting findings to information technology (IT) contexts. Background: Although the human factors literature is replete with articles about trust (and distrust) in automation, there is little on the related, but distinct, construct of “suspicion” (in either automated or IT contexts). The construct of suspicion—its precise definition, theoretical correlates, and role in such applications—deserves further study. Method: Literatures that consider suspicion are reviewed and integrated. Literatures include communication, psychology, human factors, management, marketing, information technology, and brain/neurology. We first develop a generic model of state-level suspicion. Research propositions are then derived within IT contexts. Results: Fundamental components of suspicion include (a) uncertainty, (b) increased cognitive processing (e.g., generation of alternative explanations for perceived discrepancies), and (c) perceptions of (mal)intent. State suspicion is defined as the simultaneous occurrence of these three components. Our analysis also suggests that trust inhibits suspicion, whereas distrust can be a catalyst of state-level suspicion. Based on a three-stage model of state-level suspicion, associated research propositions and questions are developed. These propositions and questions are intended to help guide future work on the measurement of suspicion (self-report and neurological), as well as the role of the construct of suspicion in models of decision making and detection of deception. Conclusion: The study of suspicion, including its correlates, antecedents, and consequences, is important. We hope that the social sciences will benefit from our integrated definition and model of state suspicion. The research propositions regarding suspicion in IT contexts should motivate substantial research in human factors and related fields

The Construct of Suspicion and How It Can Benefit Theories and Models in Organizational Science

This article introduces the construct of suspicion to researchers in business and applied psychology, provides a literature-based definition of state suspicion and an initial self-report measure of that construct, and encourages research on this important topic. The construct of suspicion is under-researched in business and applied psychology, yet has wide application for both researchers and practitioners. These applications occur across many content domains (e.g., consumer psychology, leadership), as well as at varying levels of analysis (e.g., individual, group, organizational). To motivate research on this construct, possible studies are delineated/suggested by way of example and a Call for Papers also appears. The organizational sciences will benefit from the incorporation of suspicion-based constructs in theoretical and explanatory models. Organizations might also function more efficiently because of these efforts —as decision makers assess, understand, and better manage appropriate levels of suspicion in their employees and work groups

Using functional Near-Infrared Spectroscopy in HCI: Toward evaluation methods and adaptive interfaces

Functional Near-Infrared Spectroscopy (fNIRS) is a new brain imaging tool that shows potential for use in the field of human computer interaction (HCI) because of its lightweight, non-invasive qualities. fNIRS could become an additional input to interfaces, by recording the user‟s mental state through the measure of blood flow in the brain. However, before we are able to use the tool at its full potential, we must test its feasibility in HCI, and develop methods to accurately analyze the output. This paper will introduce fNIRS, and briefly discuss a feasibility study conducted to explore the measurement of different levels of workload. Finally, we will present future research directions that follow from this work, such as evaluating new interaction styles according to the measured mental workload, adaptive interfaces with fNIRS, and combining fNIRS with EEG. Author Keywords brain computer interfaces (BCI), workload, fNIRS

Table_1_Friend or foe: classifying collaborative interactions using fNIRS.pdf

To succeed, effective teams depend on both cooperative and competitive interactions between individual teammates. Depending on the context, cooperation and competition can amplify or neutralize a team's problem solving ability. Therefore, to assess successful collaborative problem solving, it is first crucial to distinguish competitive from cooperative interactions. We investigate the feasibility of using lightweight brain sensors to distinguish cooperative from competitive interactions in pairs of participants (N=84) playing a decision-making game involving uncertain outcomes. We measured brain activity using functional near-infrared spectroscopy (fNIRS) from social, motor, and executive areas during game play alone and in competition or cooperation with another participant. To distinguish competitive, cooperative, and alone conditions, we then trained support vector classifiers using combinations of features extracted from fNIRS data. We find that features from social areas of the brain outperform other features for discriminating competitive, cooperative, and alone conditions in cross-validation. Comparing the competitive and alone conditions, social features yield a 5% improvement over motor and executive features. Social features show promise as means of distinguishing competitive and cooperative environments in problem solving settings. Using fNIRS data provides a real-time measure of subjective experience in an ecologically valid environment. These results have the potential to inform intelligent team monitoring to provide better real-time feedback and improve team outcomes in naturalistic settings.</p