The Usefulness of Multi-Sensor Affect Detection on User Experience: An Application of Biometric Measurement Systems on Online Purchasing

abstract: Traditional usability methods in Human-Computer Interaction (HCI) have been extensively used to understand the usability of products. Measurements of user experience (UX) in traditional HCI studies mostly rely on task performance and observable user interactions with the product or services, such as usability tests, contextual inquiry, and subjective self-report data, including questionnaires, interviews, and usability tests. However, these studies fail to directly reflect a user’s psychological involvement and further fail to explain the cognitive processing and the related emotional arousal. Thus, capturing how users think and feel when they are using a product remains a vital challenge of user experience evaluation studies. Conversely, recent research has revealed that sensor-based affect detection technologies, such as eye tracking, electroencephalography (EEG), galvanic skin response (GSR), and facial expression analysis, effectively capture affective states and physiological responses. These methods are efficient indicators of cognitive involvement and emotional arousal and constitute effective strategies for a comprehensive measurement of UX. The literature review shows that the impacts of sensor-based affect detection systems to the UX can be categorized in two groups: (1) confirmatory to validate the results obtained from the traditional usability methods in UX evaluations; and (2) complementary to enhance the findings or provide more precise and valid evidence. Both provided comprehensive findings to uncover the issues related to mental and physiological pathways to enhance the design of product and services. Therefore, this dissertation claims that it can be efficient to integrate sensor-based affect detection technologies to solve the current gaps or weaknesses of traditional usability methods. The dissertation revealed that the multi-sensor-based UX evaluation approach through biometrics tools and software corroborated user experience identified by traditional UX methods during an online purchasing task. The use these systems enhanced the findings and provided more precise and valid evidence to predict the consumer purchasing preferences. Thus, their impact was “complementary” on overall UX evaluation. The dissertation also provided information of the unique contributions of each tool and recommended some ways user experience researchers can combine both sensor-based and traditional UX approaches to explain consumer purchasing preferences.Dissertation/ThesisDoctoral Dissertation Human Systems Engineering 201

Accuracy and precision of fixation locations recorded with the low-cost Eye Tribe tracker in different experimental set-ups

This article compares the accuracy and precision of the low-cost Eye Tribe tracker and a well-established comparable eye tracker: SMI RED 250. Participants were instructed to fixate on predefined point locations on a screen. The accuracy is measured by the distance between the recorded fixation locations and the actual location. Precision is represented by the standard deviation of these measurements. Furthermore, the temporal precision of both eye tracking devices (sampling rate) is evaluated as well. The obtained results illustrate that a correct set-up and selection of software to record and process the data are of utmost importance to obtain acceptable results with the low-cost device. Nevertheless, with careful selections in each of these steps, the quality (accuracy and precision) of the recorded data can be considered comparable

Evaluation of Technology Concepts for Energy, Automation, and System State Awareness in Commercial Airline Flight Decks

A pilot-in-the-loop flight simulation study was conducted at NASA Langley Research Center to evaluate flight deck systems that (1) provide guidance for recovery from low energy states and stalls, (2) present the current state and expected future state of automated systems, and/or (3) show the state of flight-critical data systems in use by automated systems and primary flight instruments. The study was conducted using 13 commercial airline crews from multiple airlines, paired by airline to minimize procedural effects. Scenarios spanned a range of complex conditions and several emulated causal and contributing factors found in recent accidents involving loss of state awareness by pilots (e.g., energy state, automation state, and/or system state). Three new technology concepts were evaluated while used in concert with current state-of-the-art flight deck systems and indicators. The technologies include a stall recovery guidance algorithm and display concept, an enhanced airspeed control indicator that shows when automation is no longer actively controlling airspeed, and enhanced synoptic pages designed to work with simplified interactive electronic checklists. An additional synoptic was developed to provide the flight crew with information about the effects of loss of flight critical data. Data was collected via questionnaires administered at the completion of flight scenarios, audio/video recordings, flight data, head and eye tracking data, pilot control inputs, and researcher observations. This paper presents findings derived from the questionnaire responses and subjective data measures including workload, situation awareness, usability, and acceptability as well as analyses of two low-energy flight events that resulted in near-stall conditions

Framing or Gaming? Constructing a Study to Explore the Impact of Option Presentation on Consumers

The manner in which choice is framed influences individuals’ decision-making. This research examines the impact of different decision constructs on decision-making by focusing on the more problematic decision constructs: the un-selected and pre-selected optout. The study employs eye-tracking with cued retrospective think-aloud (RTA) to combine quantitative and qualitative data. Eye-tracking will determine how long a user focuses on a decision construct before taking action. Cued RTA where the user will be shown a playback of their interaction will be used to explore their attitudes towards a decision construct and identify problematic designs. This pilot begins the second of a three phase study, which ultimately aims to develop a research model containing the theoretical constructs along with hypothesized causal associations between the constructs to reveal the impact of measures such as decision construct type, default value type and question framing have on the perceived value of the website and loyalty intentions

Ubiquitous Computing in a Home Environment, Controlling Consumer Electronics

Building interaction prototypes for ubiquitous computing is inherently difficult, since it involves a number of different devices and systems. Prototyping is an important step in developing and evaluating interaction concepts. The ideal prototyping methodology should offer high fidelity at a relatively low cost. This thesis describes the development of interaction concepts for controlling consumer electronics in a ubiquitous computing home environment, as well as the setup, based on immersive virtual reality, used to develop and evaluate the interaction concepts. Off-the-shelf input/output devices and a game engine are used for developing two concepts for device discovery and two concepts for device interaction. The interaction concepts are compared in a controlled experiment in order to evaluate the concepts as well as the virtual reality setup. Statistically significant differences and subjective preferences could be observed in the quantitative and qualitative data respectively. Overall, the results suggest that the interaction concepts could be acceptable to some users for some use cases and that the virtual reality setup offers the possibility to quickly build interaction concepts which can be evaluated and compared in a controlled experiment

Development and Usability Evaluation of an mHealth Application for Symptom Self-Management in Underserved Persons Living with HIV

Effective symptom management is essential to decrease symptom severity and improve health-related quality of life for persons living with HIV (PLWH). A mobile health (mHealth) application (app) has the potential to be an effective delivery mode of an existing paper-based symptom management manual with self-management strategies for underserved PLWH. The quality of the mHealth app requires a thorough understanding of the needs of the intended end-users and ensuring the app’s usability. The purpose of this study was to translate paper-based health information into an mHealth app for symptom self-management in underserved PLWH, entitled mVIP (mobile Video Information Provider), and assess its usability. To achieve this goal, usability was evaluated rigorously throughout the development process of mVIP. Based on a stratified view of health information technology (IT) usability evaluation framework, usability evaluation was sequentially conducted with the following three levels: 1) user-task, 2) user-task-system, and 3) user-task-system-environment. At level 1 (user-task), we applied a user-centered design method to guide the information architecture of mVIP. Using a reverse in-person card sorting technique, symptoms and self-management strategies from a paper-based HIV/AIDS symptom management manual were ranked. The rank order of the 13 symptoms and 151 self-management strategies determined the order of appearance to end-users of the mVIP app, with higher-ranked symptoms and strategies appearing first. Based on the findings, we developed a prototype of mVIP as following: 1) once users log in, they are guided by an avatar through a series of 13 symptom questions ascertaining the nature and severity of their symptoms, and 2) the avatar recommends three self-management strategies for each symptom reported. At level 2 (user-task-system), we conducted a usability evaluation of the mVIP prototype in a laboratory setting through end-user usability testing and heuristic evaluation. In end-user usability testing, we used an eye-tracking and retrospective think-aloud method to examine task performance by 20 PLWH. For the heuristic evaluation, five usability experts in informatics assessed the user interface. In the two usability evaluations conducted in a laboratory setting, we found strong user acceptance of the mVIP prototype while identifying a number of usability issues with this prototype. Based on the recommendations from the end-users and heuristic evaluators, we iteratively refined the app’s content, functionality, and interface. We then inserted videos of the finalized symptom self-management strategies into the refined mVIP prototype. At level 3 (user-task-system-environment), the usability of the refined mVIP prototype was evaluated in a real-world setting. Through 10 in-depth interviews and four focus groups conducted at the conclusion of a three-month randomized controlled trial, we explored in-depth understandings of users’ experiences, perceptions, and satisfaction of mVIP use. Findings from the study showed that first, mVIP is useful for HIV-related symptom self-management and has the potential for being used as a communication tool with healthcare providers; and second, mVIP is easy to use to monitor symptom experience over time. At the same time, participants suggested mVIP be more sensitively tailored based on years from initial diagnosis of HIV, an individuals’ age, and conditions. The overall user satisfaction with the mVIP prototype was high, which reflects strong user acceptance of mVIP. Integral to the findings from the three-level usability evaluation, we assessed the quality of the mVIP prototype in use and found the prototype was highly accepted by PLWH with high user satisfaction. This study will add to the body of literature on translation of evidence-based health information into an mHealth app and its usability assessment, which highlights the importance of the use of mobile technology for PLWH, specifically racial and ethnic minorities and those from low-socioeconomic groups who have limited health literacy and low level of education

Multimodal Human-Machine Interface For Haptic-Controlled Excavators

The goal of this research is to develop a human-excavator interface for the hapticcontrolled excavator that makes use of the multiple human sensing modalities (visual, auditory haptic), and efficiently integrates these modalities to ensure intuitive, efficient interface that is easy to learn and use, and is responsive to operator commands. Two empirical studies were conducted to investigate conflict in the haptic-controlled excavator interface and identify the level of force feedback for best operator performance

Eye typing in application: A comparison of two systems with ALS patients

A variety of eye typing systems has been developed during the last decades. Such systems can provide support for people who lost the ability to communicate, e.g. patients suffering from motor neuron diseases such as amyotrophic lateral sclerosis (ALS). In the current retrospective analysis, two eye typing applications were tested (EyeGaze, GazeTalk) by ALS patients (N = 4) in order to analyze objective performance measures and subjective ratings. An advantage of the EyeGaze system was found for most of the evaluated criteria. The results are discussed in respect of the special target population and in relation to requirements of eye tracking devices