A USER’S COGNITIVE WORKLOAD PERSPECTIVE IN NEGOTIATION SUPPORT SYSTEMS: AN EYE-TRACKING EXPERIMENT

Replying to several research calls, I report promising results from an initial experiment which com-pares different negotiation support system approaches concerning their potential to reduce a user’s cognitive workload. Using a novel laboratory-based non-intrusive objective measurement technique which derives the user’s cognitive workload from pupillary responses and eye-movements, I experi-mentally evaluated a standard, a chat-based, and an argumentation-based negotiation support system and found that a higher assistance level of negotiation support systems actually leads to a lower user’s cognitive workload. In more detail, I found that an argumentation-based system which fully automates the generation of the user’s arguments significantly decreases the user’s cognitive workload compared to a standard system. In addition I found that a negotiation support system implementing an additional chat function significantly causes higher cognitive workload for users compared to a standard system

Pupillometry as a tool to study expertise in medicine

Background Pupillometry has been studied as a physiological marker for quantifying cognitive load since the early 1960s. It has been established that small changes in pupillary size can provide an index of the cognitive load of a participant as he/she performs a mental task. The utility of pupillometry as a measure of expertise is less well established, although recent research in the fields of education, medicine and psychology indicates that differences in pupillary size during domain-specific tasks allows differentiation between experts and novices in appropriately designed experiments.Purpose The goal of this review is to explore the existing body of evidence for the use of pupillometry as a measure of expertise and to identify its strengths and constraints within the context of expertise research in the medical sciences.Results Pupillometry is a robust metric that allows researchers to better understand cognitive load in medical practitioners with varying levels of expertise. In medical expertise research, it has been used to study surgeons, anesthetists and emergency physicians. Its strengths include its ability to provide quantitative and objective outputs, to be measured unobtrusively with new technology and to be precisely computed as cognitive load changes over the course of completion of a task. Constraints associated with this methodology include its potential inaccuracy with changes in ambient light and pupillary accommodation as well as the need for relatively expensive equipment. Conclusion With recent technological advances, pupillometry has become a simple and robust method for quantifying physiological changes attributable to cognitive load and is increasingly being utilized in medical education. It can be used as a reliable marker of mental effort and has been shown to differentiate levels of expertise in medical practitioners

Mobile pupillometry in manual assembly : a pilot study exploring the wearability and external validity of a renowned mental workload lab measure

Human operators in the upcoming Industry 4.0 workplace will face accelerating job demands such as elevated cognitive complexity. Unobtrusive objective measures of mental workload (MWL) are therefore in high demand as indicated by both theory and practice. This pilot study explored the wearability and external validity of pupillometry, a MWL measure robustly validated in laboratory settings and now deployable in work settings demanding operator mobility. In an ecologically valid work environment, 21 participants performed two manual assemblies - one of low and one of high complexity - while wearing eye-tracking glasses for pupil size measurement. Results revealed that the device was perceived as fairly wearable in terms of physical and mental comfort. In terms of validity, no significant differences in mean pupil size were found between the assemblies even though subjective mental workload differed significantly. Exploratory analyses on the pupil size when attending to the assembly instructions only, were inconclusive. The present work suggests that current lab-based procedures might not be adequate yet for in-the-field mobile pupillometry. From a broader perspective, these findings also invite a more nuanced view on the current validity of lab-validated physiological MWL-measures when applied in real-life settings. We therefore conclude with some key insights for future development of mobile pupillometry

Trial application of pupillometry for a maritime usability study in field conditions

Eye-tracking is a tool employed in usability testing. It is primarily intended as a means for tracking the visual attention patterns of an observer on a continuous basis. Eye-tracking can also capture certain physiological data, such as pupil dilation. Pupil diameter is a validated metric of cognitive workload, meaning the pupil dilates with increasing workload. This research evaluates the fitness, in field conditions, of an eye-tracking based method for accurate measurement of cognitive workload. This implies evaluating the fitness of this tool in changing light conditions such as in coastal navigation. This methodology thus accounts for the effect of light on pupil dilation. This means we are able to account for the effect of only cognitive workload on the pupil dilation even in changing light conditions. This method was applied as a part of an analysis of a navigational exercise involving the navigator and the navigator’s assistant on board a training vessel of the Royal Norwegian Naval Academy. Pupillometry is used alongside egocentric video recordings and Geo-positioning systems (GPS) recordings to allow for multi-faceted evaluation of the activity. Subjective data was recorded as well to evaluate the quality of the eye-tracking data. Subjective data was recorded using NASA-TLX self-report of mental workload, self-report of mental workload (on three levels) using maps and an expert assessment of the mental workload was obtained for the navigational course. The analysis concluded that pupillometry (through eye-trackers) can have a substantial role in the evaluation of field operations and provide a good and objective estimate of the perceived workload. The eye-tracking technology has substantial limitations, for example sometimes strong infra-red sources of light can impede data collection as such with an eye-tracker, meaning the analysis is labour intensive as it relies on the ability of the operator to filter out low quality data and retain the rest

Monitoring Cognitive and Emotional Processes Through Pupil and Cardiac Response During Dynamic Versus Logical Task

The paper deals with the links between physiological measurements and cognitive and emotional functioning. As long as the operator is a key agent in charge of complex systems, the definition of metrics able to predict his performance is a great challenge. The measurement of the physiological state is a very promising way but a very acute comprehension is required; in particular few studies compare autonomous nervous system reactivity according to specific cognitive processes during task performance and task related psychological stress is often ignored. We compared physiological parameters recorded on 24 healthy subjects facing two neuropsychological tasks: a dynamic task that require problem solving in a world that continually evolves over time and a logical task representative of cognitive processes performed by operators facing everyday problem solving. Results showed that the mean pupil diameter change was higher during the dynamic task; conversely, the heart rate was more elevated during the logical task. Finally, the systolic blood pressure seemed to be strongly sensitive to psychological stress. A better taking into account of the precise influence of a given cognitive activity and both workload and related task-induced psychological stress during task performance is a promising way to better monitor operators in complex working situations to detect mental overload or pejorative stress factor of error

Measuring cognitive state from physiological signals in user interface research

The purpose of this Thesis is to investigate how modern technology can be used for evaluating human cognitive state in the context of human-computer interaction, namely user interface (UI) research. In this work two types of physiological data were collected to measure cognitive load during a task which requires some degree of human-computer interaction. A near-infrared spectroscopy device and eye tacker were used to evaluate cognitive load level during the task and provide an insight into how these data might be used in an adaptive real-time system. A mental calculation task was used as the cognitively demanding learning task, which challenges working memory. Additional difficulty was added using the task presentation: mathematical expressions were either static or moving from the top to the bottom of the screen. Results indicate that tasks of different mental complexity elicit different cognitive responses. With careful interpretation this information can be used in designing environments, suitable for the user. This work have shown that in designing the systems which use physiological measurements, it is crucial to know the possible sources of the noise. For example, in pupillary measurements it is important to control for luminance and physiological changes which affect pupil size along with cognitive load, or to develop methods which discriminate between task-evoked pupil response from other responses. For any real-time system it is necessary to develop the fast and efficient algorithms which produce reliable results with minimal training of the models

Pupil response as an indicator of hazard perception during simulator driving

We investigate the pupil response to hazard perception during driving simulation. Complementary to gaze movement and physiological stress indicators, pupil size changes can provide valuable information on traffic hazard perception with a relatively low temporal delay. We tackle the challenge of identifying those pupil dilation events associated with hazardous events from a noisy signal by a combination of wavelet transformation and machine learning. Therefore, we use features of the wavelet components as training data of a support vector machine. We further demonstrate how to utilize the method for the analysis of actual hazard perception and how it may differ from the behavioral driving response

Frequency analysis of a task-evoked pupillary response: Luminance-independent measure of mental effort

The pupil diameter is a widely studied cognitive load measure, which, despite its convenience for non-intrusive operator state monitoring in complex environments, is still not available for in situ measurements because of numerous methodological limitations. The most important of these limitations is the influence of the pupillary light reflex. Hence, there is the need of providing a pupil-based cognitive load measure independent of light conditions. In this paper, we present a promising technique of pupillary signal analysis resulting in luminance-independent measure of mental effort that could be used in real-time without a priori on luminous conditions. Twenty two participants performed a short-term memory task under different screen luminance conditions. Our results showed that the amplitude of pupil dilation due to load on memory is luminance-dependent with higher amplitude corresponding to low-luminance condition. Furthermore, our experimentation showed that the load on memory and luminance factors express themselves differently according to frequency. Therefore, as our statistical analysis revealed, the ratio between low (0–1.6 Hz) and high frequency (1.6–4 Hz) bands (LF/HF ratio) of power spectral densities of pupillary signal is sensitive to the cognitive load but not to luminance. This result is promising for the measurements of load on memory in ecological settings

Estudo experimental do comportamento ocular em trabalhadores administrativos como um indicador de conforto visual em situação de risco de encadeamento

The daylight impact on the visual environment is fundamental on visual display terminal work (VDT). Visual performance and visual comfort should be considered for equal. The study (n=16) was performed at the experimental lighting laboratory. Office work with VDT was evaluated using STROOP task in two orientations: (with/without solar presence in the visual field). Our hypothesis states the existence of a relationship between ocular behavior and visual comfort of workers. An eye-tracker was employed in order to record the ocular gestural parameters: blinks, direction of gaze, eye aperture (Degree of eye?s openness) and pupil size, which were correlated with the vertical illuminance at the eye. Visual comfort was assessed with Glare Sensation Vote. Results indicate a strong negative linear correlation between eye illuminance and the degree of eye?s openness in the direct sunlight scenario (p=-0.636; s=0.008) and in diffuse light scenario (p=-0.661; s=0.005), that could be the main predictor of visual discomfort. This experiment allowed us to explore eye behavior patterns that could be visual comfort indices under glare risk situations.O impacto a luz do dia no ambiente visual é fundamental para o trabalho no Ecrã de Visualização de Dados (EDV). Desempenho visual e conforto visual devem ser considerados em igual. O estudo (n = 16) foi realizado no laboratório experimental de iluminação. O trabalho de escritório com EDV foi avaliado utilizando a tarefa de Stroop em duas orientações: (com / sem presença solar no campo visual). A nossa hipótese afirma a existência de uma relação entre o comportamento ocular e conforto visual dos trabalhadores. Um “eye-tracker” foi desenvolvido para gravar os parâmetros gestuais oculares: pestanejar, direção do olhar, abertura dos olhos (Grau de abertura do olho) e tamanho da pupila, que foram correlacionados com a iluminância vertical no olho. Conforto visual foi avaliado com a escala de sensação de encadeamento. Os resultados indicam uma correlação linear negativa forte entre a luminosidade dos olhos e do grau de abertura de olho no cenário de luz solar direta (p = -0,636; s = 0,008) e no cenário de luz difusa (p = -0,661; s = 0,005), que poderia ser o principal preditor de desconforto visual. Esta experiência permitiu-nos explorar padrões de comportamento do olho que poderiam ser os índices de conforto visual em situação de risco de encadeamento.Fil: Yamin Garretón, Julieta Alejandra. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mendoza. Instituto de Ciencias Humanas, Sociales y Ambientales; ArgentinaFil: Rodriguez, Roberto Germán. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mendoza. Instituto de Ciencias Humanas, Sociales y Ambientales; ArgentinaFil: Pattini, Andrea Elvira. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mendoza. Instituto de Ciencias Humanas, Sociales y Ambientales; Argentin