807 research outputs found

    Precision is in the Eye of the Beholder: Application of Eye Fixation-Related Potentials to Information Systems Research

    Get PDF
    This paper introduces the eye-fixation related potential (EFRP) method to IS research. The EFRP method allows one to synchronize eye tracking with electroencephalographic (EEG) recording to precisely capture users’ neural activity at the exact time at which they start to cognitively process a stimulus (e.g., event on the screen). This complements and overcomes some of the shortcomings of the traditional event related potential (ERP) method, which can only stamp the time at which a stimulus is presented to a user. Thus, we propose a method conjecture of the superiority of EFRP over ERP for capturing the cognitive processing of a stimulus when such cognitive processing is not necessarily synchronized with the time at which the stimulus appears. We illustrate the EFRP method with an experiment in a natural IS use context in which we asked users to read an industry report while email pop-up notifications arrived on their screen. The results support our proposed hypotheses and show three distinct neural processes associated with 1) the attentional reaction to email pop-up notification, 2) the cognitive processing of the email pop-up notification, and 3) the motor planning activity involved in opening or not the email. Furthermore, further analyses of the data gathered in the experiment serve to validate our method conjecture about the superiority of the EFRP method over the ERP in natural IS use contexts. In addition to the experiment, our study discusses important IS research questions that could be pursued with the aid of EFRP, and describes a set of guidelines to help IS researchers use this method

    Precision is in the Eye of the Beholder: Application of Eye Fixation-Related Potentials to Information Systems Research

    Get PDF
    This is the final version. Available from Association for Information Systems via the DOI in this recordThis paper introduces the eye-fixation related potential (EFRP) method to IS research. The EFRP method allows one to synchronize eye tracking with electroencephalographic (EEG) recording to precisely capture users’ neural activity at the exact time at which they start to cognitively process a stimulus (e.g., event on the screen). This complements and overcomes some of the shortcomings of the traditional event related potential (ERP) method, which can only stamp the time at which a stimulus is presented to a user. Thus, we propose a method conjecture of the superiority of EFRP over ERP for capturing the cognitive processing of a stimulus when such cognitive processing is not necessarily synchronized with the time at which the stimulus appears. We illustrate the EFRP method with an experiment in a natural IS use context in which we asked users to read an industry report while email pop-up notifications arrived on their screen. The results support our proposed hypotheses and show three distinct neural processes associated with 1) the attentional reaction to email pop-up notification, 2) the cognitive processing of the email pop-up notification, and 3) the motor planning activity involved in opening or not the email. Furthermore, further analyses of the data gathered in the experiment serve to validate our method conjecture about the superiority of the EFRP method over the ERP in natural IS use contexts. In addition to the experiment, our study discusses important IS research questions that could be pursued with the aid of EFRP, and describes a set of guidelines to help IS researchers use this method.Social Sciences and Humanities Research Council of Canada (SSHRC)Natural Sciences and Engineering Research Council of CanadaFonds Québécois pour la Recherche sur la Société et la Culture (FQRSC)Fonds de recherche Nature et Technologies (FQRNT

    Validating and improving the correction of ocular artifacts in electro-encephalography

    Get PDF
    For modern applications of electro-encephalography, including brain computer interfaces and single-trial Event Related Potential detection, it is becoming increasingly important that artifacts are accurately removed from a recorded electro-encephalogram (EEG) without affecting the part of the EEG that reflects cerebral activity. Ocular artifacts are caused by movement of the eyes and the eyelids. They occur frequently in the raw EEG and are often the most prominent artifacts in EEG recordings. Their accurate removal is therefore an important procedure in nearly all electro-encephalographic research. As a result of this, a considerable number of ocular artifact correction methods have been introduced over the past decades. A selection of these methods, which contains some of the most frequently used correction methods, is given in Section 1.5. When two different correction methods are applied to the same raw EEG, this usually results in two different corrected EEGs. A measure for the accuracy of correction should indicate how well each of these corrected EEGs recovers the part of the raw EEG that truly reflects cerebral activity. The fact that this accuracy cannot be determined directly from a raw EEG is intrinsic to the need for artifact removal. If, based on a raw EEG, it would be possible to derive an exact reference on what the corrected EEG should be, then there would not be any need for adequate artifact correction methods. Estimating the accuracy of correction methods is mostly done either by using models to simulate EEGs and artifacts, or by manipulating the experimental data in such a way that the effects of artifacts to the raw EEG can be isolated. In this thesis, modeling of EEG and artifact is used to validate correction methods based on simulated data. A new correction method is introduced which, unlike all existing methods, uses a camera to monitor eye(lid) movements as a basis for ocular artifact correction. The simulated data is used to estimate the accuracy of this new correction method and to compare it against the estimated accuracy of existing correction methods. The results of this comparison suggest that the new method significantly increases correction accuracy compared to the other methods. Next, an experiment is performed, based on which the accuracy of correction can be estimated on raw EEGs. Results on this experimental data comply very well with the results on the simulated data. It is therefore concluded that using a camera during EEG recordings provides valuable extra information that can be used in the process of ocular artifact correction. In Chapter 2, a model is introduced that assists in estimating the accuracy of eye movement artifacts for simulated EEG recordings. This model simulates EEG and eye movement artifacts simultaneously. For this, the model uses a realistic representation of the head, multiple dipoles to model cerebral and ocular electrical activity, and the boundary element method to calculate changes in electrical potential at different positions on the scalp. With the model, it is possible to simulate different data sets as if they are recorded using different electrode configurations. Signal to noise ratios are used to assess the accuracy of these six correction methods for various electrode configurations before and after applying six different correction methods. Results show that out of the six methods, second order blind identification, SOBI, and multiple linear regression, MLR, correct most accurately overall as they achieve the highest rise in signal to noise ratio. The occurrence of ocular artifacts is linked to changes in eyeball orientation. In Chapter 2 an eye tracker is used to record pupil position, which is closely linked to eyeball orientation. The pupil position information is used in the model to simulate eye movements. Recognizing the potential benefit of using an eye tracker not only for simulations, but also for correction, Chapter 3 introduces an eye movement artifact correction method that exploits the pupil position information that is provided by an eye tracker. Other correction methods use the electrooculogram (EOG) and/or the EEG to estimate ocular artifacts. Because both the EEG and the EOG recordings are susceptive to cerebral activity as well as to ocular activity, these other methods are at risk of overcorrecting the raw EEG. Pupil position information provides a reference that is linked to the ocular artifact in the EEG but that cannot be affected by cerebral activity, and as a result the new correction method avoids having to solve traditionally problematic issues like forward/backward propagation and evaluating the accuracy of component extraction. By using both simulated and experimental data, it is determined how pupil position influences the raw EEG and it is found that this relation is linear or quadratic. A Kalman filter is used for tuning of the parameters that specify the relation. On simulated data, the new method performs very well, resulting in an SNR after correction of over 10 dB for various patterns of eye movements. When compared to the three methods that performed best in the evaluation of Chapter 2, only the SOBI method which performed best in that evaluation shows similar results for some of the eye movement patterns. However, a serious limitation of the correction method is its inability to correct blink artifacts. In order to increase the variety of applications for which the new method can be used, the new correction should be improved in a way that enables it to correct the raw EEG for blinking artifacts. Chapter 4 deals with implementing such improvements based on the idea that a more advanced eye-tracker should be able to detect both the pupil position and the eyelid position. The improved eye tracker-based ocular artifact correction method is named EYE. Driven by some practical limitations regarding the eye tracking device currently available to us, an alternative way to estimate eyelid position is suggested, based on an EOG recorded above one eye. The EYE method can be used with both the eye tracker information or with the EOG substitute. On simulated data, accuracy of the EYE method is estimated using the EOGbased eyelid reference. This accuracy is again compared against the six other correction methods. Two different SNR-based measures of accuracy are proposed. One of these quantifies the correction of the entire simulated data set and the other focuses on those segments containing simulated blinking artifacts. After applying EYE, an average SNR of at least 9 dB for both these measures is achieved. This implies that the power of the corrected signal is at least eight times the power of the remaining noise. The simulated data sets contain a wide range of eye movements and blink frequencies. For almost all of these data sets, 16 out of 20, the correction results for EYE are better than for any of the other evaluated correction method. On experimental data, the EYE method appears to adequately correct for ocular artifacts as well. As the detection of eyelid position from the EOG is in principle inferior to the detection of eyelid position with the use of an eye tracker, these results should also be considered as an indicator of even higher accuracies that could be obtained with a more advanced eye tracker. Considering the simplicity of the MLR method, this method also performs remarkably well, which may explain why EOG-based regression is still often used for correction. In Chapter 5, the simulation model of Chapter 2 is put aside and, alternatively, experimentally recorded data is manipulated in a way that correction inaccuracies can be highlighted. Correction accuracies of eight correction methods, including EYE, are estimated based on data that are recorded during stop-signal tasks. In the analysis of these tasks it is essential that ocular artifacts are adequately removed because the task-related ERPs, are located mostly at frontal electrode positions and are low-amplitude. These data are corrected and subsequently evaluated. For the eight methods, the overall ranking of estimated accuracy in Figure 5.3, corresponds very well with the correction accuracy of these methods on simulated data as was found in Chapter 4. In a single-trial correction comparison, results suggest that the EYE corrected EEG, is not susceptible to overcorrection, whereas the other corrected EEGs are

    Signal validation in electroencephalography research

    Get PDF

    Comparative analysis of TMS-EEG signal using different approaches in healthy subjects

    Get PDF
    openThe integration of transcranial magnetic stimulation with electroencephalography (TMS-EEG) represents a useful non-invasive approach to assess cortical excitability, plasticity and intra-cortical connectivity in humans in physiological and pathological conditions. However, biological and environmental noise sources can contaminate the TMS-evoked potentials (TEPs). Therefore, signal preprocessing represents a fundamental step in the analysis of these potentials and is critical to remove artefactual components while preserving the physiological brain activity. The objective of the present study is to evaluate the effects of different signal processing pipelines, (namely Leodori et al., Rogasch et al., Mutanen et al.) applied on TEPs recorded in five healthy volunteers after TMS stimulation of the primary motor cortex (M1) of the dominant hemisphere. These pipelines were used and compared to remove artifacts and improve the quality of the recorded signals, laying the foundation for subsequent analyses. Various algorithms, such as Independent Component Analysis (ICA), SOUND, and SSP-SIR, were used in each pipeline. Furthermore, after signal preprocessing, current localization was performed to map the TMS-induced neural activation in the cortex. This methodology provided valuable information on the spatial distribution of activity and further validated the effectiveness of the signal cleaning pipelines. Comparing the effects of the different pipelines on the same dataset, we observed considerable variability in how the pipelines affect various signal characteristics. We observed significant differences in the effects on signal amplitude and in the identification and characterisation of peaks of interest, i.e., P30, N45, P60, N100, P180. The identification and characteristics of these peaks showed variability, especially with regard to the early peaks, which reflect the cortical excitability of the stimulated area and are the more affected by biological and stimulation-related artifacts. Despite these differences, the topographies and source localisation, which are the most informative and useful in reconstructing signal dynamics, were consistent and reliable between the different pipelines considered. The results suggest that the existing methodologies for analysing TEPs produce different effects on the data, but are all capable of reproducing the dynamics of the signal and its components. Future studies evaluating different signal preprocessing methods in larger populations are needed to determine an appropriate workflow that can be shared through the scientific community, in order to make the results obtained in different centres comparable

    Investigating the effects of neuromodulatory training on autistic traits: a multi-methods psychophysiological study.

    Get PDF
    Autism spectrum disorder (ASD) is characterized by noticeable difficulties with social interaction and communication. Building on past research in this area and with the aim of improving methodological perspectives, a multi method approach to the study of ASD, mirror neurons and neurofeedback was taken. This thesis is made up of three main experiments: 1) A descriptive study of the resting state electroencephalography (EEG) across the spectrum of autistic traits in neurotypical individuals, 2) A comparison of 3 EEG protocols on MNs activation (mu suppression) and its difference according to self-reported traits of autism in neurotypical individuals, and 3) Neurofeedback training (NFT) on individuals with high autistic traits. In chapters 3 and 4 we employed simultaneous monitoring of physiological data. For chapter 3 EEG and eye-tracking was used, In the case of chapter 4, EEG and eye-tracking as well functional near infrared spectroscopy (fNIRS). Overall the findings revealed differences in mu rhythm reactivity associated to AQ traits. In chapter 2, the rEEG showed that individuals with high AQ scores showed less activation of frontal and fronto-central regions combined with higher levels of complexity in fronto-temporal, temporal, parietal and parieto-occipital areas. In chapter 3, EEG protocols that elicited Mu reactivity in individuals with different AQ traits suggested that as the AQ traits become more pronounced in neurotypical population, the event-related desynchronization (ERD) in low alpha declines. Chapter 3 was also the basis for the choice of pre/post assessment for chapter 4. In chapter 4 the multi-method physiological approach provided parallel physiological evidence for the effects of NFT in sensorimotor reactivity, namely, an increase in ERD in high alpha, higher levels of oxygenated haemoglobin and changes to the amplitude and frequency in the microstructure of mu for participants who underwent active training as opposed to a sham group

    Advancing Multimodal Approaches to Study Human Brain: Improvements in Simultaneous EEG-fMRI Acquisition

    Get PDF
    The primary aim of the study detailed in this dissertation was improving the quality of simultaneous electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) experiments. Two common challenges to use concurrent EEG-fMRI tests are addressed herein. The first is the presence of EEG artifacts during simultaneous EEG-fMRI, which require more consideration than EEG data recorded outside the scanner. To mitigate this issue, a fully automated artifact correction pipeline was developed. In the proposed pipeline, magnetic resonance (MR) environmental (i.e., gradient and ballistocardiogram [BCG]) artifacts were reduced using optimal basis sets (OBS) and average artifact subtraction (AAS). Subsequently, independent component analysis (ICA) was leveraged for reducing physiological artifacts (e.g., eye blinks, saccade and muscle artifacts), in addition to residual BCG artifacts. To validate pipeline performance, both resting-state (time/frequency and frequency analysis) and task-based (event related potential [ERP]) EEG data from eight healthy participants were tested. This data was compared with the time/frequency and frequency results achieved by matching meticulously, manually corrected EEG data to the automatically corrected EEG data. No significant difference was found between results. A comparison between ERP results (e.g., amplitude measures and SNR) also showed no differences between manually corrected and fully automated EEG corrected data. The second challenge addressed in this work is the low experimental control over the subject's actual behavior during the eyes-open resting-state fMRI (rsfMRI). This technique has been widely used for studying the (presumably) awake and alert human brain using multimodal EEG-fMRI; however, objective and verified experimental measures to quantify the degree of alertness (e.g., vigilance) are not readily available. To this end, the study reported in this dissertation investigated whether simultaneous multimodal EEG, rsfMRI and eye-tracker experiments could be used to extract objective and robust biomarkers of vigilance in healthy human subjects (n = 10) during cross fixation. Frontal and occipital beta power (FOBP) were found to correlate (r = 0.306, p<0.001) with pupil size fluctuation, which is an indirect index for locus coeruleus activity implicated in vigilance regulation. Moreover, FOBP was also correlated with heart rate (r = 0.255, p<0.001) and several brain regions in an anti-correlated network, including the bilateral insula and inferior parietal lobule. Results support the conclusion that FOBP is an objective and robust biomarker of vigilance in healthy human subjects

    Decomposition and classification of electroencephalography data

    Get PDF

    Co-registration of eye movements and fixation-related potentials in natural reading: Practical issues of experimental design and data analysis

    Get PDF
    A growing number of studies are using co-registration of eye movement (EM) and fixation-related potential (FRP) measures to investigate reading. However, the number of co-registration experiments remains small when compared to the number of studies in the literature conducted with EMs and event-related potentials (ERPs) alone. One reason for this is the complexity of the experimental design and data analyses. The present paper is designed to support researchers who might have expertise in conducting reading experiments with EM or ERP techniques and are wishing to take their first steps towards co-registration research. The objective of this paper is threefold. First, to provide an overview of the issues that such researchers would face. Second, to provide a critical overview of the methodological approaches available to date to deal with these issues. Third, to offer an example pipeline and a full set of scripts for data preprocessing that may be adopted and adapted for one's own needs. The data preprocessing steps are based on EM data parsing via Data Viewer (SR Research), and the provided scripts are written in Matlab and R. Ultimately, with this paper we hope to encourage other researchers to run co-registration experiments to study reading and human cognition more generally
    • …
    corecore