What we can and cannot (yet) do with functional near infrared spectroscopy

Functional near infrared spectroscopy (NIRS) is a relatively new technique complimentary to EEG for the development of brain-computer interfaces (BCIs). NIRS-based systems for detecting various cognitive and affective states such as mental and emotional stress have already been demonstrated in a range of adaptive human–computer interaction (HCI) applications. However, before NIRS-BCIs can be used reliably in realistic HCI settings, substantial challenges oncerning signal processing and modeling must be addressed. Although many of those challenges have been identified previously, the solutions to overcome them remain scant. In this paper, we first review what can be currently done with NIRS, specifically, NIRS-based approaches to measuring cognitive and affective user states as well as demonstrations of passive NIRS-BCIs. We then discuss some of the primary challenges these systems would face if deployed in more realistic settings, including detection latencies and motion artifacts. Lastly, we investigate the effects of some of these challenges on signal reliability via a quantitative comparison of three NIRS models. The hope is that this paper will actively engage researchers to acilitate the advancement of NIRS as a more robust and useful tool to the BCI community

Speeded Near Infrared Spectroscopy (NIRS) Response Detection

The hemodynamic response measured by Near Infrared Spectroscopy (NIRS) is temporally delayed from the onset of the underlying neural activity. As a consequence, NIRS based brain-computer-interfaces (BCIs) and neurofeedback learning systems, may have a latency of several seconds in responding to a change in participants' behavioral or mental states, severely limiting the practical use of such systems. To explore the possibility of reducing this delay, we used a multivariate pattern classification technique (linear support vector machine, SVM) to decode the true behavioral state from the measured neural signal and systematically evaluated the performance of different feature spaces (signal history, history gradient, oxygenated or deoxygenated hemoglobin signal and spatial pattern). We found that the latency to decode a change in behavioral state can be reduced by 50% (from 4.8 s to 2.4 s), which will enhance the feasibility of NIRS for real-time applications

Detection of Human Vigilance State During Locomotion Using Wearable FNIRS

Human vigilance is a cognitive function that requires sustained attention toward change in the environment. Human vigilance detection is a widely investigated topic which can be accomplished by various approaches. Most studies have focused on stationary vigilance detection due to the high effect of interference such as motion artifacts which are prominent in common movements such as walking. Functional Near-Infrared Spectroscopy is a preferred modality in vigilance detection due to the safe nature, the low cost and ease of implementation. fNIRS is not immune to motion artifact interference, and therefore human vigilance detection performance would be severely degraded when studied during locomotion. Properly treating and removing walking-induced motion artifacts from the contaminated signals is crucial to ensure accurate vigilance detection. This study compared the vigilance level detection during both stationary and walking states and confirmed that the performance of vigilance level detection during walking is significantly deteriorated (with a

Exploring the Brain Responses to Driving Fatigue through Simultaneous EEG and fNIRS Measurements

© 2020 World Scientific Publishing Company. Fatigue is one problem with driving as it can lead to difficulties with sustaining attention, behavioral lapses, and a tendency to ignore vital information or operations. In this research, we explore multimodal physiological phenomena in response to driving fatigue through simultaneous functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) recordings with the aim of investigating the relationships between hemodynamic and electrical features and driving performance. Sixteen subjects participated in an event-related lane-deviation driving task while measuring their brain dynamics through fNIRS and EEGs. Three performance groups, classified as Optimal, Suboptimal, and Poor, were defined for comparison. From our analysis, we find that tonic variations occur before a deviation, and phasic variations occur afterward. The tonic results show an increased concentration of oxygenated hemoglobin (HbO2) and power changes in the EEG theta, alpha, and beta bands. Both dynamics are significantly correlated with deteriorated driving performance. The phasic EEG results demonstrate event-related desynchronization associated with the onset of steering vehicle in all power bands. The concentration of phasic HbO2 decreased as performance worsened. Further, the negative correlations between tonic EEG delta and alpha power and HbO2 oscillations suggest that activations in HbO2 are related to mental fatigue. In summary, combined hemodynamic and electrodynamic activities can provide complete knowledge of the brain's responses as evidence of state changes during fatigue driving

The impact of physiological noise on hemodynamic-derived estimates of directed functional connectivity

This work was supported by a grant of the BrainLinks-BrainTools Cluster of Excellence funded by the German Research Foundation (DFG, Grant Number EXC 1086).Peer reviewedPostprintPostprin

Simultaneous fNIRS and thermal infrared imaging during cognitive task reveal autonomic correlates of prefrontal cortex activity

Functional Near Infrared-Spectroscopy (fNIRS) represents a powerful tool to non-invasively study task-evoked brain activity. fNIRS assessment of cortical activity may suffer for contamination by physiological noises of different origin (e.g. heart beat, respiration, blood pressure, skin blood flow), both task-evoked and spontaneous. Spontaneous changes occur at different time scales and, even if they are not directly elicited by tasks, their amplitude may result task-modulated. In this study, concentration changes of hemoglobin were recorded over the prefrontal cortex while simultaneously recording the facial temperature variations of the participants through functional infrared thermal (fIR) imaging. fIR imaging provides touch-less estimation of the thermal expression of peripheral autonomic. Wavelet analysis revealed task-modulation of the very low frequency (VLF) components of both fNIRS and fIR signals and strong coherence between them. Our results indicate that subjective cognitive and autonomic activities are intimately linked and that the VLF component of the fNIRS signal is affected by the autonomic activity elicited by the cognitive task. Moreover, we showed that task-modulated changes in vascular tone occur both at a superficial and at larger depth in the brain. Combined use of fNIRS and fIR imaging can effectively quantify the impact of VLF autonomic activity on the fNIRS signals

Reshaping cortical activity with subthalamic stimulation in Parkinson's disease during finger tapping and gait mapped by near infrared spectroscopy

Exploration of motor cortex activity is essential to understanding the pathophysiology in Parkinson's Disease (PD), but only simple motor tasks can be investigated using a fMRI or PET. We aim to investigate the cortical activity of PD patients during a complex motor task (gait) to verify the impact of deep brain stimulation in the subthalamic nucleus (DBS-STN) by using Near-Infrared-Spectroscopy (NIRS). NIRS is a neuroimaging method of brain cortical activity using low-energy optical radiation to detect local changes in (de)oxyhemoglobin concentration. We used a multichannel portable NIRS during finger tapping (FT) and gait. To determine the signal activity, our methodology consisted of a pre-processing phase for the raw signal, followed by statistical analysis based on a general linear model. Processed recordings from 9 patients were statistically compared between the on and off states of DBS-STN. DBS-STN led to an increased activity in the contralateral motor cortex areas during FT. During gait, we observed a concentration of activity towards the cortex central area in the "stimulation-on" state. Our study shows how NIRS can be used to detect functional changes in the cortex of patients with PD with DBS-STN and indicates its future use for applications unsuited for PET and a fMRI

Functional Near Infrared Spectroscopy: Watching the Brain in Flight

Functional Near Infrared Spectroscopy (fNIRS) is an emerging neurological sensing technique applicable to optimizing human performance in transportation operations, such as commercial aviation. Cognitive state can be determined via pattern classification of functional activations measured with fNIRS. Operational application calls for further development of algorithms and filters for dynamic artifact removal. The concept of using the frequency domain phase shift signal to tune a Kalman filter is introduced to improve the quality of fNIRS signals in realtime. Hemoglobin concentration and phase shift traces were simulated for four different types of motion artifact to demonstrate the filter. Unwanted signal was reduced by at least 43%, and the contrast of the filtered oxygenated hemoglobin signal was increased by more than 100% overall. This filtering method is a good candidate for qualifying fNIRS signals in real time without auxiliary sensor