Improved physiological noise regression in fNIRS: a multimodal extension of the General Linear Model using temporally embedded Canonical Correlation Analysis

For the robust estimation of evoked brain activity from functional Near-Infrared Spectroscopy (fNIRS) signals, it is crucial to reduce nuisance signals from systemic physiology and motion. The current best practice incorporates short-separation (SS) fNIRS measurements as regressors in a General Linear Model (GLM). However, several challenging signal characteristics such as non-instantaneous and non-constant coupling are not yet addressed by this approach and additional auxiliary signals are not optimally exploited. We have recently introduced a new methodological framework for the unsupervised multivariate analysis of fNIRS signals using Blind Source Separation (BSS) methods. Building onto the framework, in this manuscript we show how to incorporate the advantages of regularized temporally embedded Canonical Correlation Analysis (tCCA) into the supervised GLM. This approach allows flexible integration of any number of auxiliary modalities and signals. We provide guidance for the selection of optimal parameters and auxiliary signals for the proposed GLM extension. Its performance in the recovery of evoked HRFs is then evaluated using both simulated ground truth data and real experimental data and compared with the GLM with short-separation regression. Our results show that the GLM with tCCA significantly improves upon the current best practice, yielding significantly better results across all applied metrics: Correlation (HbO max. +45%), Root Mean Squared Error (HbO max. -55%), F-Score (HbO up to 3.25-fold) and p-value as well as power spectral density of the noise floor. The proposed method can be incorporated into the GLM in an easily applicable way that flexibly combines any available auxiliary signals into optimal nuisance regressors. This work has potential significance both for conventional neuroscientific fNIRS experiments as well as for emerging applications of fNIRS in everyday environments, medicine and BCI, where high Contrast to Noise Ratio is of importance for single trial analysis.Published versio

A wide field-of-view, modular, high-density diffuse optical tomography system for minimally constrained three-dimensional functional neuroimaging

The ability to produce high-quality images of human brain function in any environment and during unconstrained movement of the subject has long been a goal of neuroimaging research. Diffuse optical tomography, which uses the intensity of back-scattered near-infrared light from multiple source-detector pairs to image changes in haemoglobin concentrations in the brain, is uniquely placed to achieve this goal. Here, we describe a new generation of modular, fibre-less, high-density diffuse optical tomography technology that provides exceptional sensitivity, a large dynamic range, a field-of-view sufficient to cover approximately one-third of the adult scalp, and also incorporates dedicated motion sensing into each module. Using in-vivo measures, we demonstrate a noise-equivalent power of 318 fW, and an effective dynamic range of 142 dB. We describe the application of this system to a novel somatomotor neuroimaging paradigm that involves subjects walking and texting on a smartphone. Our results demonstrate that wearable high-density diffuse optical tomography permits three-dimensional imaging of the human brain function during overt movement of the subject; images of somatomotor cortical activation can be obtained while subjects move in a relatively unconstrained manner, and these images are in good agreement with those obtained while the subjects remain stationary. The scalable nature of the technology we described here paves the way for the routine acquisition of high-quality, three-dimensional, whole-cortex diffuse optical tomography images of cerebral haemodynamics, both inside and outside of the laboratory environment, which has profound implications for neuroscience

Concurrent fNIRS and EEG for brain function investigation: A systematic, methodology-focused review

Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) stand as state-of-the-art techniques for non-invasive functional neuroimaging. On a unimodal basis, EEG has poor spatial resolution while presenting high temporal resolution. In contrast, fNIRS offers better spatial resolution, though it is constrained by its poor temporal resolution. One important merit shared by the EEG and fNIRS is that both modalities have favorable portability and could be integrated into a compatible experimental setup, providing a compelling ground for the development of a multimodal fNIRS-EEG integration analysis approach. Despite a growing number of studies using concurrent fNIRS-EEG designs reported in recent years, the methodological reference of past studies remains unclear. To fill this knowledge gap, this review critically summarizes the status of analysis methods currently used in concurrent fNIRS-EEG studies, providing an up-to-date overview and guideline for future projects to conduct concurrent fNIRS-EEG studies. A literature search was conducted using PubMed and Web of Science through 31 August 2021. After screening and qualification assessment, 92 studies involving concurrent fNIRS-EEG data recordings and analyses were included in the final methodological review. Specifically, three methodological categories of concurrent fNIRS-EEG data analyses, including EEG-informed fNIRS analyses, fNIRS-informed EEG analyses, and parallel fNIRS-EEG analyses, were identified and explained with detailed description. Finally, we highlighted current challenges and potential directions in concurrent fNIRS-EEG data analyses in future research

A wide field-of-view, modular, high-density diffuse optical tomography system for minimally constrained three-dimensional functional neuroimaging

The ability to produce high-quality images of human brain function in any environment and during unconstrained movement of the subject has long been a goal of neuroimaging research. Diffuse optical tomography, which uses the intensity of back-scattered near-infrared light from multiple source-detector pairs to image changes in haemoglobin concentrations in the brain, is uniquely placed to achieve this goal. Here, we describe a new generation of modular, fibre-less, high-density diffuse optical tomography technology that provides exceptional sensitivity, a large dynamic range, a field-of-view sufficient to cover approximately one-third of the adult scalp, and also incorporates dedicated motion sensing into each module. Using in-vivo measures, we demonstrate a noise-equivalent power of 318 fW, and an effective dynamic range of 142 dB. We describe the application of this system to a novel somatomotor neuroimaging paradigm that involves subjects walking and texting on a smartphone. Our results demonstrate that wearable high-density diffuse optical tomography permits three-dimensional imaging of the human brain function during overt movement of the subject; images of somatomotor cortical activation can be obtained while subjects move in a relatively unconstrained manner, and these images are in good agreement with those obtained while the subjects remain stationary. The scalable nature of the technology we described here paves the way for the routine acquisition of high-quality, three-dimensional, whole-cortex diffuse optical tomography images of cerebral haemodynamics, both inside and outside of the laboratory environment, which has profound implications for neuroscience

Using the General Linear Model to Improve Performance in fNIRS Single Trial Analysis and Classification: A Perspective

Within a decade, single trial analysis of functional Near Infrared Spectroscopy (fNIRS) signals has gained significant momentum, and fNIRS joined the set of modalities frequently used for active and passive Brain Computer Interfaces (BCI). A great variety of methods for feature extraction and classification have been explored using state-of-the-art Machine Learning methods. In contrast, signal preprocessing and cleaning pipelines for fNIRS often follow simple recipes and so far rarely incorporate the available state-of-the-art in adjacent fields. In neuroscience, where fMRI and fNIRS are established neuroimaging tools, evoked hemodynamic brain activity is typically estimated across multiple trials using a General Linear Model (GLM). With the help of the GLM, subject, channel, and task specific evoked hemodynamic responses are estimated, and the evoked brain activity is more robustly separated from systemic physiological interference using independent measures of nuisance regressors, such as short-separation fNIRS measurements. When correctly applied in single trial analysis, e.g., in BCI, this approach can significantly enhance contrast to noise ratio of the brain signal, improve feature separability and ultimately lead to better classification accuracy. In this manuscript, we provide a brief introduction into the GLM and show how to incorporate it into a typical BCI preprocessing pipeline and cross-validation. Using a resting state fNIRS data set augmented with synthetic hemodynamic responses that provide ground truth brain activity, we compare the quality of commonly used fNIRS features for BCI that are extracted from (1) conventionally preprocessed signals, and (2) signals preprocessed with the GLM and physiological nuisance regressors. We show that the GLM-based approach can provide better single trial estimates of brain activity as well as a new feature type, i.e., the weight of the individual and channel-specific hemodynamic response function (HRF) regressor. The improved estimates yield features with higher separability, that significantly enhance accuracy in a binary classification task when compared to conventional preprocessing—on average +7.4% across subjects and feature types. We propose to adapt this well-established approach from neuroscience to the domain of single-trial analysis and preprocessing wherever the classification of evoked brain activity is of concern, for instance in BCI

Best practices for fNIRS publications

The application of functional near-infrared spectroscopy (fNIRS) in the neurosciences has been expanding over the last 40 years. Today, it is addressing a wide range of applications within different populations and utilizes a great variety of experimental paradigms. With the rapid growth and the diversification of research methods, some inconsistencies are appearing in the way in which methods are presented, which can make the interpretation and replication of studies unnecessarily challenging. The Society for Functional Near-Infrared Spectroscopy has thus been motivated to organize a representative (but not exhaustive) group of leaders in the field to build a consensus on the best practices for describing the methods utilized in fNIRS studies. Our paper has been designed to provide guidelines to help enhance the reliability, repeatability, and traceability of reported fNIRS studies and encourage best practices throughout the community. A checklist is provided to guide authors in the preparation of their manuscripts and to assist reviewers when evaluating fNIRS papers

Why behaviour matters: Studying inter-brain coordination during child-caregiver interaction

Modern technology allows for simultaneous neuroimaging from interacting caregiver-child dyads. Whereas most analyses that examine the coordination between brain regions within an individual brain do so by measuring changes relative to observed events, studies that examine coordination between two interacting brains generally do this by measuring average intra-brain coordination across entire blocks or experimental conditions. In other words, they do not examine changes in inter-brain coordination relative to individual behavioural events. Here, we discuss the limitations of this approach. First, we present data suggesting that fine-grained temporal interdependencies in behaviour can leave residual artifact in neuroimaging data. We show how artifact can manifest as both power and (through that) phase synchrony effects in EEG and affect wavelet transform coherence in fNIRS analyses. Second, we discuss different possible mechanistic explanations of how inter-brain coordination is established and maintained. We argue that non-event-locked approaches struggle to differentiate between them. Instead, we contend that approaches which examine how interpersonal dynamics change around behavioural events have better potential for addressing possible artifactual confounds and for teasing apart the overlapping mechanisms that drive changes in inter-brain coordination

Review of Artifact Rejection Methods for Electroencephalographic Systems

Technologies using electroencephalographic (EEG) signals have been penetrated into public by the development of EEG systems. During EEG system operation, recordings ought to be obtained under no restriction of movement for routine use in the real world. However, the lack of consideration of situational behavior constraints will cause technical/biological artifacts that often mixed with EEG signals and make the signal processing difficult in all respects by ingeniously disguising themselves as EEG components. EEG systems integrating gold standard or specialized device in their processing strategies would appear as daily tools in the future if they are unperturbed to such obstructions. In this chapter, we describe algorithms for artifact rejection in multi-/single-channel. In particular, some existing single-channel artifact rejection methods that will exhibit beneficial information to improve their performance in online EEG systems were summarized by focusing on the advantages and disadvantages of algorithms