Interactions between visual and semantic processing during object recognition revealed by modulatory effects of age of acquisition

The age of acquisition (AoA) of objects and their names is a powerful determinant of processing speed in adulthood, with early-acquired objects being recognized and named faster than late-acquired objects. Previous research using fMRI (Ellis et al., 2006. Traces of vocabulary acquisition in the brain: evidence from covert object naming. NeuroImage 33, 958–968) found that AoA modulated the strength of BOLD responses in both occipital and left anterior temporal cortex during object naming. We used magnetoencephalography (MEG) to explore in more detail the nature of the influence of AoA on activity in those two regions. Covert object naming recruited a network within the left hemisphere that is familiar from previous research, including visual, left occipito-temporal, anterior temporal and inferior frontal regions. Region of interest (ROI) analyses found that occipital cortex generated a rapid evoked response (~ 75–200 ms at 0–40 Hz) that peaked at 95 ms but was not modulated by AoA. That response was followed by a complex of later occipital responses that extended from ~ 300 to 850 ms and were stronger to early- than late-acquired items from ~ 325 to 675 ms at 10–20 Hz in the induced rather than the evoked component. Left anterior temporal cortex showed an evoked response that occurred significantly later than the first occipital response (~ 100–400 ms at 0–10 Hz with a peak at 191 ms) and was stronger to early- than late-acquired items from ~ 100 to 300 ms at 2–12 Hz. A later anterior temporal response from ~ 550 to 1050 ms at 5–20 Hz was not modulated by AoA. The results indicate that the initial analysis of object forms in visual cortex is not influenced by AoA. A fastforward sweep of activation from occipital and left anterior temporal cortex then results in stronger activation of semantic representations for early- than late-acquired objects. Top-down re-activation of occipital cortex by semantic representations is then greater for early than late acquired objects resulting in delayed modulation of the visual response

Resting state electroencephalographic rhythms are affected by immediately preceding memory demands in cognitively unimpaired elderly and patients with mild cognitive impairment

Experiments on event-related electroencephalographic oscillations in aged people typically include blocks of cognitive tasks with a few minutes of interval between them. The present exploratory study tested the effect of being engaged on cognitive tasks over the resting state cortical arousal after task completion, and whether it differs according to the level of the participant’s cognitive decline. To investigate this issue, we used a local database including data in 30 healthy cognitively unimpaired (CU) persons and 40 matched patients with amnestic mild cognitive impairment (aMCI). They had been involved in 2 memory tasks for about 40 min and underwent resting-state electroencephalographic (rsEEG) recording after 5 min from the task end. eLORETA freeware estimated rsEEG alpha source activity as an index of general cortical arousal. In the CU but not aMCI group, there was a negative correlation between memory tasks performance and posterior rsEEG alpha source activity. The better the memory tasks performance, the lower the posterior alpha activity (i.e., higher cortical arousal). There was also a negative correlation between neuropsychological test scores of global cognitive status and alpha source activity. These results suggest that engagement in memory tasks may perturb background brain arousal for more than 5 min after the tasks end, and that this effect are dependent on participants global cognitive status. Future studies in CU and aMCI groups may cross-validate and extend these results with experiments including (1) rsEEG recordings before memory tasks and (2) post-tasks rsEEG recordings after 5, 15, and 30 minThis study was supported by grants from the Spanish Government, Ministerio de Ciencia e Innovación (PSI2017- 89389-C2-R and PID2020-114521RB-C21/C22); the Galician Government (Xunta de Galicia), Axudas para a Consolidación e Estruturación de Unidades de Investigación Competitivas do Sistema Universitario de Galicia: GRC (GI-1807- USC); Ref: ED431-2017/27 and ED431C-2021/04; all with ERDF/FEDER funds. DP was supported by the Fundação para a Ciência e a Tecnologia (FCT) grant with reference SFRH/BPD/120111/2016. AF was supported by an FPI grant from the Ministerio de Ciencia e Innovación with reference PRE2018-085514S

Applying neural networks for improving the MEG inverse solution

Magnetoencephalography (MEG) and electroencephalography (EEG) are appealing non-invasive methods for recording brain activity with high temporal resolution. However, locating the brain source currents from recordings picked up by the sensors on the scalp introduces an ill-posed inverse problem. The MEG inverse problem one of the most difficult inverse problems in medical imaging. The current standard in approximating the MEG inverse problem is to use multiple distributed inverse solutions – namely dSPM, sLORETA and L2 MNE – to estimate the source current distribution in the brain. This thesis investigates if these inverse solutions can be "post-processed" by a neural network to provide improved accuracy on source locations. Recently, deep neural networks have been used to approximate other ill-posed inverse medical imaging problems with accuracy comparable to current state-of- the-art inverse reconstruction algorithms. Neural networks are powerful tools for approximating problems with limited prior knowledge or problems that require high levels of abstraction. In this thesis a special case of a deep convolutional network, the U-Net, is applied to approximate the MEG inverse problem using the standard inverse solutions (dSPM, sLORETA and L2 MNE) as inputs. The U-Net is capable of learning non-linear relationships between the inputs and producing predictions about the site of single-dipole activation with higher accuracy than the L2 minimum-norm based inverse solutions with the following resolution metrics: dipole localization error (DLE), spatial dispersion (SD) and overall amplitude (OA). The U-Net model is stable and performs better in aforesaid resolution metrics than the inverse solutions with multi-dipole data previously unseen by the U-Net

Event-related brain potential indexes provide evidence for some decline in healthy people with subjective memory complaints during target evaluation and response inhibition processing

In the preclinical stage of the Alzheimer’s disease (AD) continuum, subjects report subjective memory complaints (SMCs), although with the absence of any objective decline, and have a higher risk of progressing to dementia than the general population. Early identification of this stage therefore constitutes a major focus of current AD research, to enable early intervention. In this study, healthy adult participants with high and low SMCs (HSMCs and LSMCs) performed a Go/NoGo task during electroencephalogram (EEG) recording. Relative to LSMC participants, HSMC participants performed the task slower (longer reaction times) and showed changes in the event-related potential (ERP) components associated with response preparation (lower readiness potential -RP- amplitude in the Go condition), and also related to response inhibition processes (lower N2-P3 amplitude in the NoGo condition). In addition, HSMC participants showed lower Go-N2 and NoGo-N2 peak-to-baseline amplitudes, however these results seem to be influenced by a negative tendency overlapping stimulus-related waveforms. The declines observed in this study are mostly consistent with those observed in aMCI participants, supporting the notion of the AD continuum regarding SMC stateThis study was supported by grants from the Spanish Government, Ministerio de Economía y Competitividad (PSI2014-55316-C3-3-R; PSI2017-89389-C2-2-R), with FEDER Funds; the Galician Government, Consellería de Cultura, Educación e Ordenación Universitaria, Axudas para a Consolidación e Estruturación de Unidades de Investigación Competitivas do Sistema Universitario de Galicia: GRC (GI-1807-USC); Ref: ED431-2017/27, with FEDER funds; the Galician Government, Consellería de Cultura, Educación e Ordenación Universitaria, Programa de axudas de apoio á etapa de formación posdoutoral (Xunta de Galicia, 2016); Ref: ED481B2016/078-0S

Pattern Recognition

Pattern recognition is a very wide research field. It involves factors as diverse as sensors, feature extraction, pattern classification, decision fusion, applications and others. The signals processed are commonly one, two or three dimensional, the processing is done in real- time or takes hours and days, some systems look for one narrow object class, others search huge databases for entries with at least a small amount of similarity. No single person can claim expertise across the whole field, which develops rapidly, updates its paradigms and comprehends several philosophical approaches. This book reflects this diversity by presenting a selection of recent developments within the area of pattern recognition and related fields. It covers theoretical advances in classification and feature extraction as well as application-oriented works. Authors of these 25 works present and advocate recent achievements of their research related to the field of pattern recognition

Improving Engagement Assessment by Model Individualization and Deep Learning

This dissertation studies methods that improve engagement assessment for pilots. The major work addresses two challenging problems involved in the assessment: individual variation among pilots and the lack of labeled data for training assessment models. Task engagement is usually assessed by analyzing physiological measurements collected from subjects who are performing a task. However, physiological measurements such as Electroencephalography (EEG) vary from subject to subject. An assessment model trained for one subject may not be applicable to other subjects. We proposed a dynamic classifier selection algorithm for model individualization and compared it to other two methods: base line normalization and similarity-based model replacement. Experimental results showed that baseline normalization and dynamic classifier selection can significantly improve cross-subject engagement assessment. For complex tasks such as piloting an air plane, labeling engagement levels for pilots is challenging. Without enough labeled data, it is very difficult for traditional methods to train valid models for effective engagement assessment. This dissertation proposed to utilize deep learning models to address this challenge. Deep learning models are capable of learning valuable feature hierarchies by taking advantage of both labeled and unlabeled data. Our results showed that deep models are better tools for engagement assessment when label information is scarce. To further verify the power of deep learning techniques for scarce labeled data, we applied the deep learning algorithm to another small size data set, the ADNI data set. The ADNI data set is a public data set containing MRI and PET scans of Alzheimer\u27s Disease (AD) patients for AD diagnosis. We developed a robust deep learning system incorporating dropout and stability selection techniques to identify the different progression stages of AD patients. The experimental results showed that deep learning is very effective in AD diagnosis. In addition, we studied several imbalance learning techniques that are useful when data is highly unbalanced, i.e., when majority classes have many more training samples than minority classes. Conventional machine learning techniques usually tend to classify all data samples into majority classes and to perform poorly for minority classes. Unbalanced learning techniques can balance data sets before training and can improve learning performance