Removing the effects of the site in brain imaging machine-learning Measurement and extendable benchmark

Multisite machine-learning neuroimaging studies, such as those conducted by the ENIGMA Consortium, need to remove the differences between sites to avoid effects of the site (EoS) that may prevent or fraudulently help the creation of prediction models, leading to impoverished or inflated prediction accuracy. Unfortunately, we have shown earlier that current Methods Aiming to Remove the EoS (MAREoS, e.g., ComBat) cannot remove complex EoS (e.g., including interactions between regions). And complex EoS may bias the accuracy. To overcome this hurdle, groups worldwide are developing novel MAREoS. However, we cannot assess their effectiveness because EoS may either inflate or shrink the accuracy, and MAREoS may both remove the EoS and degrade the data. In this work, we propose a strategy to measure the effectiveness of a MAREoS in removing different types of EoS. FOR MAREOS DEVELOPERS, we provide two multisite MRI datasets with only simple true effects (i.e., detectable by most machine-learning algorithms) and two with only simple EoS (i.e., removable by most MAREoS). First, they should use these datasets to fit machine-learning algorithms after applying the MAREoS. Second, they should use the formulas we provide to calculate the relative accuracy change associated with the MAREoS in each dataset and derive an EoS-removal effectiveness statistic. We also offer similar datasets and formulas for complex true effects and EoS that include first-order interactions. FOR MACHINE-LEARNING RESEARCHERS, we provide an extendable benchmark website to show: a) the types of EoS they should remove for each given machine-learning algorithm and b) the effectiveness of each MAREoS for removing each type of EoS. Relevantly, a MAREoS only able to remove the simple EoS may suffice for simple machine-learning algorithms, whereas more complex algorithms need a MAREoS that can remove more complex EoS. For instance, ComBat removes all simple EoS as needed for predictions based on simple lasso algorithms, but it leaves residual complex EoS that may bias the predictions based on standard support vector machine algorithms

Influence of corpus callosum damage on cognition and physical disability in multiple sclerosis: a multimodal study.

Background Corpus callosum (CC) is a common target for multiple sclerosis (MS) pathology. We investigated the influence of CC damage on physical disability and cognitive dysfunction using a multimodal approach. Methods Twenty-one relapsing-remitting MS patients and 13 healthy controls underwent structural MRI and diffusion tensor of the CC (fractional anisotropy; mean diffusivity, MD; radial diffusivity, RD; axial diffusivity). Interhemisferic transfer of motor inhibition was assessed by recording the ipsilateral silent period (iSP) to transcranial magnetic stimulation. We evaluated cognitive function using the Brief Repeatable Battery and physical disability using the Expanded Disability Status Scale (EDSS) and the MS Functional Composite (MSFC) z-score. Results The iSP latency correlated with physical disability scores (r ranged from 0.596 to 0.657, P values from 0.004 to 0.001), and with results of visual memory (r = −0.645, P = 0.002), processing speed (r = −0.51, P = 0.018) and executive cognitive domain tests (r = −0.452, P = 0.039). The area of the rostrum correlated with the EDSS (r = −0.442, P = 0.045). MD and RD correlated with cognitive performance, mainly with results of visual and verbal memory tests (r ranged from −0.446 to −0.546, P values from 0.048 to 0.011). The iSP latency correlated with CC area (r = −0.345, P = 0.049), volume (r = −0.401, P = 0.002), MD (r = 0.404, P = 0.002) and RD (r = 0.415, P = 0.016). Conclusions We found evidence for structural and microstructural CC abnormalities associated with impairment of motor callosal inhibitory conduction in MS. CC damage may contribute to cognitive dysfunction and in less extent to physical disability likely through a disconnection mechanism

The multiple sclerosis visual pathway cohort: understanding neurodegeneration in MS

BACKGROUND: Multiple Sclerosis (MS) is an immune-mediated disease of the Central Nervous System with two major underlying etiopathogenic processes: inflammation and neurodegeneration. The latter determines the prognosis of this disease. MS is the main cause of non-traumatic disability in middle-aged populations. FINDINGS: The MS-VisualPath Cohort was set up to study the neurodegenerative component of MS using advanced imaging techniques by focusing on analysis of the visual pathway in a middle-aged MS population in Barcelona, Spain. We started the recruitment of patients in the early phase of MS in 2010 and it remains permanently open. All patients undergo a complete neurological and ophthalmological examination including measurements of physical and disability (Expanded Disability Status Scale; Multiple Sclerosis Functional Composite and neuropsychological tests), disease activity (relapses) and visual function testing (visual acuity, color vision and visual field). The MS-VisualPath protocol also assesses the presence of anxiety and depressive symptoms (Hospital Anxiety and Depression Scale), general quality of life (SF-36) and visual quality of life (25-Item National Eye Institute Visual Function Questionnaire with the 10-Item Neuro-Ophthalmic Supplement). In addition, the imaging protocol includes both retinal (Optical Coherence Tomography and Wide-Field Fundus Imaging) and brain imaging (Magnetic Resonance Imaging). Finally, multifocal Visual Evoked Potentials are used to perform neurophysiological assessment of the visual pathway. DISCUSSION: The analysis of the visual pathway with advance imaging and electrophysilogical tools in parallel with clinical information will provide significant and new knowledge regarding neurodegeneration in MS and provide new clinical and imaging biomarkers to help monitor disease progression in these patients

Assessing biological and methodological aspects of brain volume loss in multiple sclerosis

Importance: Before using brain volume loss (BVL) as a marker of therapeutic response in multiple sclerosis (MS), certain biological and methodological issues must be clarified. Objectives: To assess the dynamics of BVL as MS progresses and to evaluate the repeatability and exchangeability of BVL estimates with Jacobian Integration (JI) and Functional Magnetic Resonance Imaging of the Brain (FMRIB) Software Library (FSL) (specifically, the Structural Image Evaluation, Using Normalisation, of Atrophy-Cross-Sectional [SIENA-X] tool or FMRIB's Integrated Registration and Segmentation Tool [FIRST]). Design, Setting, and Participants: A cohort of patients who had either clinically isolated syndrome or MS was enrolled from February 2011 through October 2015. All underwent a series of annual magnetic resonance imaging (MRI) scans. Images from 2 cohorts of healthy volunteers were used to evaluate short-term repeatability of the MRI measurements (n = 34) and annual BVL (n = 20). Data analysis occurred from January to May 2017. Main Outcomes and Measures: The goodness of fit of different models to the dynamics of BVL throughout the MS disease course was assessed. The short-term test-retest error was used as a measure of JI and FSL repeatability. The correlations (R2) of the changes quantified in the brain using JI and FSL, together with the accuracy of the annual BVL cutoffs to discriminate patients with MS from healthy volunteers, were used to measure compatibility of imaging methods. Results: A total of 140 patients with clinically isolated syndrome or MS were enrolled, including 95 women (67.9%); the group had a median (interquartile range) age of 40.7 (33.6-48.1) years. Patients underwent 4 MRI scans with a median (interquartile range) interscan period of 364 (351-379) days. The 34 healthy volunteers (of whom 18 [53%] were women; median [IQR] age, 33.5 [26.2-42.5] years) and 20 healthy volunteers (of whom 10 [50%] were women; median [IQR] age, 33.0 [28.7-39.2] years) underwent 2 MRI scans within a median (IQR) of 24.5 (0.0-74.5) days and 384.5 (366.3-407.8) days for the short-term and long-term MRI follow-up, respectively. The BVL rates were higher in the first 5 years after MS onset (R2 = 0.65 for whole-brain volume change and R2 = 0.52 for gray matter volume change) with a direct association with steroids (β = 0.280; P = .02) and an inverse association with age at MS onset, particularly in the first 5 years (β = 0.015; P = .047). The reproducibility of FSL (SIENA) and JI was similar for whole-brain volume loss, while JI gave more precise, less biased estimates for specific brain regions than FSL (SIENA-X and FIRST). The correlation between whole-brain volume loss using JI and FSL was high (R2 = 0.92), but the same correlations were poor for specific brain regions. The area under curve of the whole-brain volume change to discriminate between patients with MS and healthy volunteers was similar, although the thresholds and accuracy index were distinct for JI and FSL. Conclusions and Relevance: The proposed BVL threshold of less than 0.4% per year as a marker of therapeutic efficiency should be reconsidered because of the different dynamics of BVL as MS progresses and because of the limited reproducibility and variability of estimates using different imaging methods

Intense long-term training impairs brain health compared with moderate exercise: Experimental evidence and mechanisms

The consequences of extremely intense long-term exercise for brain health remain unknown. We studied the effects of strenuous exercise on brain structure and function, its dose-response relationship, and mechanisms in a rat model of endurance training. Five-week-old male Wistar rats were assigned to moderate (MOD) or intense (INT) exercise or a sedentary (SED) group for 16 weeks. MOD rats showed the highest motivation and learning capacity in operant conditioning experiments; SED and INT presented similar results. In vivo MRI demonstrated enhanced global and regional connectivity efficiency and clustering as well as a higher cerebral blood flow (CBF) in MOD but not INT rats compared with SED. In the cortex, downregulation of oxidative phosphorylation complex IV and AMPK activation denoted mitochondrial dysfunction in INT rats. An imbalance in cortical antioxidant capacity was found between MOD and INT rats. The MOD group showed the lowest hippocampal brain-derived neurotrophic factor levels. The mRNA and protein levels of inflammatory markers were similar in all groups. In conclusion, strenuous long-term exercise yields a lesser improvement in learning ability than moderate exercise. Blunting of MOD-induced improvements in CBF and connectivity efficiency, accompanied by impaired mitochondrial energetics and, possibly, transient local oxidative stress, may underlie the findings in intensively trained rats

Predictors of vision impairment in Multiple Sclerosis.

Visual impairment significantly alters the quality of life of people with Multiple Sclerosis (MS). The objective of this study was to identify predictors (independent variables) of visual outcomes, and to define their relationship with neurological disability and retinal atrophy when assessed by optical coherence tomography (OCT). We performed a cross-sectional analysis of 119 consecutive patients with MS, assessing vision using high contrast visual acuity (LogMar), 2.5% and 1.25% low contrast visual acuity (Sloan charts), and color vision (Hardy-Rand-Rittler plates). Quality of vision is a patient reported outcome based on an individual's unique perception of his or her vision and was assessed with the Visual Functioning Questionnaire-25 (VFQ-25) with the 10 neuro-ophthalmologic items. MS disability was assessed using the expanded disability status scale (EDSS), the MS functional composite (MSFC) and the brief repetitive battery-neuropsychology (BRB-N). Retinal atrophy was assessed using spectral domain OCT, measuring the thickness of the peripapillar retinal nerve fiber layer (pRNFL) and the volume of the ganglion cell plus inner plexiform layer (GCIPL). The vision of patients with MS was impaired, particularly in eyes with prior optic neuritis. Retinal atrophy (pRNFL and GCIPL) was closely associated with impaired low contrast vision and color vision, whereas the volume of the GCIPL showed a trend (p = 0.092) to be associated with quality of vision. Multiple regression analysis revealed that EDSS was an explanatory variable for high contrast vision after stepwise analysis, GCIPL volume for low contrast vision, and GCIPL volume and EDSS for color vision. The explanatory variables for quality of vision were high contrast vision and color vision. In summary, quality of vision in MS depends on the impairment of high contrast visual acuity and color vision due to the disease

Cognitive Performance and Health-Related Quality of Life in Patients with Neuromyelitis Optica Spectrum Disorder

Background: The frequency of cognitive impairment (CI) reported in neuromyelitis optica spectrum disorder (NMOSD) is highly variable, and its relationship with demographic and clinical characteristics is poorly understood. We aimed to describe the cognitive profile of NMOSD patients, and to analyse the cognitive differences according to their serostatus; furthermore, we aimed to assess the relationship between cognition, demographic and clinical characteristics, and other aspects linked to health-related quality of life (HRQoL). Methods: This cross-sectional study included 41 patients (median age, 44 years; 85% women) from 13 Spanish centres. Demographic and clinical characteristics were collected along with a cognitive z-score (Rao's Battery) and HRQoL patient-centred measures, and their relationship was explored using linear regression. We used the Akaike information criterion to model which characteristics were associated with cognition. Results: Fourteen patients (34%) had CI, and the most affected cognitive domain was visual memory. Cognition was similar in AQP4-IgG-positive and -negative patients. Gender, mood, fatigue, satisfaction with life, and perception of stigma were associated with cognitive performance (adjusted R-2 = 0.396, p < 0.001). Conclusions: The results highlight the presence of CI and its impact on HRQoL in NMOSD patients. Cognitive and psychological assessments may be crucial to achieve a holistic approach in patient care

Evaluation of treatment response in adults with relapsing MOG-Ab-associated disease

Background: Myelin oligodendrocyte glycoprotein antibodies (MOG-Ab) are related to several acquired demyelinating syndromes in adults, but the therapeutic approach is currently unclear. We aimed to describe the response to different therapeutic strategies in adult patients with relapsing MOG-Ab-associated disease. Methods: This is a retrospective study conducted in France and Spain including 125 relapsing MOG-Ab patients aged ≥ 18 years. First, we performed a survival analysis to investigate the relapse risk between treated and non-treated patients, performing a propensity score method based on the inverse probability of treatment weighting. Second, we assessed the annualised relapse rates (ARR), Expanded Disability Status Scale (EDSS) and visual acuity pre-treatment and on/end-treatment. Results: Median age at onset was 34.1 years (range 18.0-67.1), the female to male ratio was 1.2:1, and 96% were Caucasian. At 5 years, 84% (95% confidence interval [CI], 77.1-89.8) patients relapsed. At the last follow-up, 66 (52.8%) received maintenance therapy. Patients initiating immunosuppressants (azathioprine, mycophenolate mophetil [MMF], rituximab) were at lower risk of new relapse in comparison to non-treated patients (HR, 0.41; 95CI%, 0.20-0.82; p = 0.011). Mean ARR (standard deviation) was reduced from 1.05(1.20) to 0.43(0.79) with azathioprine (n = 11; p = 0.041), from 1.20(1.11) to 0.23(0.60) with MMF (n = 11; p = 0.033), and from 1.08(0.98) to 0.43(0.89) with rituximab (n = 26; p = 0.012). Other immunosuppressants (methotrexate/mitoxantrone/cyclophosphamide; n = 5), or multiple sclerosis disease-modifying drugs (MS-DMD; n = 9), were not associated with significantly reduced ARR. Higher rates of freedom of EDSS progression were observed with azathioprine, MMF or rituximab. Conclusion: In adults with relapsing MOG-Ab-associated disease, immunosuppressant therapy (azathioprine, MMF and rituximab) is associated with reduced risk of relapse and better disability outcomes. Such an effect was not found in the few patients treated with MS-DMD

Randomized placebo-controlled phase II trial of autologous mesenchymal stem cells in multiple sclerosis.

OBJECTIVE: Uncontrolled studies of mesenchymal stem cells (MSCs) in multiple sclerosis suggested some beneficial effect. In this randomized, double-blind, placebo-controlled, crossover phase II study we investigated their safety and efficacy in relapsing-remitting multiple sclerosis patients. Efficacy was evaluated in terms of cumulative number of gadolinium-enhancing lesions (GEL) on magnetic resonance imaging (MRI) at 6 months and at the end of the study. METHODS: Patients unresponsive to conventional therapy, defined by at least 1 relapse and/or GEL on MRI scan in past 12 months, disease duration 2 to 10 years and Expanded Disability Status Scale (EDSS) 3.0-6.5 were randomized to receive IV 1-2×10(6) bone-marrow-derived-MSCs/Kg or placebo. After 6 months, the treatment was reversed and patients were followed-up for another 6 months. Secondary endpoints were clinical outcomes (relapses and disability by EDSS and MS Functional Composite), and several brain MRI and optical coherence tomography measures. Immunological tests were explored to assess the immunomodulatory effects. RESULTS: At baseline 9 patients were randomized to receive MSCs (n = 5) or placebo (n = 4). One patient on placebo withdrew after having 3 relapses in the first 5 months. We did not identify any serious adverse events. At 6 months, patients treated with MSCs had a trend to lower mean cumulative number of GEL (3.1, 95% CI = 1.1-8.8 vs 12.3, 95% CI = 4.4-34.5, p = 0.064), and at the end of study to reduced mean GEL (-2.8±5.9 vs 3±5.4, p = 0.075). No significant treatment differences were detected in the secondary endpoints. We observed a non-significant decrease of the frequency of Th1 (CD4+ IFN-γ+) cells in blood of MSCs treated patients. CONCLUSION: Bone-marrow-MSCs are safe and may reduce inflammatory MRI parameters supporting their immunomodulatory properties. ClinicalTrials.gov NCT01228266

Estudios de resonancia magnética y técnicas electrofisiológicas para evaluar y predecir la discapacidad en pacientes con esclerosis múltiple

La presente tesis se basa en cuatro artículos originales y un artículo de revisión que pertenecen a una misma línea de trabajo: el uso de técnicas de resonancia magnética (RM) y electrofisiológicas para evaluar y predecir la discapacidad física o cognitiva en pacientes con esclerosis múltiple (EM). En primer lugar, a través de RM convencional se ha evaluado el comportamiento radiológico de determinados patrones de lesiones cerebrales y su asociación con una peor evolución de la discapacidad. El trabajo muestra que las lesiones con un borde hipointenso en secuencias T2 y las lesiones captantes de gadolinio en anillo aparecen en el 9 y 12% de los pacientes con EM seguidos según la práctica clínica habitual. Además, la presencia de lesiones captantes de gadolinio en forma de anillo incrementa el riesgo de alcanzar una discapacidad elevada en menor tiempo y por tanto predice una peor evolución de la enfermedad. En segundo lugar se ha realizado un estudio multimodal del cuerpo calloso utilizando de forma conjunta técnicas electrofisiológicas con RM avanzada para indagar en el papel de la alteración de dicha estructura sobre la discapacidad física y cognitiva. El cuerpo calloso en pacientes con EM presenta una alteración tanto de la estructura e integridad microestructural como en la función de inhibición transcallosa. La alteración estructural y funcional de esta comisura se asocia con un bajo rendimiento cognitivo y con mayor discapacidad física. En tercer lugar se han utilizado diversas técnicas de RM avanzada para evaluar la integridad del tejido cerebral tanto de la sustancia gris como de la sustancia blanca y su relación con el rendimiento de diversas funciones cognitivas. En los pacientes existe un daño global de la integridad microestructural que afecta la sustancia blanca y la sustancia gris desde fases iniciales de la enfermedad. Sin embargo, la relación entre el daño microestructural y la disfunción cognitiva es específica de algunas regiones concretas según el test cognitivo evaluado. La integridad microestructural en la sustancia blanca y la presencia de lesiones parecen ser los principales eventos que explican la varianza del rendimiento cognitivo en pacientes poco discapacitados. En cuarto lugar, se ha investigado la capacidad de marcadores de desmielinización, daño axonal y astrogliosis en RM avanzada para predecir la discapacidad y la atrofia cerebral a medio plazo. Este último trabajo, actualmente enviado para su revisión a una revista científica, fue seleccionado para ser presentado en la “Contemporary Clinical Issues Plennary Session” de la Academia Americana de Neurología celebrada en Nueva Orleans en 2012. Del trabajo se concluye que la astrogliosis y el daño axonal son eventos relevantes en la progresión de la discapacidad y se propone el ratio de mioinositol/N-acetilaspartato obtenido mediante espectroscopia es un robusto predictor de la evolución de la atrofia y la discapacidad en pacientes con esclerosis múltiple. Estos estudios han servido para profundizar en el conocimiento de la fisiopatología de los condicionantes de la discapacidad, y en el avance en la búsqueda de marcadores de RM y electrofisiológicos útiles para evaluar y predecir la discapacidad en la EM.This thesis is based in four original articles and one review from the same research topic: the use of different magnetic resonance (MR) and electrophysiological techniques to evaluate and predict the clinical and cognitive disability in patients with multiple sclerosis (MS). First, the radiological behaviour and clinical meaning of lesions with hipointense rim on T2 weighted sequences and lesions with ring enhancement on T1 were evaluated. The presence of ring enhancement increases the risk of disability worsening. On the second article, the corpus callosum was evaluated through electrophysiological and MR techniques to understand the role of this structure on physical and cognitive dysfunction in MS patients. The structure and function of the corpus callosum is impaired in MS and relates to worse cognitive performance in memory and executive tests. Third, we used several advanced MR techniques to evaluate the integrity of brain tissue, both in white matter and grey matter, in MS and their relationship with cognitive functions. The microstructural integrity is widespread impaired although the cognitive performance relates to the damage of specific regions. The impairment of white matter microstructural integrity and the presence of lesions are the main factors explaining the cognitive impairment in patients. Finally, the capacity of markers of demyelination, axonal damage and astrogliosis to predict the evolution of disabilty and brain atrophy along four years was investigated. This work shows that astrogliosis and axonal damage are cardinal events leading to disesase evolution. The ratio of myoinositol and N-acetylaspartate obtained through spectroscopy is a robust predictor of disability and brain atrophy progression. These works have improved the knowledge on the physiopathological events underlying disability in multiple sclerosis and can be useful in the search of biomarkers that predict disease evolution