Heterogeneity: An Open Challenge for Federated On-board Machine Learning

peer reviewedThe design of satellite missions is currently undergoing a paradigm shift from the historical approach of individualised monolithic satellites towards distributed mission configurations, consisting of multiple small satellites. With a rapidly growing number of such satellites now deployed in orbit, each collecting large amounts of data, interest in on-board orbital edge computing is rising. Federated Learning is a promising distributed computing approach in this context, allowing multiple satellites to collaborate efficiently in training on-board machine learning models. Though recent works on the use of Federated Learning in orbital edge computing have focused largely on homogeneous satellite constellations, Federated Learning could also be employed to allow heterogeneous satellites to form ad-hoc collaborations, e.g. in the case of communications satellites operated by different providers. Such an application presents additional challenges to the Federated Learning paradigm, arising largely from the heterogeneity of such a system. In this position paper, we offer a systematic review of these challenges in the context of the cross-provider use case, giving a brief overview of the state-of-the-art for each, and providing an entry point for deeper exploration of each issue.U-AGR-8025 - ILNAS PC2 - BOUVRY Pasca

Introducing FedPref: Federated Learning Across Heterogeneous Multi-objective Preferences

peer reviewedMulti-objective problems occur in all aspects of life; knowing how to solve them is crucial for accurate modelling of the real world. Rapid progress is being made in adapting traditional machine learning paradigms to the multi-objective use case, but so far few works address the specific challenges of distributed multi-objective learning. Federated Learning is a distributed machine learning paradigm introduced to tackle problems where training data originates in distribution and cannot be shared. With recent advances in hardware and model capabilities, Federated Learning (FL) is finding ever more widespread application to problems of increasing complexity, from deployment on edge devices to the tuning of large language models. However, heterogeneity caused by differences between participants remains a fundamental challenge in application. Existing work has largely focused on mitigating two major types of heterogeneity: data and device heterogeneity. Yet as the use of FL evolves, other types of heterogeneity become relevant. In this work, we consider one such emerging heterogeneity challenge: the preference-heterogeneous setting, where each participant has multiple objectives, and heterogeneity is induced by different preferences over these objectives. We propose FedPref, the first Personalised Federated Learning algorithm designed for this setting, and empirically demonstrate that our approach yields significantly improved average client performance and adaptability compared to other heterogeneity-mitigating algorithms across different preference distributions

Wnt signaling and Loxl2 promote aggressive osteosarcoma

Osteosarcoma (OS) is the most frequent primary malignant bone tumor in urgent need of better therapies. Using genetically modified mouse models (GEMMs), we demonstrate that Wnt signaling promotes c-Fos-induced OS formation via the actions of the collagen-modifying enzyme Loxl2. c-Fos/AP-1 directly regulates the expression of the Wnt ligands Wnt7b and Wnt9a in OS cells through promoter binding, and Wnt7b and Wnt9a in turn promote Loxl2 expression in murine and human OS cells through the transcription factors Zeb1 and Zeb2. Concordantly, inhibition of Wnt ligand secretion by inactivating the Wnt-less (Wls) gene in osteoblasts in c-Fos GEMMs either early or in a therapeutic setting reduces Loxl2 expression and progression of OS. Wls-deficient osteosarcomas proliferate less, are less mineralized and are enriched in fibroblastic cells surrounded by collagen fibers. Importantly, Loxl2 inhibition using either the pan-Lox inhibitor BAPN or a specific inducible shRNA reduces OS cell proliferation in vitro and decreases tumor growth and lung colonization in murine and human orthotopic OS transplantation models. Finally, OS development is delayed in c-Fos GEMMs treated with BAPN or with specific Loxl2 blocking antibodies. Congruently, a strong correlation between c-FOS, LOXL2 and WNT7B/WNT9A expression is observed in human OS samples, and c-FOS/LOXL2 coexpression correlates with OS aggressiveness and decreased patient survival. Therefore, therapeutic targeting of Wnt and/or Loxl2 should be considered to potentiate the inadequate current treatments for pediatric, recurrent, and metastatic OS

Benchmarking whole exome sequencing in the German Network for Personalized Medicine

Introduction Whole Exome Sequencing (WES) has emerged as an efficient tool in clinical cancer diagnostics to broaden the scope from panel-based diagnostics to screening of all genes and enabling robust determination of complex biomarkers in a single analysis. Methods To assess concordance, six formalin-fixed paraffin-embedded (FFPE) tissue specimens and four commercial reference standards were analyzed by WES as matched tumor-normal DNA at 21 NGS centers in Germany, each employing local wet-lab and bioinformatics investigating somatic and germline variants, copy-number alteration (CNA), and different complex biomarkers. Somatic variant calling was performed in 494 diagnostically relevant cancer genes. In addition, all raw data were re-analyzed with a central bioinformatic pipeline to separate wet- and dry-lab variability. Results The mean positive percentage agreement (PPA) of somatic variant calling was 76% and positive predictive value (PPV) 89% compared a consensus list of variants found by at least five centers. Variant filtering was identified as the main cause for divergent variant calls. Adjusting filter criteria and re-analysis increased the PPA to 88% for all and 97% for clinically relevant variants. CNA calls were concordant for 82% of genomic regions. Calls of homologous recombination deficiency (HRD), tumor mutational burden (TMB), and microsatellite instability (MSI) status were concordant for 94%, 93%, and 93% respectively. Variability of CNAs and complex biomarkers did not increase considerably using the central pipeline and was hence attributed to wet-lab differences. Conclusion Continuous optimization of bioinformatic workflows and participating in round robin tests are recommend

Rare coding variants in PLCG2, ABI3, and TREM2 implicate microglial-mediated innate immunity in Alzheimer's disease

We identified rare coding variants associated with Alzheimer’s disease (AD) in a 3-stage case-control study of 85,133 subjects. In stage 1, 34,174 samples were genotyped using a whole-exome microarray. In stage 2, we tested associated variants (P<1×10-4) in 35,962 independent samples using de novo genotyping and imputed genotypes. In stage 3, an additional 14,997 samples were used to test the most significant stage 2 associations (P<5×10-8) using imputed genotypes. We observed 3 novel genome-wide significant (GWS) AD associated non-synonymous variants; a protective variant in PLCG2 (rs72824905/p.P522R, P=5.38×10-10, OR=0.68, MAFcases=0.0059, MAFcontrols=0.0093), a risk variant in ABI3 (rs616338/p.S209F, P=4.56×10-10, OR=1.43, MAFcases=0.011, MAFcontrols=0.008), and a novel GWS variant in TREM2 (rs143332484/p.R62H, P=1.55×10-14, OR=1.67, MAFcases=0.0143, MAFcontrols=0.0089), a known AD susceptibility gene. These protein-coding changes are in genes highly expressed in microglia and highlight an immune-related protein-protein interaction network enriched for previously identified AD risk genes. These genetic findings provide additional evidence that the microglia-mediated innate immune response contributes directly to AD development

Common variants in Alzheimer’s disease and risk stratification by polygenic risk scores

Funder: Funder: Fundación bancaria ‘La Caixa’ Number: LCF/PR/PR16/51110003 Funder: Grifols SA Number: LCF/PR/PR16/51110003 Funder: European Union/EFPIA Innovative Medicines Initiative Joint Number: 115975 Funder: JPco-fuND FP-829-029 Number: 733051061Genetic discoveries of Alzheimer's disease are the drivers of our understanding, and together with polygenetic risk stratification can contribute towards planning of feasible and efficient preventive and curative clinical trials. We first perform a large genetic association study by merging all available case-control datasets and by-proxy study results (discovery n = 409,435 and validation size n = 58,190). Here, we add six variants associated with Alzheimer's disease risk (near APP, CHRNE, PRKD3/NDUFAF7, PLCG2 and two exonic variants in the SHARPIN gene). Assessment of the polygenic risk score and stratifying by APOE reveal a 4 to 5.5 years difference in median age at onset of Alzheimer's disease patients in APOE ɛ4 carriers. Because of this study, the underlying mechanisms of APP can be studied to refine the amyloid cascade and the polygenic risk score provides a tool to select individuals at high risk of Alzheimer's disease

Genomic Relationships, Novel Loci, and Pleiotropic Mechanisms across Eight Psychiatric Disorders

Genetic influences on psychiatric disorders transcend diagnostic boundaries, suggesting substantial pleiotropy of contributing loci. However, the nature and mechanisms of these pleiotropic effects remain unclear. We performed analyses of 232,964 cases and 494,162 controls from genome-wide studies of anorexia nervosa, attention-deficit/hyper-activity disorder, autism spectrum disorder, bipolar disorder, major depression, obsessive-compulsive disorder, schizophrenia, and Tourette syndrome. Genetic correlation analyses revealed a meaningful structure within the eight disorders, identifying three groups of inter-related disorders. Meta-analysis across these eight disorders detected 109 loci associated with at least two psychiatric disorders, including 23 loci with pleiotropic effects on four or more disorders and 11 loci with antagonistic effects on multiple disorders. The pleiotropic loci are located within genes that show heightened expression in the brain throughout the lifespan, beginning prenatally in the second trimester, and play prominent roles in neurodevelopmental processes. These findings have important implications for psychiatric nosology, drug development, and risk prediction.Peer reviewe

New insights into the genetic etiology of Alzheimer's disease and related dementias

Characterization of the genetic landscape of Alzheimer's disease (AD) and related dementias (ADD) provides a unique opportunity for a better understanding of the associated pathophysiological processes. We performed a two-stage genome-wide association study totaling 111,326 clinically diagnosed/'proxy' AD cases and 677,663 controls. We found 75 risk loci, of which 42 were new at the time of analysis. Pathway enrichment analyses confirmed the involvement of amyloid/tau pathways and highlighted microglia implication. Gene prioritization in the new loci identified 31 genes that were suggestive of new genetically associated processes, including the tumor necrosis factor alpha pathway through the linear ubiquitin chain assembly complex. We also built a new genetic risk score associated with the risk of future AD/dementia or progression from mild cognitive impairment to AD/dementia. The improvement in prediction led to a 1.6- to 1.9-fold increase in AD risk from the lowest to the highest decile, in addition to effects of age and the APOE ε4 allele

Dissecting the Shared Genetic Architecture of Suicide Attempt, Psychiatric Disorders, and Known Risk Factors

Background Suicide is a leading cause of death worldwide, and nonfatal suicide attempts, which occur far more frequently, are a major source of disability and social and economic burden. Both have substantial genetic etiology, which is partially shared and partially distinct from that of related psychiatric disorders. Methods We conducted a genome-wide association study (GWAS) of 29,782 suicide attempt (SA) cases and 519,961 controls in the International Suicide Genetics Consortium (ISGC). The GWAS of SA was conditioned on psychiatric disorders using GWAS summary statistics via multitrait-based conditional and joint analysis, to remove genetic effects on SA mediated by psychiatric disorders. We investigated the shared and divergent genetic architectures of SA, psychiatric disorders, and other known risk factors. Results Two loci reached genome-wide significance for SA: the major histocompatibility complex and an intergenic locus on chromosome 7, the latter of which remained associated with SA after conditioning on psychiatric disorders and replicated in an independent cohort from the Million Veteran Program. This locus has been implicated in risk-taking behavior, smoking, and insomnia. SA showed strong genetic correlation with psychiatric disorders, particularly major depression, and also with smoking, pain, risk-taking behavior, sleep disturbances, lower educational attainment, reproductive traits, lower socioeconomic status, and poorer general health. After conditioning on psychiatric disorders, the genetic correlations between SA and psychiatric disorders decreased, whereas those with nonpsychiatric traits remained largely unchanged. Conclusions Our results identify a risk locus that contributes more strongly to SA than other phenotypes and suggest a shared underlying biology between SA and known risk factors that is not mediated by psychiatric disorders.Peer reviewe