An Experimental Study of Byzantine-Robust Aggregation Schemes in Federated Learning

Byzantine-robust federated learning aims at mitigating Byzantine failures during the federated training process, where malicious participants may upload arbitrary local updates to the central server to degrade the performance of the global model. In recent years, several robust aggregation schemes have been proposed to defend against malicious updates from Byzantine clients and improve the robustness of federated learning. These solutions were claimed to be Byzantine-robust, under certain assumptions. Other than that, new attack strategies are emerging, striving to circumvent the defense schemes. However, there is a lack of systematic comparison and empirical study thereof. In this paper, we conduct an experimental study of Byzantine-robust aggregation schemes under different attacks using two popular algorithms in federated learning, FedSGD and FedAvg . We first survey existing Byzantine attack strategies and Byzantine-robust aggregation schemes that aim to defend against Byzantine attacks. We also propose a new scheme, ClippedClustering , to enhance the robustness of a clustering-based scheme by automatically clipping the updates. Then we provide an experimental evaluation of eight aggregation schemes in the scenario of five different Byzantine attacks. Our results show that these aggregation schemes sustain relatively high accuracy in some cases but are ineffective in others. In particular, our proposed ClippedClustering successfully defends against most attacks under independent and IID local datasets. However, when the local datasets are Non-IID, the performance of all the aggregation schemes significantly decreases. With Non-IID data, some of these aggregation schemes fail even in the complete absence of Byzantine clients. We conclude that the robustness of all the aggregation schemes is limited, highlighting the need for new defense strategies, in particular for Non-IID datasets.Comment: This paper has been accepted for publication in IEEE Transactions on Big Dat

Ciliary parathyroid hormone signaling activates transforming growth factor-β to maintain intervertebral disc homeostasis during aging

© 2018 The Author(s). Degenerative disc disease (DDD) is associated with intervertebral disc degeneration of spinal instability. Here, we report that the cilia of nucleus pulposus (NP) cells mediate mechanotransduction to maintain anabolic activity in the discs. We found that mechanical stress promotes transport of parathyroid hormone 1 receptor (PTH1R) to the cilia and enhances parathyroid hormone (PTH) signaling in NP cells. PTH induces transcription of integrin αvβ6 to activate the transforming growth factor (TGF)-β-connective tissue growth factor (CCN2)-matrix proteins signaling cascade. Intermittent injection of PTH (iPTH) effectively attenuates disc degeneration of aged mice by direct signaling through NP cells, specifically improving intervertebral disc height and volume by increasing levels of TGF-β activity, CCN2, and aggrecan. PTH1R is expressed in both mouse and human NP cells. Importantly, knockout PTH1R or cilia in the NP cells results in significant disc degeneration and blunts the effect of PTH on attenuation of aged discs. Thus, mechanical stress-induced transport of PTH1R to the cilia enhances PTH signaling, which helps maintain intervertebral disc homeostasis, particularly during aging, indicating therapeutic potential of iPTH for DDD

Haematopoietic stem cells do not asymmetrically segregate chromosomes or retain BrdU

Stem cells are proposed to segregate chromosomes asymmetrically during self-renewing divisions so that older ('immortal') DNA strands are retained in daughter stem cells whereas newly synthesized strands segregate to differentiating cells(1-6). Stem cells are also proposed to retain DNA labels, such as 5-bromo-2-deoxyuridine (BrdU), either because they segregate chromosomes asymmetrically or because they divide slowly(5,7-9). However, the purity of stem cells among BrdU-label-retaining cells has not been documented in any tissue, and the 'immortal strand hypothesis' has not been tested in a system with definitive stem cell markers. Here we tested these hypotheses in haematopoietic stem cells (HSCs), which can be highly purified using well characterized markers. We administered BrdU to newborn mice, mice treated with cyclophosphamide and granulocyte colony-stimulating factor, and normal adult mice for 4 to 10 days, followed by 70 days without BrdU. In each case, less than 6% of HSCs retained BrdU and less than 0.5% of all BrdU-retaining haematopoietic cells were HSCs, revealing that BrdU has poor specificity and poor sensitivity as an HSC marker. Sequential administration of 5-chloro-2-deoxyuridine and 5-iodo-2-deoxyuridine indicated that all HSCs segregate their chromosomes randomly. Division of individual HSCs in culture revealed no asymmetric segregation of the label. Thus, HSCs cannot be identified on the basis of BrdU-label retention and do not retain older DNA strands during division, indicating that these are not general properties of stem cells.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/62821/1/nature06115.pd

Juvenile Paget’s Disease From Heterozygous Mutation of SP7 Encoding Osterix (Specificity Protein 7, Transcription Factor Sp7)

Juvenile Paget's disease (JPD) became in 1974 the commonly used name for ultra-rare heritable occurrences of rapid bone remodeling throughout of the skeleton that present in infancy or early childhood as fractures and deformity hallmarked biochemically by marked elevation of serum alkaline phosphatase (ALP) activity (hyperphosphatasemia). Untreated, JPD can kill during childhood or young adult life. In 2002, we reported that homozygous deletion of the gene called tumor necrosis factor receptor superfamily, member 11B (TNFRSF11B) encoding osteoprotegerin (OPG) explained JPD in Navajos. Soon after, other bi-allelic loss-of-function TNFRSF11B defects were identified in JPD worldwide. OPG inhibits osteoclastogenesis and osteoclast activity by decoying receptor activator of nuclear factor κ-B (RANK) ligand (RANKL) away from its receptor RANK. Then, in 2014, we reported JPD in a Bolivian girl caused by a heterozygous activating duplication within TNFRSF11A encoding RANK. Herein, we identify mutation of a third gene underlying JPD. An infant girl began atraumatic fracturing of her lower extremity long-bones. Skull deformity and mild hearing loss followed. Our single investigation of the patient, when she was 15 years-of-age, showed generalized osteosclerosis and hyperostosis. DXA revealed a Z-score of +5.1 at her lumbar spine and T-score of +3.3 at her non-dominant wrist. Biochemical studies were consistent with positive mineral balance and several markers of bone turnover were elevated and included striking hyperphosphatasemia. Iliac crest histopathology was consistent with rapid skeletal remodeling. Measles virus transcripts, common in classic Paget's disease of bone, were not detected in circulating mononuclear cells. Then, reportedly, she responded to several months of alendronate therapy with less skeletal pain and correction of hyperphosphatasemia but had been lost to our follow-up. After we detected no defect in TNFRSF11A or B, trio exome sequencing revealed a de novo heterozygous missense mutation (c.926C>G; p.S309W) within SP7 encoding the osteoblast transcription factor osterix (specificity protein 7, transcription factor SP7). Thus, mutation of SP7 represents a third genetic cause of JPD

CRL4 antagonizes SCFFbxo7-mediated turnover of cereblon and BK channel to regulate learning and memory

Intellectual disability (ID), one of the most common human developmental disorders, can be caused by genetic mutations in Cullin 4B (Cul4B) and cereblon (CRBN). CRBN is a substrate receptor for the Cul4A/B-DDB1 ubiquitin ligase (CRL4) and can target voltage- and calcium-activated BK channel for ER retention. Here we report that ID-associated CRL4CRBNmutations abolish the interaction of the BK channel with CRL4, and redirect the BK channel to the SCFFbxo7ubiquitin ligase for proteasomal degradation. Glioma cell lines harbouring CRBN mutations record density-dependent decrease of BK currents, which can be restored by blocking Cullin ubiquitin ligase activity. Importantly, mice with neuron-specific deletion of DDB1 or CRBN express reduced BK protein levels in the brain, and exhibit similar impairment in learning and memory, a deficit that can be partially rescued by activating the BK channel. Our results reveal a competitive targeting of the BK channel by two ubiquitin ligases to achieve exquisite control of its stability, and support changes in neuronal excitability as a common pathogenic mechanism underlying CRL4CRBN–associated ID

Differential Gene Expression by RamA in Ciprofloxacin-Resistant Salmonella Typhimurium

Overexpression of ramA has been implicated in resistance to multiple drugs in several enterobacterial pathogens. In the present study, Salmonella Typhimurium strain LTL with constitutive expression of ramA was compared to its ramA-deletion mutant by employing both DNA microarrays and phenotype microarrays (PM). The mutant strain with the disruption of ramA showed differential expression of at least 33 genes involved in 11 functional groups. The study confirmed at the transcriptional level that the constitutive expression of ramA was directly associated with increased expression of multidrug efflux pump AcrAB-TolC and decreased expression of porin protein OmpF, thereby conferring multiple drug resistance phenotype. Compared to the parent strain constitutively expressing ramA, the ramA mutant had increased susceptibility to over 70 antimicrobials and toxic compounds. The PM analysis also uncovered that the ramA mutant was better in utilization of 10 carbon sources and 5 phosphorus sources. This study suggested that the constitutive expression of ramA locus regulate not only multidrug efflux pump and accessory genes but also genes involved in carbon metabolic pathways