ZeroFL: Efficient On-Device Training for Federated Learning with Local Sparsity

When the available hardware cannot meet the memory and compute requirements to efficiently train high performing machine learning models, a compromise in either the training quality or the model complexity is needed. In Federated Learning (FL), nodes are orders of magnitude more constrained than traditional server-grade hardware and are often battery powered, severely limiting the sophistication of models that can be trained under this paradigm. While most research has focused on designing better aggregation strategies to improve convergence rates and in alleviating the communication costs of FL, fewer efforts have been devoted to accelerating on-device training. Such stage, which repeats hundreds of times (i.e. every round) and can involve thousands of devices, accounts for the majority of the time required to train federated models and, the totality of the energy consumption at the client side. In this work, we present the first study on the unique aspects that arise when introducing sparsity at training time in FL workloads. We then propose ZeroFL, a framework that relies on highly sparse operations to accelerate on-device training. Models trained with ZeroFL and 95% sparsity achieve up to 2.3% higher accuracy compared to competitive baselines obtained from adapting a state-of-the-art sparse training framework to the FL setting.Comment: Published as a conference paper at ICLR 202

Expression profiling on soybean leaves reveals integration of ER- and osmotic-stress pathways

Despite the potential of the endoplasmic reticulum (ER) stress response to accommodate adaptive pathways, its integration with other environmental-induced responses is poorly understood in plants. We have previously demonstrated that the ER-stress sensor binding protein (BiP) from soybean exhibits an unusual response to drought. The members of the soybean BiP gene family are differentially regulated by osmotic stress and soybean BiP confers tolerance to drought. While these results may reflect crosstalk between the osmotic and ER-stress signaling pathways, the lack of mutants, transcriptional response profiles to stresses and genome sequence information of this relevant crop has limited our attempts to identify integrated networks between osmotic and ER stress-induced adaptive responses. As a fundamental step towards this goal, we performed global expression profiling on soybean leaves exposed to polyethylene glycol treatment (osmotic stress) or to ER stress inducers. The up-regulated stress-specific changes unmasked the major branches of the ER-stress response, which include enhancing protein folding and degradation in the ER, as well as specific osmotically regulated changes linked to cellular responses induced by dehydration. However, a small proportion (5.5%) of total up-regulated genes represented a shared response that seemed to integrate the two signaling pathways. These co-regulated genes were considered downstream targets based on similar induction kinetics and a synergistic response to the combination of osmotic- and ER-stress-inducing treatments. Genes in this integrated pathway with the strongest synergistic induction encoded proteins with diverse roles, such as plant-specific development and cell death (DCD) domain-containing proteins, an ubiquitin-associated (UBA) protein homolog and NAC domain-containing proteins. This integrated pathway diverged further from characterized specific branches of ER-stress as downstream targets were inversely regulated by osmotic stress. The present ER-stress- and osmotic-stress-induced transcriptional studies demonstrate a clear predominance of stimulus-specific positive changes over shared responses on soybean leaves. This scenario indicates that polyethylene glycol (PEG)-induced cellular dehydration and ER stress elicited very different up-regulated responses within a 10-h stress treatment regime. In addition to identifying ER-stress and osmotic-stress-specific responses in soybean (Glycine max), our global expression-profiling analyses provided a list of candidate regulatory components, which may integrate the osmotic-stress and ER-stress signaling pathways in plants

The NAC domain-containing protein, GmNAC6, is a downstream component of the ER stress- and osmotic stress-induced NRP-mediated cell-death signaling pathway

<p>Abstract</p> <p>Background</p> <p>The endoplasmic reticulum (ER) is a major signaling organelle, which integrates a variety of responses against physiological stresses. In plants, one such stress-integrating response is the N-rich protein (NRP)-mediated cell death signaling pathway, which is synergistically activated by combined ER stress and osmotic stress signals. Despite the potential of this integrated signaling to protect plant cells against different stress conditions, mechanistic knowledge of the pathway is lacking, and downstream components have yet to be identified.</p> <p>Results</p> <p>In the present investigation, we discovered an NAC domain-containing protein from soybean, GmNAC6 (<it>Glycine max </it>NAC6), to be a downstream component of the integrated pathway. Similar to <it>NRP-A </it>and <it>NRP-B, GmNAC6 </it>is induced by ER stress and osmotic stress individually, but requires both signals for full activation. Transient expression of <it>GmNAC6 </it>promoted cell death and hypersensitive-like responses <it>in planta</it>. <it>GmNAC6 </it>and <it>NRPs </it>also share overlapping responses to biotic signals, but the induction of <it>NRPs </it>peaked before the increased accumulation of GmNAC6 transcripts. Consistent with the delayed kinetics of <it>GmNAC6 </it>induction, increased levels of <it>NRP-A </it>and <it>NRP-B </it>transcripts induced promoter activation and the expression of the <it>GmNAC6 </it>gene.</p> <p>Conclusions</p> <p>Collectively, our results biochemically link GmNAC6 to the ER stress- and osmotic stress-integrating cell death response and show that GmNAC6 may act downstream of the NRPs.</p

Functional abilities of cultivable plant growth promoting bacteria associated with wheat (Triticum aestivum L.) crops

Abstract In the pursuit of sustainable agriculture, bioinoculants usage as providers of a crop's needs is a method to limit environmental damage. In this study, a collection of cultivable putative plant growth promoting (PGP) bacteria associated with wheat crops was obtained and this bacterial sample was characterized in relation to the functional diversity of certain PGP features. The isolates were obtained through classical cultivation methods, identified by partial 16S rRNA gene sequencing and characterized for PGP traits of interest. Functional diversity characterization was performed using Categorical Principal Component Analysis (CatPCA) and Multiple Correspondence Analysis (MCA). The most abundant genera found among the 346 isolates were Pseudomonas, Burkholderia, and Enterobacter. Occurrence of PGP traits was affected by genus, niche, and sampling site. A large number of genera grouped together with the ability to produce indolic compounds; phosphate solubilization and siderophores production formed a second group related to fewer genera, in which the genus Burkholderia has a great importance. The results obtained may help future studies aiming prospection of putative plant growth promoting bacteria regarding the desired organism and PGP trait

Chronic Losartan Administration Reduces Mortality and Preserves Cardiac but Not Skeletal Muscle Function in Dystrophic Mice

Duchenne muscular dystrophy (DMD) is a degenerative disorder affecting skeletal and cardiac muscle for which there is no effective therapy. Angiotension receptor blockade (ARB) has excellent therapeutic potential in DMD based on recent data demonstrating attenuation of skeletal muscle disease progression during 6–9 months of therapy in the mdx mouse model of DMD. Since cardiac-related death is major cause of mortality in DMD, it is important to evaluate the effect of any novel treatment on the heart. Therefore, we evaluated the long-term impact of ARB on both the skeletal muscle and cardiac phenotype of the mdx mouse. Mdx mice received either losartan (0.6 g/L) (n = 8) or standard drinking water (n = 9) for two years, after which echocardiography was performed to assess cardiac function. Skeletal muscle weight, morphology, and function were assessed. Fibrosis was evaluated in the diaphragm and heart by Trichrome stain and by determination of tissue hydroxyproline content. By the study endpoint, 88% of treated mice were alive compared to only 44% of untreated (p = 0.05). No difference in skeletal muscle morphology, function, or fibrosis was noted in losartan-treated animals. Cardiac function was significantly preserved with losartan treatment, with a trend towards reduction in cardiac fibrosis. We saw no impact on the skeletal muscle disease progression, suggesting that other pathways that trigger fibrosis dominate over angiotensin II in skeletal muscle long term, unlike the situation in the heart. Our study suggests that ARB may be an important prophylactic treatment for DMD-associated cardiomyopathy, but will not impact skeletal muscle disease

Measurement of the production of a W boson in association with a charm quark in pp collisions at √s = 7 TeV with the ATLAS detector

The production of a W boson in association with a single charm quark is studied using 4.6 fb−1 of pp collision data at s√ = 7 TeV collected with the ATLAS detector at the Large Hadron Collider. In events in which a W boson decays to an electron or muon, the charm quark is tagged either by its semileptonic decay to a muon or by the presence of a charmed meson. The integrated and differential cross sections as a function of the pseudorapidity of the lepton from the W-boson decay are measured. Results are compared to the predictions of next-to-leading-order QCD calculations obtained from various parton distribution function parameterisations. The ratio of the strange-to-down sea-quark distributions is determined to be 0.96+0.26−0.30 at Q 2 = 1.9 GeV2, which supports the hypothesis of an SU(3)-symmetric composition of the light-quark sea. Additionally, the cross-section ratio σ(W + +c¯¯)/σ(W − + c) is compared to the predictions obtained using parton distribution function parameterisations with different assumptions about the s−s¯¯¯ quark asymmetry

Search for new phenomena in final states with an energetic jet and large missing transverse momentum in pp collisions at √ s = 8 TeV with the ATLAS detector

Results of a search for new phenomena in final states with an energetic jet and large missing transverse momentum are reported. The search uses 20.3 fb−1 of √ s = 8 TeV data collected in 2012 with the ATLAS detector at the LHC. Events are required to have at least one jet with pT > 120 GeV and no leptons. Nine signal regions are considered with increasing missing transverse momentum requirements between Emiss T > 150 GeV and Emiss T > 700 GeV. Good agreement is observed between the number of events in data and Standard Model expectations. The results are translated into exclusion limits on models with either large extra spatial dimensions, pair production of weakly interacting dark matter candidates, or production of very light gravitinos in a gauge-mediated supersymmetric model. In addition, limits on the production of an invisibly decaying Higgs-like boson leading to similar topologies in the final state are presente

Measurement of the cross-section of high transverse momentum vector bosons reconstructed as single jets and studies of jet substructure in pp collisions at √s = 7 TeV with the ATLAS detector

This paper presents a measurement of the cross-section for high transverse momentum W and Z bosons produced in pp collisions and decaying to all-hadronic final states. The data used in the analysis were recorded by the ATLAS detector at the CERN Large Hadron Collider at a centre-of-mass energy of √s = 7 TeV;{\rm Te}{\rm V}$and correspond to an integrated luminosity of$4.6\;{\rm f}{{{\rm b}}^{-1}}$. The measurement is performed by reconstructing the boosted W or Z bosons in single jets. The reconstructed jet mass is used to identify the W and Z bosons, and a jet substructure method based on energy cluster information in the jet centre-of-mass frame is used to suppress the large multi-jet background. The cross-section for events with a hadronically decaying W or Z boson, with transverse momentum${{p}_{{\rm T}}}\gt 320\;{\rm Ge}{\rm V}$and pseudorapidity$|\eta |\lt 1.9$, is measured to be${{\sigma }_{W+Z}}=8.5\pm 1.7$ pb and is compared to next-to-leading-order calculations. The selected events are further used to study jet grooming techniques

Search for direct pair production of the top squark in all-hadronic final states in proton-proton collisions at s√=8 TeV with the ATLAS detector

The results of a search for direct pair production of the scalar partner to the top quark using an integrated luminosity of 20.1fb−1 of proton–proton collision data at √s = 8 TeV recorded with the ATLAS detector at the LHC are reported. The top squark is assumed to decay via t˜→tχ˜01 or t˜→ bχ˜±1 →bW(∗)χ˜01 , where χ˜01 (χ˜±1 ) denotes the lightest neutralino (chargino) in supersymmetric models. The search targets a fully-hadronic final state in events with four or more jets and large missing transverse momentum. No significant excess over the Standard Model background prediction is observed, and exclusion limits are reported in terms of the top squark and neutralino masses and as a function of the branching fraction of t˜ → tχ˜01 . For a branching fraction of 100%, top squark masses in the range 270–645 GeV are excluded for χ˜01 masses below 30 GeV. For a branching fraction of 50% to either t˜ → tχ˜01 or t˜ → bχ˜±1 , and assuming the χ˜±1 mass to be twice the χ˜01 mass, top squark masses in the range 250–550 GeV are excluded for χ˜01 masses below 60 GeV