Federated Learning with Communication Delay in Edge Networks

Federated learning has received significant attention as a potential solution for distributing machine learning (ML) model training through edge networks. This work addresses an important consideration of federated learning at the network edge: communication delays between the edge nodes and the aggregator. A technique called FedDelAvg (federated delayed averaging) is developed, which generalizes the standard federated averaging algorithm to incorporate a weighting between the current local model and the delayed global model received at each device during the synchronization step. Through theoretical analysis, an upper bound is derived on the global model loss achieved by FedDelAvg, which reveals a strong dependency of learning performance on the values of the weighting and learning rate. Experimental results on a popular ML task indicate significant improvements in terms of convergence speed when optimizing the weighting scheme to account for delays.Comment: Accepted for publication at IEEE Global Communications Conference (Globecom 2020

Delay-Aware Hierarchical Federated Learning

Federated learning has gained popularity as a means of training models distributed across the wireless edge. The paper introduces delay-aware hierarchical federated learning (DFL) to improve the efficiency of distributed machine learning (ML) model training by accounting for communication delays between edge and cloud. Different from traditional federated learning, DFL leverages multiple stochastic gradient descent iterations on local datasets within each global aggregation period and intermittently aggregates model parameters through edge servers in local subnetworks. During global synchronization, the cloud server consolidates local models with the outdated global model using a local-global combiner, thus preserving crucial elements of both, enhancing learning efficiency under the presence of delay. A set of conditions is obtained to achieve the sub-linear convergence rate of O(1/k) for strongly convex and smooth loss functions. Based on these findings, an adaptive control algorithm is developed for DFL, implementing policies to mitigate energy consumption and communication latency while aiming for sublinear convergence. Numerical evaluations show DFL's superior performance in terms of faster global model convergence, reduced resource consumption, and robustness against communication delays compared to existing FL algorithms. In summary, this proposed method offers improved efficiency and results when dealing with both convex and non-convex loss functions.Comment: A condensed version of this paper was presented at IEEE Globecom 202

Long-term administration of olanzapine induces adiposity and increases hepatic fatty acid desaturation protein in female C57BL/6J mice

Objective(s): Weight gain and metabolic disturbances such as dyslipidemia, are frequent side effects of second-generation antipsychotics, including olanzapine. This study examined the metabolic effects of chronic olanzapine exposure. In addition, we investigated the hepatic fatty acid effects of olanzapine in female C57BL/6J mice fed a normal diet.Materials and Methods: Female C57BL/6J mice orally received olanzapine or normal saline for 7 weeks. The effects of long-term olanzapine exposure on body weight changes, food efficiency, blood glucose, triglyceride (TG), insulin, and leptin levels were observed. Hepatic TG and abdominal fat mass were investigated, and fat cell morphology was analyzed through histopathological methods. The levels of protein markers of fatty acid regulation in the liver, namely fatty acid synthase (FAS) and stearoyl-CoA desaturase-1 (SCD-1), were measured.Results: Olanzapine treatment increased the food intake of the mice as well as their body weight. Biochemical analyses showed that olanzapine increased blood TG, insulin, leptin, and hepatic TG. The olanzapine group exhibited increased abdominal fat mass and fat cell enlargement in abdominal fat tissue. Western blotting of the mouse liver revealed significantly higher (1.6-fold) levels of SCD-1 in the olanzapine group relative to the control group; by contrast, FAS levels in the two groups did not differ significantly.Conclusion: Enhanced lipogenesis triggered by increased hepatic SCD-1 activity might be a probable peripheral mechanism of olanzapine-induced dyslipidemia. Some adverse metabolic effects of olanzapine may be related to the disturbance of lipid homeostasis in the liver

New insights into ion regulation of cephalopod molluscs: a role of epidermal ionocytes in acid-base regulation during embryogenesis

The constraints of an active life in a pelagic habitat led to numerous convergent morphological and physiological adaptations that enable cephalopod molluscs and teleost fishes to compete for similar resources. Here we show for the first time that such convergent developments are also found in the ontogenetic progression of ion regulatory tissues: as in teleost fish epidermal ionocytes scattered on skin and yolk sac of cephalopod embryos appear to be responsible for ionic and acid-base regulation before gill epithelia become functional. Ion and acid-base regulation is crucial in cephalopod embryos, as they are surrounded by a hypercapnic egg fluid with a pCO2 of 0.2-0.4 kPa. Epidermal ionocytes were characterized via immunohistochemistry, in situ hybridization and vital dye staining techniques. We found one group of cells that is recognized by Concavalin A and MitoTracker, which also expresses Na+/H+ exchangers (NHE) and Na+/K+-ATPase. Similar to findings obtained in teleosts these NHE3-rich cells take up sodium in exchange for protons, illustrating the energetic superiority of NHE based proton excretion in marine systems. In vivo electrophysiological techniques demonstrated that acid equivalents are secreted by the yolk and skin integument. Intriguingly, epidermal ionocytes of cephalopod embryos are ciliated as demonstrated by scanning electron microscopy suggesting a dual function of epithelial cells in water convection and ion regulation. These findings add significant knowledge to our mechanistic understanding of hypercapnia tolerance in marine organisms, as it demonstrates that marine taxa which were identified as powerful acid-base regulators during hypercapnic challenges already exhibit strong acid-base regulatory abilities during embryogenesis

Computational Bacterial Genome-Wide Analysis of Phylogenetic Profiles Reveals Potential Virulence Genes of Streptococcus agalactiae

The phylogenetic profile of a gene is a reflection of its evolutionary history and can be defined as the differential presence or absence of a gene in a set of reference genomes. It has been employed to facilitate the prediction of gene functions. However, the hypothesis that the application of this concept can also facilitate the discovery of bacterial virulence factors has not been fully examined. In this paper, we test this hypothesis and report a computational pipeline designed to identify previously unknown bacterial virulence genes using group B streptococcus (GBS) as an example. Phylogenetic profiles of all GBS genes across 467 bacterial reference genomes were determined by candidate-against-all BLAST searches,which were then used to identify candidate virulence genes by machine learning models. Evaluation experiments with known GBS virulence genes suggested good functional and model consistency in cross-validation analyses (areas under ROC curve, 0.80 and 0.98 respectively). Inspection of the top-10 genes in each of the 15 virulence functional groups revealed at least 15 (of 119) homologous genes implicated in virulence in other human pathogens but previously unrecognized as potential virulence genes in GBS. Among these highly-ranked genes, many encode hypothetical proteins with possible roles in GBS virulence. Thus, our approach has led to the identification of a set of genes potentially affecting the virulence potential of GBS, which are potential candidates for further in vitro and in vivo investigations. This computational pipeline can also be extended to in silico analysis of virulence determinants of other bacterial pathogens

Measurement of the Bottom-Strange Meson Mixing Phase in the Full CDF Data Set

We report a measurement of the bottom-strange meson mixing phase \beta_s using the time evolution of B0_s -> J/\psi (->\mu+\mu-) \phi (-> K+ K-) decays in which the quark-flavor content of the bottom-strange meson is identified at production. This measurement uses the full data set of proton-antiproton collisions at sqrt(s)= 1.96 TeV collected by the Collider Detector experiment at the Fermilab Tevatron, corresponding to 9.6 fb-1 of integrated luminosity. We report confidence regions in the two-dimensional space of \beta_s and the B0_s decay-width difference \Delta\Gamma_s, and measure \beta_s in [-\pi/2, -1.51] U [-0.06, 0.30] U [1.26, \pi/2] at the 68% confidence level, in agreement with the standard model expectation. Assuming the standard model value of \beta_s, we also determine \Delta\Gamma_s = 0.068 +- 0.026 (stat) +- 0.009 (syst) ps-1 and the mean B0_s lifetime, \tau_s = 1.528 +- 0.019 (stat) +- 0.009 (syst) ps, which are consistent and competitive with determinations by other experiments.Comment: 8 pages, 2 figures, Phys. Rev. Lett 109, 171802 (2012

Jet energy measurement with the ATLAS detector in proton-proton collisions at root s=7 TeV

The jet energy scale and its systematic uncertainty are determined for jets measured with the ATLAS detector at the LHC in proton-proton collision data at a centre-of-mass energy of √s = 7TeV corresponding to an integrated luminosity of 38 pb-1. Jets are reconstructed with the anti-kt algorithm with distance parameters R=0. 4 or R=0. 6. Jet energy and angle corrections are determined from Monte Carlo simulations to calibrate jets with transverse momenta pT≥20 GeV and pseudorapidities {pipe}η{pipe}<4. 5. The jet energy systematic uncertainty is estimated using the single isolated hadron response measured in situ and in test-beams, exploiting the transverse momentum balance between central and forward jets in events with dijet topologies and studying systematic variations in Monte Carlo simulations. The jet energy uncertainty is less than 2. 5 % in the central calorimeter region ({pipe}η{pipe}<0. 8) for jets with 60≤pT<800 GeV, and is maximally 14 % for pT<30 GeV in the most forward region 3. 2≤{pipe}η{pipe}<4. 5. The jet energy is validated for jet transverse momenta up to 1 TeV to the level of a few percent using several in situ techniques by comparing a well-known reference such as the recoiling photon pT, the sum of the transverse momenta of tracks associated to the jet, or a system of low-pT jets recoiling against a high-pT jet. More sophisticated jet calibration schemes are presented based on calorimeter cell energy density weighting or hadronic properties of jets, aiming for an improved jet energy resolution and a reduced flavour dependence of the jet response. The systematic uncertainty of the jet energy determined from a combination of in situ techniques is consistent with the one derived from single hadron response measurements over a wide kinematic range. The nominal corrections and uncertainties are derived for isolated jets in an inclusive sample of high-pT jets. Special cases such as event topologies with close-by jets, or selections of samples with an enhanced content of jets originating from light quarks, heavy quarks or gluons are also discussed and the corresponding uncertainties are determined. © 2013 CERN for the benefit of the ATLAS collaboration

Measurement of the inclusive and dijet cross-sections of b-jets in pp collisions at sqrt(s) = 7 TeV with the ATLAS detector

The inclusive and dijet production cross-sections have been measured for jets containing b-hadrons (b-jets) in proton-proton collisions at a centre-of-mass energy of sqrt(s) = 7 TeV, using the ATLAS detector at the LHC. The measurements use data corresponding to an integrated luminosity of 34 pb^-1. The b-jets are identified using either a lifetime-based method, where secondary decay vertices of b-hadrons in jets are reconstructed using information from the tracking detectors, or a muon-based method where the presence of a muon is used to identify semileptonic decays of b-hadrons inside jets. The inclusive b-jet cross-section is measured as a function of transverse momentum in the range 20 < pT < 400 GeV and rapidity in the range |y| < 2.1. The bbbar-dijet cross-section is measured as a function of the dijet invariant mass in the range 110 < m_jj < 760 GeV, the azimuthal angle difference between the two jets and the angular variable chi in two dijet mass regions. The results are compared with next-to-leading-order QCD predictions. Good agreement is observed between the measured cross-sections and the predictions obtained using POWHEG + Pythia. MC@NLO + Herwig shows good agreement with the measured bbbar-dijet cross-section. However, it does not reproduce the measured inclusive cross-section well, particularly for central b-jets with large transverse momenta.Comment: 10 pages plus author list (21 pages total), 8 figures, 1 table, final version published in European Physical Journal