The Gradient Convergence Bound of Federated Multi-Agent Reinforcement Learning with Efficient Communication

The paper considers a distributed version of deep reinforcement learning (DRL) for multi-agent decision-making process in the paradigm of federated learning. Since the deep neural network models in federated learning are trained locally and aggregated iteratively through a central server, frequent information exchange incurs a large amount of communication overheads. Besides, due to the heterogeneity of agents, Markov state transition trajectories from different agents are usually unsynchronized within the same time interval, which will further influence the convergence bound of the aggregated deep neural network models. Therefore, it is of vital importance to reasonably evaluate the effectiveness of different optimization methods. Accordingly, this paper proposes a utility function to consider the balance between reducing communication overheads and improving convergence performance. Meanwhile, this paper develops two new optimization methods on top of variation-aware periodic averaging methods: 1) the decay-based method which gradually decreases the weight of the model's local gradients within the progress of local updating, and 2) the consensus-based method which introduces the consensus algorithm into federated learning for the exchange of the model's local gradients. This paper also provides novel convergence guarantees for both developed methods and demonstrates their effectiveness and efficiency through theoretical analysis and numerical simulation results

Risk factors and prediction model of sleep disturbance in patients with maintenance hemodialysis: A single center study

ObjectivesThis study aimed to explore the risk factors and develop a prediction model of sleep disturbance in maintenance hemodialysis (MHD) patients.MethodsIn this study, 193 MHD patients were enrolled and sleep quality was assessed by Pittsburgh Sleep Quality Index. Binary logistic regression analysis was used to explore the risk factors for sleep disturbance in MHD patients, including demographic, clinical and laboratory parameters, and that a prediction model was developed on the basis of risk factors by two-way stepwise regression. The final prediction model is displayed by nomogram and verified internally by bootstrap resampling procedure.ResultsThe prevalence of sleep disturbance and severe sleep disturbance in MHD patients was 63.73 and 26.42%, respectively. Independent risk factors for sleep disturbance in MHD patients included higher 0.1*age (OR = 1.476, 95% CI: 1.103–1.975, P = 0.009), lower albumin (OR = 0.863, 95% CI: 0.771–0.965, P = 0.010), and lower 10*calcium levels (OR = 0.747, 95% CI: 0.615–0.907, P = 0.003). In addition, higher 0.1*age, lower albumin levels, and anxiety were independently associated with severe sleep disturbance in MHD patients. A risk prediction model of sleep disturbance in MHD patients showed that the concordance index after calibration is 0.736, and the calibration curve is approximately distributed along the reference line.ConclusionsOlder age, lower albumin and calcium levels are higher risk factors of sleep disturbance in MHD, and the prediction model for the assessment of sleep disturbance in MHD patients has excellent discrimination and calibration

A Novel Chemosynthetic Peptide with β-Sheet Motif Efficiently Kills Klebsiella pnuemoniae in a Mouse Model

Klebsiella pneumoniae (Kp) is one of the most common pathogens in nosocomial infections and is increasingly becoming multiple drug resistant. However, the molecular pathogenesis of Kp in causing tissue injury and dysregulated host defense remains elusive, further dampening the development of novel therapeutic measures. We have previously screened a series of synthetic antimicrobial beta-sheet forming peptides and identified a peptide (IRIKIRIK; ie, IK8L) with a broad range of bactericidal activity and low cytotoxicity in vitro. Here, employing an animal model, we investigated the antibacterial effects of IK8L in acute infection and demonstrated that peritoneal injection of IK8L to mice down-regulated inflammatory cytokines, alleviated lung injury, and importantly, decreased mortality compared to sham-injected controls. In addition, a math model was used to evaluate in vivo imaging data and predict infection progression in infected live animals. Mechanistically, IK8L can kill Kp by inhibiting biofilm formation and modulating production of inflammatory cytokines through the STAT3/JAK signaling both in vitro and in vivo. Collectively, these findings reveal that IK8L may have potential for preventing or treating Kp infection

Chitin Oligosaccharide (COS) Reduces Antibiotics Dose and Prevents Antibiotics-Caused Side Effects in Adolescent Idiopathic Scoliosis (AIS) Patients with Spinal Fusion Surgery

Antibiotics are always considered for surgical site infection (SSI) in adolescent idiopathic scoliosis (AIS) surgery. However, the use of antibiotics often causes the antibiotic resistance of pathogens and side effects. Thus, it is necessary to explore natural products as drug candidates. Chitin Oligosaccharide (COS) has anti-inflammation and anti-bacteria functions. The effects of COS on surgical infection in AIS surgery were investigated. A total of 312 AIS patients were evenly and randomly assigned into control group (CG, each patient took one-gram alternative Azithromycin/Erythromycin/Cloxacillin/Aztreonam/Ceftazidime or combined daily), experiment group (EG, each patient took 20 mg COS and half-dose antibiotics daily), and placebo group (PG, each patient took 20 mg placebo and half-dose antibiotics daily). The average follow-up was one month, and infection severity and side effects were analyzed. The effects of COS on isolated pathogens were analyzed. SSI rates were 2%, 3% and 8% for spine wounds and 1%, 2% and 7% for iliac wound in CG, EG and PG (p < 0.05), respectively. COS reduces the side effects caused by antibiotics (p < 0.05). COS improved biochemical indexes and reduced the levels of interleukin (IL)-6 and tumor necrosis factor (TNF) alpha. COS reduced the antibiotics dose and antibiotics-caused side effects in AIS patients with spinal fusion surgery by improving antioxidant and anti-inflammatory activities. COS should be developed as potential adjuvant for antibiotics therapies

RNA-Seq and iTRAQ reveal multiple pathways involved in storage root formation and development in sweet potato (Ipomoea batatas L.)

Abstract Background Sweet potato (Ipomoea batatas L.) is the sixth most important food crop in the world. The formation and development of storage roots in sweet potato is a highly complicated and genetically programmed process. However, the underlying mechanisms of storage root development have not yet been elucidated. Results To better understand the molecular mechanisms involved in storage root development, a combined analysis of the transcriptome and proteome of sweet potato fibrous roots (F) and storage roots at four different stages (D1, D3, D5 and D10) was performed in the present study. A total of 26,273 differentially expressed genes were identified in a comparison between the fibrous root library and four storage root libraries, while 2558 proteins showed a 1.0-fold or greater expression difference as indicated by isobaric tags for relative and absolute quantitation (iTRAQ) analysis. The combination of the transcriptome and proteome analyses and morphological and physiological data revealed several critical pathways involved in storage root formation and development. First, genes/proteins involved in the development of meristems/cambia and starch biosynthesis were all significantly upregulated in storage roots compared with fibrous roots. Second, multiple phytohormones and the genes related to their biosynthesis showed differential expression between fibrous roots and storage roots. Third, a large number of transcription factors were differentially expressed during storage root initiation and development, which suggests the importance of transcription factor regulation in the development of storage roots. Fourth, inconsistent gene expression was found between the transcriptome and proteome data, which indicated posttranscriptional regulatory activity during the development of storage roots. Conclusion Overall, these results reveal multiple events associated with storage root development and provide new insights into the molecular mechanisms underlying the regulatory networks involved in storage root development

Cloning and expression analysis of <i>BmYki</i> gene in silkworm, <i>Bombyx mori</i>

<div><p>The transcriptional coactivator Yorkie(Yki), is a critical downstream effector of the Hippo(Hpo) signaling pathway that controls organ size through the regulation of cell proliferation and apoptosis. During the past ten years the biological function of Yki has been studied extensively in <i>Drosophila</i> and a few other insects, however, little is known about it in the silkworm, <i>Bombyx mori</i>, a major research model of lepidopteran insect. Here, we describe the isolation, characterization and expression of the <i>B</i>. <i>mori</i> Yki ortholog, BmYki. The coding sequence of the <i>BmYki</i> was 1314 bp in length, encoding a protein of 437 amino acids containing two conserved WW domains. <i>BmYki</i> transcripts were ubiquitous but not abundant in all detected tissues and developmental stages. Comparatively, it was expressed at pretty high level in silk glands and at the stage of fifth-instar day-3 larvae. Overexpression of <i>BmYki</i> in cultured <i>B</i>. <i>mori</i> embryonic cells significantly promoted transcription of genes associated with cell proliferation and apoptosis, indicating that <i>BmYki</i> functions in the regulation of organ growth-related biological processes. Interestingly, transcription of silk protein-coding genes and transcription factors regulating the synthesis of silk proteins was downregulated remarkably, suggesting that <i>BmYki</i> was involved in the regulation of silk protein synthesis. This study provides new insights into the role of <i>BmYki</i> in Hpo pathway regulation in silkworm.</p></div