FedDD: Toward Communication-efficient Federated Learning with Differential Parameter Dropout

Federated Learning (FL) requires frequent exchange of model parameters, which leads to long communication delay, especially when the network environments of clients vary greatly. Moreover, the parameter server needs to wait for the slowest client (i.e., straggler, which may have the largest model size, lowest computing capability or worst network condition) to upload parameters, which may significantly degrade the communication efficiency. Commonly-used client selection methods such as partial client selection would lead to the waste of computing resources and weaken the generalization of the global model. To tackle this problem, along a different line, in this paper, we advocate the approach of model parameter dropout instead of client selection, and accordingly propose a novel framework of Federated learning scheme with Differential parameter Dropout (FedDD). FedDD consists of two key modules: dropout rate allocation and uploaded parameter selection, which will optimize the model parameter uploading ratios tailored to different clients' heterogeneous conditions and also select the proper set of important model parameters for uploading subject to clients' dropout rate constraints. Specifically, the dropout rate allocation is formulated as a convex optimization problem, taking system heterogeneity, data heterogeneity, and model heterogeneity among clients into consideration. The uploaded parameter selection strategy prioritizes on eliciting important parameters for uploading to speedup convergence. Furthermore, we theoretically analyze the convergence of the proposed FedDD scheme. Extensive performance evaluations demonstrate that the proposed FedDD scheme can achieve outstanding performances in both communication efficiency and model convergence, and also possesses a strong generalization capability to data of rare classes

Relationship between four tumor-associated bio-markers and prognosis of gastric cancer

Purpose: To investigate the relationship between prognosis of gastric cancer (GC) and the expression of P53, Epidermal growth factor receptor (EGFR), Human epidermal growth factor receptor-2 (HER-2), and Vascular endothelial growth factor (VEGF).Methods: One hundred and forty-seven patients admitted to People's Liberation Army General Hospital (Beijing, China) with diagnosis of locally advanced GC were enrolled in the study. Follow-up data were obtained by outpatient review or telephone follow-up. Expressions of P53, EGFR, HER-2 and VEGF were determined by immunohistochemical staining. The relationship between protein expression, clinico-pathological factors, disease-free survival time (DFS) and overall survival (OS) were analyzed.Results: The expressions of EGER, HER-2, P53 and VEGF in GC were 17.7, 17.0, 41.0 and 55.9%, respectively. The expressions of EGFR and P53 were positively correlated (r = 0.306, p < 0.05), while the expressions of VEGF and HER-2 were negatively correlated (r = -0.2, p < 0.05). The expressions of EGFR, HER-2 and VEGF were not related to the clinico-pathological factors (p > 0.05) while expression of P53 was related only to histological grade (p < 0.05). Univariate analysis showed that OS and DFS were longer (p < 0.05) when P53 was lowly expressed. Multiple-factor analysis revealed that histological grade, infiltration depth and P53 expression were independent factors that influenced DFS.Conclusion: These results indicate that the expression of P53, EGFR, HER2 and VEGF can be used to predict prognosis of GC and screening of patients’ benefits from adjuvant chemotherapy.Keywords: Gastric cancer, Prognosis, Biomarkers, Adjuvant chemotherap

护理学生临床实习前锐器伤预防的认知情况调查研究

Objective: To investigate the cognition of sharp injury prevention among nursing students before the clinical practice in order to provide a basis for corresponding measures and active measures. Methods: In July 2014, a total of 232 nursing students in 3 A grade Hospital of Guangzhou, from 30 colleges and universities of 8 provinces, were tested by self-made questionnaire in regard to sharp injury prevention knowledge. Results: The awareness rate of occupational exposure, occupational exposure prevention, Guideline for prevention and control for occupational exposure to bloodborne pathogen by National Health and Family Planning Commission 2009 was 28.94% and 13.71%, 1.01%; and the highest score of sharp instrument injury prevention knowledge was 22 points, the lowest score was 4 points, with an average of 15.92 ± 2.59 points. Sharp injury knowledge gained from school education accounts for 87.31%, but the students who have not received relevant education accounts for 3.05%. Conclusion: The overall situation of occupational exposures cognition is not optimistic, the master of sharp instrument injury prevention knowledge is not complete; and related curriculum in part of the schools is unreasonable, or receives poor effect. Some schools need to adjust the curriculum, strengthen the prevention knowledge of sharp injuries, occupational exposure to bloodborne pathogen. Hospitals need to strengthen pre-job training of nursing students and strengthen the clinical teaching work. Schools and hospitals need to jointly explore teaching mode for nursing students, so as to promote the students to master the sharp instrument injury prevention knowledge, the implementation of relevant measures of protection, and ensure the safety of students and patients. 目的  对护理学生临床实习前锐器伤预防的认知情况进行了解，以便为采取积极有效的应对措施提供依据。方法  采用自行编制问卷对2014年7月广州市某三甲医院来自全国8省30所高等院校的232名护理实习学生的一般资料和锐器伤认知情况进行调查并分析。结果  职业暴露、职业暴露后预防、国家卫计委2009《血源性病原体职业接触防护导则》知晓率为28.94%、13.71%、1.01%；锐器伤预防知识最高得分22分，最低得分4分，均数为（15.92±2.59）分。锐器伤知识来源于学校教育为87.31%，而未接受过相关教育者为3.05%。结论  研究对象对职业暴露认知总体情况不容乐观；锐器伤预防知识掌握不全；部分学校相关课程设置不合理或教育效果欠佳。部分学校需调整课程设置，加强锐器伤预防、血源性病原体职业接触防护等相关知识的教育，医院需强化护理实习生岗前培训，加强临床带教工作，学校与医院需探讨共同教导护理实习学生模式，从而促进学生掌握锐器伤预防相关知识，落实相关防护措施，保障患者和学生的安全

General-Purpose Multi-Modal OOD Detection Framework

Out-of-distribution (OOD) detection identifies test samples that differ from the training data, which is critical to ensuring the safety and reliability of machine learning (ML) systems. While a plethora of methods have been developed to detect uni-modal OOD samples, only a few have focused on multi-modal OOD detection. Current contrastive learning-based methods primarily study multi-modal OOD detection in a scenario where both a given image and its corresponding textual description come from a new domain. However, real-world deployments of ML systems may face more anomaly scenarios caused by multiple factors like sensor faults, bad weather, and environmental changes. Hence, the goal of this work is to simultaneously detect from multiple different OOD scenarios in a fine-grained manner. To reach this goal, we propose a general-purpose weakly-supervised OOD detection framework, called WOOD, that combines a binary classifier and a contrastive learning component to reap the benefits of both. In order to better distinguish the latent representations of in-distribution (ID) and OOD samples, we adopt the Hinge loss to constrain their similarity. Furthermore, we develop a new scoring metric to integrate the prediction results from both the binary classifier and contrastive learning for identifying OOD samples. We evaluate the proposed WOOD model on multiple real-world datasets, and the experimental results demonstrate that the WOOD model outperforms the state-of-the-art methods for multi-modal OOD detection. Importantly, our approach is able to achieve high accuracy in OOD detection in three different OOD scenarios simultaneously. The source code will be made publicly available upon publication

Production of copolyesters of 3-hydroxybutyrate and medium-chain-length 3-hydroxyalkanoates by E. coli containing an optimized PHA synthase gene

BACKGROUND: Microbial polyhydroxyalkanoates (PHA) are biopolyesters consisting of diverse monomers. PHA synthase PhaC2(Ps) cloned from Pseudomonas stutzeri 1317 is able to polymerize short-chain-length (scl) 3-hydroxybutyrate (3HB) monomers and medium-chain-length (mcl) 3-hydroxyalkanoates (3HA) with carbon chain lengths ranging from C6 to C12. However, the scl and mcl PHA production in Escherichia coli expressing PhaC2(Ps) is limited with very low PHA yield. RESULTS: To improve the production of PHA with a wide range of monomer compositions in E. coli, a series of optimization strategies were applied on the PHA synthase PhaC2(Ps). Codon optimization of the gene and mRNA stabilization with a hairpin structure were conducted and the function of the optimized PHA synthase was tested in E. coli. The transcript was more stable after the hairpin structure was introduced, and western blot analysis showed that both codon optimization and hairpin introduction increased the protein expression level. Compared with the wild type PhaC2(Ps), the optimized PhaC2(Ps) increased poly-3-hydroxybutyrate (PHB) production by approximately 16-fold to 30% of the cell dry weight. When grown on dodecanoate, the recombinant E. coli harboring the optimized gene phaC2(Ps)O with a hairpin structure in the 5’ untranslated region was able to synthesize 4-fold more PHA consisting of 3HB and medium-chain-length 3HA compared to the recombinant harboring the wild type phaC2(Ps). CONCLUSIONS: The levels of both PHB and scl-mcl PHA in E. coli were significantly increased by series of optimization strategies applied on PHA synthase PhaC2(Ps). These results indicate that strategies including codon optimization and mRNA stabilization are useful for heterologous PHA synthase expression and therefore enhance PHA production

Efficacy and adverse effects of transdermal fentanyl and sustained-release oral morphine in treating moderate-severe cancer pain in Chinese population: a systematic review and meta-analysis

<p>Abstract</p> <p>Background</p> <p>Previous meta-analysis suggested that transdermal fentanyl was not inferior to sustained-release oral morphine in treating moderate-severe cancer pain with less adverse effects. Now, we updated the data and performed a systematic review.</p> <p>Methods</p> <p>Updated cohort studies on transdermal fentanyl and oral morphine in the treatment of cancer pain were searched in electronic databases including CBMdisc, CNKI, VIP, Medline, EMBASE and Cochrane Library. Primary end points assessed by meta-analysis were remission rate of pain and incidence of adverse effects. Quality of life was assessed by systematic review, which was the second end point.</p> <p>Results</p> <p>32 cohort studies, which included 2651 patients, were included in present study. The remission rate in transdermal fentanyl group and sustained-release oral morphine group were 86.60% and 88.31% respectively, there was no significant difference [RR = 1.13, 95% CI (0.92, 1.38), P = 0.23]. Compared with oral morphine group, there were less adverse effects in terms of constipation [RR = 0.35, 95% CI (0.27, 0.45), P < 0.00001], nausea/vomiting [RR = 0.57, 95% CI (0.49, 0.67), P < 0.00001], and vertigo/somnolence [RR = 0.59, 95% CI (0.51, 0.68), P < 0.00001] in transdermal fentanyl group. Six of selected trials supported either transdermal fentanyl or sustained-release oral morphine improved QOL of cancer patients and one of them showed more patients got better QOL after sustained-release oral morphine transferred to transdermal fentanyl.</p> <p>Conclusions</p> <p>Our study showed again that both transdermal fentanyl and oral morphine had the same efficacy in the treatment of moderate-severe cancer pain in Chinese population, but the former might have less adverse effects and better quality of life.</p

β-Elemene Inhibits Human Sperm Function by Affecting Sperm Vitality and Intracellular Calcium

Background/Aims: β-Elemene is a bioactive sesquiterpene compound that exhibits a potent anti-tumor effect and is used in various clinical applications. However, little is known about its effect on the male reproductive system. The objective of this study was to investigate the in vitro actions of β-elemene on human sperm function and elucidate the underlying mechanism. Methods: The cytotoxicity of β-elemene toward MCF-10A, MDA-MD-231, and A549 cells was evaluated with cell proliferation and colony formation assays. Additionally, human sperm were treated with different concentrations (0, 10, 20, 40, 80, 160, and 320 µM) of β-elemene in vitro. The characteristics in human sperm essential for fertilization, including vitality, motility, capacitation, acrosome reaction, responsiveness to progesterone, and intracellular calcium concentration ([Ca2+]i) were examined with a computer-assisted sperm analysis system, chlortetracycline staining, and a fluorescent Ca2+ indicator. Results: A comprehensive evaluation of sperm motility, especially hyperactivated motility, revealed that treatments with 40–320 μM β-elemene decreased human sperm vitality, motility (total motility, progressive motility, and curvilinear velocity), and penetrating ability in a dose-dependent manner, but were non-toxic or minimally toxic toward MCF-10A, MDA-MD-231, and A549 cells. Although 10 and 20 μM β-elemene did not affect sperm vitality and motility, these concentrations increased the spontaneous acrosome reaction and inhibited progesterone-induced sperm functions by affecting sperm [Ca2+]i. Conclusion: These results suggest that β-elemene inhibits human sperm function by affecting sperm vitality and [Ca2+]i. These observations must be considered when using β-elemene to treat cancer patients who may wish to preserve their fertility

A systemic administration of liposomal curcumin inhibits radiation pneumonitis and sensitizes lung carcinoma to radiation

Radiation pneumonitis (RP) is an important dose-limiting toxicity during thoracic radiotherapy. Previous investigations have shown that curcumin is used for the treatment of inflammatory conditions and cancer, suggesting that curcumin may prevent RP and sensitize cancer cells to irradiation. However, the clinical advancement of curcumin is limited by its poor water solubility and low bioavailability after oral administration. Here, a water-soluble liposomal curcumin system was developed to investigate its prevention and sensitizing effects by an intravenous administration manner in mice models. The results showed that liposomal curcumin inhibited nuclear factor-κB pathway and downregulated inflammatory factors including tumor necrosis factor-α, interleukin (IL)-6, IL-8, and transforming growth factor-β induced by thoracic irradiation. Furthermore, the combined treatment with liposomal curcumin and radiotherapy increased intratumoral apoptosis and microvessel responses to irradiation in vivo. The significantly enhanced inhibition of tumor growth also was observed in a murine lung carcinoma (LL/2) model. There were no obvious toxicities observed in mice. The current results indicate that liposomal curcumin can effectively mitigate RP, reduce the fibrosis of lung, and sensitize LL/2 cells to irradiation. This study also suggests that the systemic administration of liposomal curcumin is safe and deserves to be investigated for further clinical application