Renyi Differential Privacy of Propose-Test-Release and Applications to Private and Robust Machine Learning

Propose-Test-Release (PTR) is a differential privacy framework that works with local sensitivity of functions, instead of their global sensitivity. This framework is typically used for releasing robust statistics such as median or trimmed mean in a differentially private manner. While PTR is a common framework introduced over a decade ago, using it in applications such as robust SGD where we need many adaptive robust queries is challenging. This is mainly due to the lack of Renyi Differential Privacy (RDP) analysis, an essential ingredient underlying the moments accountant approach for differentially private deep learning. In this work, we generalize the standard PTR and derive the first RDP bound for it when the target function has bounded global sensitivity. We show that our RDP bound for PTR yields tighter DP guarantees than the directly analyzed (\eps, \delta)-DP. We also derive the algorithm-specific privacy amplification bound of PTR under subsampling. We show that our bound is much tighter than the general upper bound and close to the lower bound. Our RDP bounds enable tighter privacy loss calculation for the composition of many adaptive runs of PTR. As an application of our analysis, we show that PTR and our theoretical results can be used to design differentially private variants for byzantine robust training algorithms that use robust statistics for gradients aggregation. We conduct experiments on the settings of label, feature, and gradient corruption across different datasets and architectures. We show that PTR-based private and robust training algorithm significantly improves the utility compared with the baseline.Comment: NeurIPS 202

Expression of Toll-like receptor 2 is up-regulated in monocytes from patients with chronic obstructive pulmonary disease

BACKGROUND: Chronic obstructive pulmonary disease (COPD) is characterised by pulmonary and systemic inflammation which flare-up during episodes of acute exacerbation (AECOPD). Given the role of Toll-like receptors (TLRs) in the induction of inflammatory responses we investigated the involvement of TLRs in COPD pathogenesis. METHODS: The expression of TLR-2, TLR-4 and CD14 in monocytes was analyzed by flow cytometry. To study the functional responses of these receptors, monocytes were stimulated with peptidoglycan or lipopolysaccharide and the amounts of TNFα and IL-6 secreted were determined by ELISA. RESULTS: We found that the expression of TLR-2 was up-regulated in peripheral blood monocytes from COPD patients, either clinically stable or during AECOPD, as compared to never smokers or smokers with normal lung function. Upon stimulation with TLR-2 ligand monocytes from COPD patients secreted increased amounts of cytokines than similarly stimulated monocytes from never smokers and smokers. In contrast, the expressions of TLR-4 and CD14 were not significantly different between groups, and the response to lipopolysaccharide (a TLR-4 ligand) stimulation was not significantly different either. At discharge from hospital TLR-2 expression was down-regulated in peripheral blood monocytes from AECOPD patients. This could be due to the treatment with systemic steroids because, in vitro, steroids down-regulated TLR-2 expression in a dose-dependent manner. Finally, we demonstrated that IL-6, whose plasma levels are elevated in patients, up-regulated in vitro TLR-2 expression in monocytes from never smokers. CONCLUSION: Our results reveal abnormalities in TLRs expression in COPD patients and highlight its potential relationship with systemic inflammation in these patients

Lower Expression of TLR2 and SOCS-3 Is Associated with Schistosoma haematobium Infection and with Lower Risk for Allergic Reactivity in Children Living in a Rural Area in Ghana

Inflammatory diseases such as atopic disorders are a major health problem in the Western world, but their prevalence is also increasing in developing countries, especially in urban centres. There is increasing evidence that exposure to a rural environment with high burden of compounds derived from parasites and microorganisms is associated with protection from atopic disorders. Since urbanisation is progressing at a rapid pace, particularly in less-developed nations, there is a need to understand the molecular processes that control the progress towards the development of allergic diseases in developing countries. In this study we have examined a population of school children living in a rural area of Ghana, where helminth (worm) infections are prevalent and associated with protection from skin reactivity to house dust mite. Blood samples were collected from these children and analysed for the expression levels of several genes involved in the development of a pro allergic immune system. The results point at a potential molecular link that might explain the negative association between schistosome infections and allergies

Immunohistochemical expression of promyelocytic leukemia body in soft tissue sarcomas

<p>Abstract</p> <p>Background</p> <p>The function of promyelocytic leukemia (PML) bodies is not well known but plays an important role in controlling cell proliferation, apoptosis and senescence. This study was undertaken to analyze the clinical significance of PML body expression in primary tumor samples from malignant fibrous histiocytoma (MFH) and liposarcoma patients.</p> <p>Methods</p> <p>We studied MFH and liposarcoma samples from 55 patients for PML bodies. Fluorescent immunostaining of PML bodies was performed in the paraffin-embedded tumor sections.</p> <p>Results</p> <p>PML body immunostaining was identified in 63.9% of MFH and 63.2% of liposarcoma samples. PML body expression rates of all sarcoma cells were 1.5 ± 1.8% (range: 0–7.0) in MFH and 1.3 ± 1.4% (0–5.2) in liposarcoma samples. PML body expression (p = 0.0053) and a high rate of PML body expression (p = 0.0012) were significantly greater prognostic risk factors for death than the other clinical factors in MFH patients. All liposarcoma patients without expression of PML were disease free at the end of the study.</p> <p>Conclusion</p> <p>Our study suggests that the presence of PML bodies may indicate a poor prognosis for MFH and liposarcoma patients.</p

CD14 Signaling Restrains Chronic Inflammation through Induction of p38-MAPK/SOCS-Dependent Tolerance

Current thinking emphasizes the primacy of CD14 in facilitating recognition of microbes by certain TLRs to initiate pro-inflammatory signaling events and the importance of p38-MAPK in augmenting such responses. Herein, this paradigm is challenged by demonstrating that recognition of live Borrelia burgdorferi not only triggers an inflammatory response in the absence of CD14, but one that is, in part, a consequence of altered PI3K/AKT/p38-MAPK signaling and impaired negative regulation of TLR2. CD14 deficiency results in increased localization of PI3K to lipid rafts, hyperphosphorylation of AKT, and reduced activation of p38. Such aberrant signaling leads to decreased negative regulation by SOCS1, SOCS3, and CIS, thereby compromising the induction of tolerance in macrophages and engendering more severe and persistent inflammatory responses to B. burgdorferi. Importantly, these altered signaling events and the higher cytokine production observed can be mimicked through shRNA and pharmacological inhibition of p38 activity in CD14-expressing macrophages. Perturbation of this CD14/p38-MAPK-dependent immune regulation may underlie development of infectious chronic inflammatory syndromes

Recent insights into targeting the IL-6 cytokine family in inflammatory diseases and cancer

The IL-6 family of cytokines consists of IL-6, IL-11, IL-27, IL-31, oncostatin M (OSM), leukaemia inhibitory factor (LIF), ciliary neurotrophic factor (CNTF), cardiotrophin 1 (CT-1) and cardiotrophin-like cytokine factor 1 (CLCF1). Membership of this cytokine family is defined by usage of common β-receptor signalling subunits, which activate various intracellular signalling pathways. Each IL-6 family member elicits responses essential to the physiological control of immune homeostasis, haematopoiesis, inflammation, development and metabolism. Accordingly, distortion of these cytokine activities often promotes chronic disease and cancer; the pathological importance of this is exemplified by the successful treatment of certain autoimmune conditions with drugs that target the IL-6 pathway. Here, we discuss the emerging roles for IL-6 family members in infection, chronic inflammation, autoimmunity and cancer and review therapeutic strategies designed to manipulate these cytokines in disease

Design of a superconducting rotating gantry for heavy-ion therapy

A superconducting rotating gantry for heavy-ion therapy is being designed. This isocentric rotating gantry can transport heavy ions with the maximum energy of 430  MeV/u to an isocenter with irradiation angles of over 0–360 degrees, and is further capable of performing three-dimensional raster-scanning irradiation. The combined-function superconducting magnets will be employed for the rotating gantry. The superconducting magnets with optimized beam optics allow a compact gantry design with a large scan size at the isocenter; the length and the radius of the gantry will be approximately 13 and 5.5 m, respectively, which are comparable to those for the existing proton gantries. Furthermore, the maximum scan size at the isocenter is calculated to be as large as approximately 200 mm square for heavy-ion beams at the maximum energy of 430  MeV/u. Based on the design of the beam optics, specifications of the superconducting magnets were determined. The superconducting magnets and magnetic-field distributions are designed using a three-dimensional field solver. With the calculated magnetic fields, beam-tracking simulations were performed to verify the design of the superconducting magnets, and concurrently to evaluate the field quality. With calculated beam profiles at the isocenter, we found that the positions of beam spots as well as their size and shape could be well reproduced as designed, proving validity of our design

Utility valuation of multi-name credit derivatives and application to CDOs

We study the impact of risk-aversion on the valuation of credit derivatives. Using the technology of utility-indifference pricing in intensity-based models of default risk, we analyse resulting yield spreads in multi-name credit derivatives, particularly CDOs. We study first the idealized problem with constant intensities where solutions are essentially explicit. We also give the large portfolio asymptotics for this problem. We then analyse the case where the firms have stochastic default intensities driven by a common factor, which can be viewed as another extreme from the independent case. This involves the numerical solution of a system of reaction-diffusion PDEs. We observe that the nonlinearity of the utility-indifference valuation mechanism enhances the effective correlation between the times of the credit events of the various firms leading to non-trivial senior tranche spreads, as often seen from market data.Applications to credit risk, Applications to default risk, Applied mathematical finance, Utility indifference, Continuous time finance, Pricing with utility based preferences, Pricing of derivatives securities, Control of stochastic systems,