Differentially Private Learning with Per-Sample Adaptive Clipping

Privacy in AI remains a topic that draws attention from researchers and the general public in recent years. As one way to implement privacy-preserving AI, differentially private learning is a framework that enables AI models to use differential privacy (DP). To achieve DP in the learning process, existing algorithms typically limit the magnitude of gradients with a constant clipping, which requires carefully tuned due to its significant impact on model performance. As a solution to this issue, latest works NSGD and Auto-S innovatively propose to use normalization instead of clipping to avoid hyperparameter tuning. However, normalization-based approaches like NSGD and Auto-S rely on a monotonic weight function, which imposes excessive weight on small gradient samples and introduces extra deviation to the update. In this paper, we propose a Differentially Private Per-Sample Adaptive Clipping (DP-PSAC) algorithm based on a non-monotonic adaptive weight function, which guarantees privacy without the typical hyperparameter tuning process of using a constant clipping while significantly reducing the deviation between the update and true batch-averaged gradient. We provide a rigorous theoretical convergence analysis and show that with convergence rate at the same order, the proposed algorithm achieves a lower non-vanishing bound, which is maintained over training iterations, compared with NSGD/Auto-S. In addition, through extensive experimental evaluation, we show that DP-PSAC outperforms or matches the state-of-the-art methods on multiple main-stream vision and language tasks.Comment: To appear in AAAI 2023, Revised acknowledgments and citation

A Multi-Robot Cooperation Framework for Sewing Personalized Stent Grafts

This paper presents a multi-robot system for manufacturing personalized medical stent grafts. The proposed system adopts a modular design, which includes: a (personalized) mandrel module, a bimanual sewing module, and a vision module. The mandrel module incorporates the personalized geometry of patients, while the bimanual sewing module adopts a learning-by-demonstration approach to transfer human hand-sewing skills to the robots. The human demonstrations were firstly observed by the vision module and then encoded using a statistical model to generate the reference motion trajectories. During autonomous robot sewing, the vision module plays the role of coordinating multi-robot collaboration. Experiment results show that the robots can adapt to generalized stent designs. The proposed system can also be used for other manipulation tasks, especially for flexible production of customized products and where bimanual or multi-robot cooperation is required.Comment: 10 pages, 12 figures, accepted by IEEE Transactions on Industrial Informatics, Key words: modularity, medical device customization, multi-robot system, robot learning, visual servoing, robot sewin

The association between ambient temperature and antimicrobial resistance of Klebsiella pneumoniae in China: a difference-in-differences analysis

IntroductionAntimicrobial resistance (AMR) of Klebsiella pneumoniae (K. pneumoniae) poses a significant global public health threat and is responsible for a high prevalence of infections and mortality. However, knowledge about how ambient temperature influences the AMR of K. pneumoniae is limited in the context of global warming.MethodsAMR data of 31 Chinese provinces was collected from the China Antimicrobial Resistance Surveillance System (CARSS) between 2014 and 2020. Socioeconomic and meteorological data were collected from the China Statistical Yearbook during the same period. A modified difference-in-differences (DID) approach was applied to estimate the association between ambient temperature and third-generation cephalosporin-resistant K. pneumoniae (3GCRKP) and carbapenem-resistant K. pneumoniae (CRKP). Furthermore, moderating effects of socioeconomic factors were also evaluated.ResultsEvery 1°C increase in annual average temperature was associated with a 4.7% (relative risk (RR):1.047, 95% confidence intervals (CI): 1.031–1.082) increase in the detection rate of 3GCRKP, and a 10.7% (RR:1.107, 95% CI: 1.011–1.211) increase in the detection rate of CRKP. The relationships between ambient temperature and 3GCRKP and CRKP were found to be moderated by socioeconomic status (GDP per capita, income per capita, and consumption per capita; the interaction p-values <0.05), where higher economic status was found to strengthen the effects of temperature on the detection rate of 3GCRKP and weaken the effects on the detection rate of CRKP.DiscussionAmbient temperature was found to be positively associated with AMR of K. pneumoniae, and this association was moderated by socioeconomic status. Policymakers should consider the impact of global warming and high temperatures on the spread of 3GCRKP and CRKP when developing strategies for the containment of AMR

Characterization of the Metabolic Fate of Datura metel Seed Extract and Its Main Constituents in Rats

Datura metel L. has been frequently used in Chinese traditional medicine. However, little is known on the chemical composition and in vivo metabolism of its seeds. In this study, using the strategy “chemical analysis, metabolism of single representative compounds, and metabolism of extract at clinical dosage” that we propose here, 42 constituents were characterized from D. metel seeds water extract. Furthermore, the metabolic pathways of 13 representative bioactive compounds of D. metel seeds were studied in rats after the oral administration of D. metel seeds water extract at a clinical dosage (0.15 g/kg). These included three withanolides, two withanolide glucosides, four amides, one indole, one triterpenoid, one steroid, and one sesquiterpenoid, and with regard to phase II metabolism, hydroxylation, (de)methylation, and dehydrogenation reactions were dominant. Furthermore, the metabolism of D. metel seeds water extract provided to rats at a clinical dosage was investigated by liquid chromatography-tandem mass spectrometry based on the above metabolic pathways. Sixty-one compounds were detected in plasma, 83 in urine, and 76 in fecal samples. Among them, withanolides exhibited higher plasma exposure than the other types. To our knowledge, this is the first systematic study on the chemical profiling and metabolite identification of D. metel seeds, including all compounds instead of single constituents

Identification of Target Genes at Juvenile Idiopathic Arthritis GWAS Loci in Human Neutrophils

Juvenile idiopathic arthritis (JIA) is the most common chronic rheumatic disease among children which could cause severe disability. Genomic studies have discovered substantial number of risk loci for JIA, however, the mechanism of how these loci affect JIA development is not fully understood. Neutrophil is an important cell type involved in autoimmune diseases. To better understand the biological function of genetic loci in neutrophils during JIA development, we took an integrated multi-omics approach to identify target genes at JIA risk loci in neutrophils and constructed a protein-protein interaction network via a machine learning approach. We identified genes likely to be JIA risk loci targeted genes in neutrophils which could contribute to JIA development

PAR6, A Potential Marker for the Germ Cells Selected to Form Primordial Follicles in Mouse Ovary

Partitioning-defective proteins (PAR) are detected to express mainly in the cytoplast, and play an important role in cell polarity. However, we showed here that PAR6, one kind of PAR protein, was localized in the nuclei of mouse oocytes that formed primordial follicles during the perinatal period, suggesting a new role of PAR protein. It is the first time we found that, in mouse fetal ovaries, PAR6 appeared in somatic cell cytoplasm and fell weak when somatic cells invaded germ cell cysts at 17.5 days post coitus (dpc). Meanwhile, the expression of PAR6 was observed in cysts, and became strong in the nuclei of some germ cells at 19.5 dpc and all primordial follicular oocytes at 3 day post parturition (dpp), and then obviously declined when the primordial follicles entered the folliculogenic growth phase. During the primordial follicle pool foundation, the number of PAR6 positive germ cells remained steady and was consistent with that of formed follicles at 3 dpp. There were no TUNEL (apoptosis examination) positive germ cells stained with PAR6 at any time studied. The number of follicles significantly declined when 15.5 dpc ovaries were treated with the anti-PAR6 antibody and PAR6 RNA interference. Carbenoxolone (CBX, a known blocker of gap junctions) inhibited the expression of PAR6 in germ cells and the formation of follicles. Our results suggest that PAR6 could be used as a potential marker of germ cells for the primordial follicle formation, and the expression of PAR6 by a gap junction-dependent process may contribute to the formation of primordial follicles and the maintenance of oocytes at the diplotene stage