Defending Pre-trained Language Models as Few-shot Learners against Backdoor Attacks

Pre-trained language models (PLMs) have demonstrated remarkable performance as few-shot learners. However, their security risks under such settings are largely unexplored. In this work, we conduct a pilot study showing that PLMs as few-shot learners are highly vulnerable to backdoor attacks while existing defenses are inadequate due to the unique challenges of few-shot scenarios. To address such challenges, we advocate MDP, a novel lightweight, pluggable, and effective defense for PLMs as few-shot learners. Specifically, MDP leverages the gap between the masking-sensitivity of poisoned and clean samples: with reference to the limited few-shot data as distributional anchors, it compares the representations of given samples under varying masking and identifies poisoned samples as ones with significant variations. We show analytically that MDP creates an interesting dilemma for the attacker to choose between attack effectiveness and detection evasiveness. The empirical evaluation using benchmark datasets and representative attacks validates the efficacy of MDP.Comment: Accepted by NeurIPS'2

Polo-like kinase 1 (Plk1) overexpression enhances ionizing radiation-induced cancer formation in mice

Polo-like kinase 1 (Plk1), a serine/threonine protein kinase normally expressed in mitosis, is frequently up-regulated in multiple types of human tumors regardless of the cell cycle stage. However, the causal relationship between Plk1 up-regulation and tumorigenesis is incompletely investigated. To this end, using a conditional expression system, here we generated Plk1 transgenic mouse lines to examine the role of Plk1 in tumorigenesis. Plk1 overexpression in mouse embryonic fibroblasts prepared from the transgenic mice led to aberrant mitosis followed by aneuploidy and apoptosis. Surprisingly, Plk1 overexpression had no apparent phenotypes in the mice. Given that no malignant tumor formation was observed even after a long period of Plk1 overexpression, we reasoned that additional factors are required for tumorigenesis in Plk1-overexpressing mice. Because Plk1 can directly participate in the regulation of the DNA damage response (DDR) pathway, we challenged Plk1-overexpressing mice with ionizing radiation (IR) and found that Plk1-overexpressing mice are much more sensitive to IR than their wild-type littermates. Analysis of tumor development in the Plk1-overexpressing mice indicated a marked decrease in the time required for tumor emergence after IR. At the molecular level, Plk1 overexpression led to reduced phosphorylation of the serine/threonine kinases ATM and Chk2 and of histone H2AX after IR treatment both in vivo and in vitro Furthermore, RNA-Seq analysis suggested that Plk1 elevation decreases the expression of several DDR genes. We conclude that Plk1 overexpression may contribute to tumor formation by both inducing chromosomal instability and suppressing the DDR pathway

Bone Mineral Density Reference Standards for Chinese Children Aged 3-18: Cross-Sectional Results of the 2013-2015 China Child and Adolescent Cardiovascular Health (CCACH) Study

Objectives: No nationwide paediatric reference standards for bone mineral density (BMD) are available in China. We aimed to provide sex-specific BMD reference values for Chinese children and adolescents (3-18 years). Methods: Data (10 818 participants aged 3-18 years) were obtained from cross-sectional surveys of the China Child and Adolescent Cardiovascular Health in 2015, which included four municipality cities and three provinces. BMD was measured using Hologic Discovery Dual Energy X-ray Absorptiometry (DXA) scanner. The DXA measures were modelled against age, with height as an independent variable. The LMS statistical method using a curve fitting procedure was used to construct reference smooth cross-sectional centile curves for dependent versus independent variables. Results: Children residing in Northeast China had the highest total body less head (TBLH) BMD while children residing in Shandong Province had the lowest values. Among children, TBLH BMD was higher for boys as compared with girls; but, it increased with age and height in both sexes. Furthermore, TBLH BMD was higher among US children as compared with Chinese children. There was a large difference in BMD for height among children from these two countries. US children had a much higher BMD at each percentile (P) than Chinese children; the largest observed difference was at P50 and P3 and the smallest difference was at P97. Conclusions: This is the first study to present a sex-specific reference dataset for Chinese children aged 3-18 years. The data can help clinicians improve interpretation, assessment and monitoring of densitometry results

Functional Analysis of General Odorant Binding Protein 2 from the Meadow Moth, Loxostege sticticalis L. (Lepidoptera: Pyralidae)

Odorant binding proteins play a crucial role in transporting semiochemicals across the sensillum lymph to olfactory receptors within the insect antennal sensilla. In this study, the general odorant binding protein 2 gene was cloned from the antennae of Loxostege sticticalis, using reverse transcription PCR and rapid amplification of cDNA ends. Recombinant LstiGOBP2 was expressed in Escherichia coli and purified by Ni ion affinity chromatography. Real-time PCR assays indicated that LstiGOBP2 mRNA is expressed mainly in adult antennae, with expression levels differing with developmental age. Ligand-binding experiments using N-phenyl-naphthylamine (1-NPN) as a fluorescent probe demonstrated that the LstiGOBP2 protein has binding affinity to a broad range of odorants. Most importantly, trans-11-tetradecen-1-yl acetate, the pheromone component of Loxostege sticticalis, and trans-2-hexenal and cis-3-hexen-1-ol, the most abundant plant volatiles in essential oils extracted from host plants, had high binding affinities to LstiGOBP2 and elicited strong electrophysiological responses from the antennae of adults

FIGURES 1–7 in Female polymorphism in Chilothrips strobilus (Thysanoptera: Thripidae), with the first description of the male

FIGURES 1–7. Chilothrips strobilus (male): (1) body, (2) head, (3) antenna, (4) pronotum, (5) abdominal sternites IV–V, (6) abdominal tergites IX–X, (7)fore wing

Adaptive Multi-task Sparse Learning with an Application to fMRI Study

In this paper, we consider the multi-task sparse learning problem under the assumption that the dimensionality diverges with the sample size. The traditional l1/l2 multi-task lasso does not enjoy the oracle property unless a rather strong condition is enforced. Inspired by adaptive lasso, we propose a multi-stage procedure, adaptive multi-task lasso, to simultaneously conduct model estimation and variable selection across different tasks. Motivated by adaptive elastic-net, we further propose the adaptive multi-task elastic-net by adding another quadratic penalty to address the problem of collinearity. When the number of tasks is fixed, under weak assumptions, we establish the asymptotic oracle property for the proposed adaptive multi-task sparse learning methods including both adaptive multitask lasso and elastic-net. In addition to the desirable asymptotic property, we show by simulations that adaptive sparse learning methods also achieve much improved finite sample performance. As a case study, we apply adaptive multi-task elastic-net to a cognitive science problem, where one wants to discover a compact semantic basis for predicting fMRI images. We show that adaptive multi-task sparse learning methods achieve superior performance and provide some insights into how the brain represents meanings of words.

Calculation of Axial Compression Capacity for Square Columns Strengthened with HPFL and BSP

The load carrying capacity and failure mechanism of 8 square columns strengthened with high-performance ferrocement laminate (HPFL) and bonded steel plates (BSP) were analyzed on the basis of experiments on the axial compression performance of these columns. Results show that the reinforcing layer worked together with the original columns as a whole, and the load-bearing capacity significantly increased. When failure of the strengthened column occurred, the mortar and concrete were crushed and bulged outward in the middle of the columns, the angle bars and longitudinal steel bars buckled, and some stirrups were pulled out. The chamfering of angle bar momentously affected the primary damage of steel strand. The values of the strength reduction factor and pressure effective utilization coefficient of the mortar were suggested. Based on the experiments and existing tests of 35 columns strengthened with HPFL, equations for the axial compression bearing capacity were proposed and all calculation results agreed well with testing results. Therefore, the calculation method could be used in the capacity design of axial compression strengthened columns

Thiamethoxam Resistance in Aphis gossypii Glover Relies on Multiple UDP-Glucuronosyltransferases

Uridine diphosphate (UDP)-glycosyltransferases (UGTs) are major phase II enzymes that conjugate a variety of small lipophilic molecules with UDP sugars and alter them into more water-soluble metabolites. Therefore, glucosidation plays a major role in the inactivation and excretion of a great variety of both endogenous and exogenous compounds. In this study, two inhibitors of UGT enzymes, sulfinpyrazone and 5-nitrouracil, significantly increased the toxicity of thiamethoxam against the resistant strain of Aphis gossypii, which indicates that UGTs are involved in thiamethoxam resistance in the cotton aphid. Based on transcriptome data, 31 A. gossypii UGTs belonging to 11 families (UGT329, UGT330, UGT341, UGT342, UGT343, UGT344, UGT345, UGT348, UGT349, UGT350, and UGT351) were identified. Compared with the thiamethoxam-susceptible strain, the transcripts of 23 UGTs were elevated, and the transcripts of 13 UGTs (UGT344J2, UGT348A2, UGT344D4, UGT341A4, UGT343B2, UGT342B2, UGT350C3, UGT344N2, UGT344A14, UGT344B4, UGT351A4, UGT344A11, and UGT349A2) were increased by approximately 2.0-fold in the resistant cotton aphid. The suppression of selected UGTs significantly increased the insensitivity of resistant aphids to thiamethoxam, suggesting that the up-regulated UGTs might be associated with thiamethoxam tolerance. This study provides an overall view of the possible metabolic factor UGTs that are relevant to the development of insecticide resistance. The results might facilitate further work to validate the roles of these UGTs in thiamethoxam resistance