Defending Large Language Models Against Jailbreaking Attacks Through Goal Prioritization

Large Language Models (LLMs) continue to advance in their capabilities, yet this progress is accompanied by a growing array of safety risks. While significant attention has been dedicated to exploiting weaknesses in LLMs through jailbreaking attacks, there remains a paucity of exploration into defending against these attacks. We point out a pivotal factor contributing to the success of jailbreaks: the inherent conflict between the goals of being helpful and ensuring safety. To counter jailbreaking attacks, we propose to integrate goal prioritization at both training and inference stages. Implementing goal prioritization during inference substantially diminishes the Attack Success Rate (ASR) of jailbreaking attacks, reducing it from 66.4% to 2.0% for ChatGPT and from 68.2% to 19.4% for Vicuna-33B, without compromising general performance. Furthermore, integrating the concept of goal prioritization into the training phase reduces the ASR from 71.0% to 6.6% for LLama2-13B. Remarkably, even in scenarios where no jailbreaking samples are included during training, our approach slashes the ASR by half, decreasing it from 71.0% to 34.0%. Additionally, our findings reveal that while stronger LLMs face greater safety risks, they also possess a greater capacity to be steered towards defending against such attacks. We hope our work could contribute to the comprehension of jailbreaking attacks and defenses, and shed light on the relationship between LLMs' capability and safety. Our code will be available at \url{https://github.com/thu-coai/JailbreakDefense_GoalPriority}.Comment: 14 page

A Comparative Study of Mammalian Diversification Pattern

Although mammals have long been regarded as a successful radiation, the diversification pattern among the clades is still poorly known. Higher-level phylogenies are conflicting and comprehensive comparative analyses are still lacking. Using a recently published supermatrix encompassing nearly all extant mammalian families and a novel comparative likelihood approach (MEDUSA), the diversification pattern of mammalian groups was examined. Both order- and family-level phylogenetic analyses revealed the rapid radiation of Boreoeutheria and Euaustralidelphia in the early mammalian history. The observation of a diversification burst within Boreoeutheria at approximately 100 My supports the Long Fuse model in elucidating placental diversification progress, and the rapid radiation of Euaustralidelphia suggests an important role of biogeographic dispersal events in triggering early Australian marsupial rapid radiation. Diversification analyses based on family-level diversity tree revealed seven additional clades with exceptional diversification rate shifts, six of which represent accelerations in net diversification rate as compared to the background pattern. The shifts gave origin to the clades Muridae+Cricetidae, Bovidae+Moschidae+Cervidae, Simiiformes, Echimyidae, Odontoceti (excluding Physeteridae+Kogiidae+Platanistidae), Macropodidae, and Vespertilionidae. Moderate to high extinction rates from background and boreoeutherian diversification patterns indicate the important role of turnovers in shaping the heterogeneous taxonomic richness observed among extant mammalian groups. Furthermore, the present results emphasize the key role of extinction on erasing unusual diversification signals, and suggest that further studies are needed to clarify the historical radiation of some mammalian groups for which MEDUSA did not detect exceptional diversification rates

Systematic screening of long intergenic noncoding RNAs expressed during chicken embryogenesis

ABSTRACT: Long noncoding RNAs (lncRNAs) have emerged as important regulators of many biological processes, including embryogenesis and development. To provide a systematic analysis of lncRNAs expressed during chicken embryogenesis, we used Iso-Seq and RNA-Seq to identify potential lncRNAs at embryonic stages from d 1 to d 8 of incubation: sequential stages covering gastrulation, somitogenesis, and organogenesis. The data characterized an expanded landscape of lncRNAs, yielding 45,410 distinct lncRNAs (31,282 genes). Amongst these, a set of 13,141 filtered intergenic lncRNAs (lincRNAs) transcribed from 9803 lincRNA gene loci, of which, 66.5% were novel, were further analyzed. These lincRNAs were found to share many characteristics with mammalian lincRNAs, including relatively short lengths, fewer exons, lower expression levels, and stage-specific expression patterns. Functional studies motivated by “guilt-by-association” associated individual lincRNAs with specific GO functions, providing an important resource for future studies of lincRNA function. Most importantly, a weighted gene co-expression network analysis suggested that genes of the brown module were specifically associated with the day 2 stage. LincRNAs within this module were co-expressed with proteins involved in hematopoiesis and lipid metabolism. This study presents the systematic identification of lincRNAs in developing chicken embryos and will serve as a powerful resource for the study of lincRNA functions

The exposure to volatile organic chemicals associates positively with rheumatoid arthritis: a cross-sectional study from the NHANES program

IntroductionRheumatoid arthritis (RA) is an autoimmune disease and closely associated with both genetic and environmental factors. Volatile organic chemicals (VOC), a common environment pollutant, was associated with some autoimmune diseases, while whether VOC exposure or which VOC leads to RA is yet clarified.MethodsA cross-sectional study using data from the 6 survey cycles (2005-2006, 2011-2012, 2013-2014, 2015-2016, 2017-2018, 2017-2020) of NHANES program was performed. The RA or non-arthritis status of participant was identified through a questionnaire survey. The quantile logistic regression method was used for correlation analysis between VOC metabolites (VOCs) in urine and RA. The covariates included age, gender, race, educational level, marital status, total energy intake, physical activity, smoking, hypertension, diabetes, urine creatinine, albumin and marihuana use.ResultsA total of 9536 participants (aged 20 to 85) with 15 VOCs, comprising 618 RA and 8918 non-arthritis participants, was finally included for analysis. Participants in the RA group showed higher VOCs in urine than that in the non-arthritis group. A positive association between 2 VOCs (AMCC: Q4: OR=2.173, 95%CI: 1.021, 4.627. 3HPMA: Q2: OR=2.286, 95%CI: 1.207 - 4.330; Q4: OR=2.663, 95%CI: 1.288 -5.508.) and RA was detected in the model 3, which was independent of all the covariates. The relative parent compounds of the two VOCs included N,N-Dimethylformamide and acrolein.DiscussionThese findings suggested that the VOC exposure significantly associated with RA, providing newly epidemiological evidence for the establishment that environmental pollutants associated with RA. And also, more prospective studies and related experimental studies are needed to further validate the conclusions of this study

LncRNA SENCR suppresses abdominal aortic aneurysm formation by inhibiting smooth muscle cells apoptosis and extracellular matrix degradation

Abdominal aortic aneurysm (AAA) is a progressive chronic dilatation of the abdominal aorta without effective medical treatment. This study aims to clarify the potential of long non-coding RNA SENCR as a treatment target in AAA. Angiotensin II (Ang-II) was used to establish AAA model in vitro and in vivo. Reverse transcription quantitative PCR and western blot were performed to measure the expression of SENCR and proteins, respectively. Annexin V-FITC/PI double staining was carried out to detect the apoptotic rate in vascular smooth muscle cells (VSMCs), and cell apoptosis in aortic tissues was determined by TUNEL staining. Besides, hematoxylin and eosin and Elastica van Gieson staining were performed for histological analysis of aortic tissues. SENCR was downregulated in AAA tissues and Ang-II-stimulated VSMCs. Overexpression of SENCR could inhibit Ang-II-induced VSMC apoptosis, while inhibition of SENCR facilitated Ang-II-induced VSMC apoptosis. Moreover, the expression of matrix metalloproteinase (MMP)-2 and MMP-9 in Ang-II-induced VSMCs was reduced following SENCR overexpression, while tissue inhibitor of metalloproteinases 1 (TIMP-1) expression was increased. In vivo, overexpression of SENCR improved the pathological change in aortic tissues and the damage in arterial wall elastic fibers induced by Ang-II, as well as suppressed Ang-II-induced cell apoptosis and extracellular matrix degradation. Overall, SENCR was decreased in AAA. Overexpression of SENCR inhibited AAA formation via inhibition of VSMC apoptosis and extracellular matrix degradation. We provided a reliable evidence for SENCR acting as a potential target for AAA treatment

Single-Cell Rna Sequencing Deconvolutes the in Vivo Heterogeneity of Human Bone Marrow-Derived Mesenchymal Stem Cells

Bone marrow-derived mesenchymal stem cells (BM-MSCs) are multipotent stromal cells that have a critical role in the maintenance of skeletal tissues such as bone, cartilage, and the fat in bone marrow. In addition to providing microenvironmental support for hematopoietic processes, BM-MSCs can differentiate into various mesodermal lineages including osteoblast/osteocyte, chondrocyte, and adipocyte that are crucial for bone metabolism. While BM-MSCs have high cell-to-cell heterogeneity in gene expression, the cell subtypes that contribute to this heterogeneity in vivo in humans have not been characterized. To investigate the transcriptional diversity of BM-MSCs, we applied single-cell RNA sequencing (scRNA-seq) on freshly isolated CD271+ BM-derived mononuclear cells (BM-MNCs) from two human subjects. We successfully identified LEPRhi CD45low BM-MSCs within the CD271+ BM-MNC population, and further codified the BM-MSCs into distinct subpopulations corresponding to the osteogenic, chondrogenic, and adipogenic differentiation trajectories, as well as terminal-stage quiescent cells. Biological functional annotations of the transcriptomes suggest that osteoblast precursors induce angiogenesis coupled with osteogenesis, and chondrocyte precursors have the potential to differentiate into myocytes. We also discovered transcripts for several clusters of differentiation (CD) markers that were either highly expressed (e.g., CD167b, CD91, CD130 and CD118) or absent (e.g., CD74, CD217, CD148 and CD68) in BM-MSCs, representing potential novel markers for human BM-MSC purification. This study is the first systematic in vivo dissection of human BM-MSCs cell subtypes at the single-cell resolution, revealing an insight into the extent of their cellular heterogeneity and roles in maintaining bone homeostasis