Red Teaming Game: A Game-Theoretic Framework for Red Teaming Language Models

Deployable Large Language Models (LLMs) must conform to the criterion of helpfulness and harmlessness, thereby achieving consistency between LLMs outputs and human values. Red-teaming techniques constitute a critical way towards this criterion. Existing work rely solely on manual red team designs and heuristic adversarial prompts for vulnerability detection and optimization. These approaches lack rigorous mathematical formulation, thus limiting the exploration of diverse attack strategy within quantifiable measure and optimization of LLMs under convergence guarantees. In this paper, we present Red-teaming Game (RTG), a general game-theoretic framework without manual annotation. RTG is designed for analyzing the multi-turn attack and defense interactions between Red-team language Models (RLMs) and Blue-team Language Model (BLM). Within the RTG, we propose Gamified Red-teaming Solver (GRTS) with diversity measure of the semantic space. GRTS is an automated red teaming technique to solve RTG towards Nash equilibrium through meta-game analysis, which corresponds to the theoretically guaranteed optimization direction of both RLMs and BLM. Empirical results in multi-turn attacks with RLMs show that GRTS autonomously discovered diverse attack strategies and effectively improved security of LLMs, outperforming existing heuristic red-team designs. Overall, RTG has established a foundational framework for red teaming tasks and constructed a new scalable oversight technique for alignment

Fast-U2++: Fast and Accurate End-to-End Speech Recognition in Joint CTC/Attention Frames

Recently, the unified streaming and non-streaming two-pass (U2/U2++) end-to-end model for speech recognition has shown great performance in terms of streaming capability, accuracy and latency. In this paper, we present fast-U2++, an enhanced version of U2++ to further reduce partial latency. The core idea of fast-U2++ is to output partial results of the bottom layers in its encoder with a small chunk, while using a large chunk in the top layers of its encoder to compensate the performance degradation caused by the small chunk. Moreover, we use knowledge distillation method to reduce the token emission latency. We present extensive experiments on Aishell-1 dataset. Experiments and ablation studies show that compared to U2++, fast-U2++ reduces model latency from 320ms to 80ms, and achieves a character error rate (CER) of 5.06% with a streaming setup.Comment: 5 pages, 3 figure

Shadowed Sets-Based Linguistic Term Modeling and Its Application in Multi-Attribute Decision-Making

For many multi-attribute decision-making (MADM) problems, linguistic variables are more convenient for people to express the attribute values. In this paper, a novel shadowed set-based method is proposed to deal with linguistic terms, where the linguistic term sets are symmetrical both in meaning and form. Firstly, to effectively express the linguistic variables, we develop a data-driven method to construct the shadowed set model for the linguistic terms. Secondly, the Pythagorean shadowed set is defined, and some theorems are subsequently explored. Thirdly, we propose the score function of the Pythagorean shadowed number and develop a new MADM method on the basis of the Pythagorean shadowed set. Finally, a case study of the supplier selection problem is provided to illustrate the effectiveness of the proposed method, and the superiority of our method is demonstrated by comparison analysis

Numerical Simulation of Wind Turbine Aerodynamic Characteristics under Wind Shear Based on Lattice-Boltzmann Method

In order to study the influence of wind shear on the aerodynamic characteristics of large wind turbines, taking the 5MW wind turbine blade model published by NREL as the research object, large eddy simulation (LES) of wind turbines was carried out by using XFlow fluid simulation software based on Lattice-Boltzmann method (LBM). WALE turbulence model was used to study wind shear at 3, 11.2 and 25m/s wind speeds. The effect of factors on the axial thrust and torque of wind turbines is compared with the data published by NREL. The results show that the XFlow software based on LBM and LES method has good capturing ability for the eddy wake of wind turbine; wind shear causes the airfoil section of each section of blade to deviate from the best designed attack angle in theory and results in a decrease in torque applied to the wind turbine

Autologous platelet-rich plasma induces bone formation of tissue-engineered bone with bone marrow mesenchymal stem cells on beta-tricalcium phosphate ceramics

Abstract Background The purpose of the study is to investigate whether autologous platelet-rich plasma (PRP) can serve as bone-inducing factors to provide osteoinduction and improve bone regeneration for tissue-engineered bones fabricated with bone marrow mesenchymal stem cells (MSCs) and beta-tricalcium phosphate (β-TCP) ceramics. The current study will give more insight into the contradictory osteogenic capacity of PRP. Methods The concentration of platelets, platelet-derived growth factor-AB (PDGF-AB), and transforming growth factor-β1 (TGF-β1) were measured in PRP and whole blood. Tissue-engineered bones using MSCs on β-TCP scaffolds in combination with autologous PRP were fabricated (PRP group). Controls were established without the use of autologous PRP (non-PRP group). In vitro, the proliferation and osteogenic differentiation of MSCs on fabricated constructs from six rabbits were evaluated with MTT assay, alkaline phosphatase (ALP) activity, and osteocalcin (OC) content measurement after 1, 7, and 14 days of culture. For in vivo study, the segmental defects of radial diaphyses of 12 rabbits from each group were repaired by fabricated constructs. Bone-forming capacity of the implanted constructs was determined by radiographic and histological analysis at 4 and 8 weeks postoperatively. Results PRP produced significantly higher concentration of platelets, PDGF-AB, and TGF-β1 than whole blood. In vitro study, MTT assay demonstrated that the MSCs in the presence of autologous PRP exhibited excellent proliferation at each time point. The results of osteogenic capacity detection showed significantly higher levels of synthesis of ALP and OC by the MSCs in combination with autologous PRP after 7 and 14 days of culture. In vivo study, radiographic observation showed that the PRP group produced significantly higher score than the non-PRP group at each time point. For histological evaluation, significantly higher volume of regenerated bone was found in the PRP group when compared with the non-PRP group at each time point. Conclusions Our study findings support the osteogenic capacity of autologous PRP. The results indicate that the use of autologous PRP is a simple and effective way to provide osteoinduction and improve bone regeneration for tissue-engineered bone reconstruction

Hydrogenation of Styrene-Butadiene Rubber Catalyzed by Tris(triisopropylphosphine)hydridorhodium(I)

The hydrogenation of C=C bonds in styrene−butadiene rubber (SBR), catalyzed by RhH(P(i-Pr)3)3, was experimentally investigated. Tris(triisopropylphosphine)hydridorhodium(I), RhH(P(i-Pr)3)3 (i-Pr=CH(CH3)2) was prepared by using rhodium chloride (RhCl3), tetrahydrofuran (THF), triisopropylphosphine (P(i-Pr)3) and a sodium mercury amalgam. The effect of catalyst/polymer ratio, reaction temperature, and hydrogen pressure on the reactivity of the catalytic system has been studied. The optimal experimental condition was obtained. The hydrogenated styrene-butadiene rubber (HSBR) was analyzed by FT-IR and 1H-NMR. In the absence of any additives, the conversion of C=C bonds in SBR could easily reach 95% in a short period of time, and no obvious cross-linking was observed. The dynamic properties of SBR did not change after the hydrogenation of the unsaturated C=C bonds. A preliminary reaction mechanism was also proposed. This study provides a new route, not only for the chemical modification of SBR by using a rhodium complex but also for the hydrogenation of other unsaturated polymers, such as diene-based rubbers