87 research outputs found

    RLTF: Reinforcement Learning from Unit Test Feedback

    Full text link
    The goal of program synthesis, or code generation, is to generate executable code based on given descriptions. Recently, there has been an increasing number of studies employing reinforcement learning (RL) to improve the performance of large language models (LLMs) for code. However, these RL methods have only used offline frameworks, limiting their exploration of new sample spaces. Additionally, current approaches that utilize unit test signals are rather simple, not accounting for specific error locations within the code. To address these issues, we proposed RLTF, i.e., Reinforcement Learning from Unit Test Feedback, a novel online RL framework with unit test feedback of multi-granularity for refining code LLMs. Our approach generates data in real-time during training and simultaneously utilizes fine-grained feedback signals to guide the model towards producing higher-quality code. Extensive experiments show that RLTF achieves state-of-the-art performance on the APPS and the MBPP benchmarks. Our code can be found at: https://github.com/Zyq-scut/RLTF

    ELK4 exerts opposite roles in cytokine/chemokine production and degranulation in activated mast cells

    Get PDF
    The proliferative potential of mast cells after activation for 3-4h was found to be decreased, which suggests that mast cell degranulation and cell proliferation are differentially regulated. ELK4, a member of the ternary complex factor (TCF) subfamily of Ets transcription factors, is one of the downstream effectors of MAPK signaling that is critical for cell proliferation. And Elk4 has been identified to be vital for macrophage activation in response to zymosan and the transcriptional response to 12-O-tetrade canoyl phorbol-13-acetate (TPA) stimulation in fibroblast. However, the effect of ELK4 on the mast cell transcriptional response to FcϵRI and GPCR mediated activation and its potential functional significance in mast cells remain unclear. Here, we showed that ELK4 expression is downregulated in activated mast cells. Elk4 knockout suppresses cell proliferation and impedes the cell cycle in bone marrow-derived mast cells (BMMCs), which is associated with decreased transcription of cell cycle genes. Additionally, the transcriptional activation of cytokines and chemokines is diminished while mast cell degranulation is enhanced in Elk4 knockout BMMCs. Mechanistically, ELK4 might positively modulate Hdc, Ccl3 and Ccl4 transcription by interacting with MITF and negatively regulate the transcription of degranulation-related genes by complexing with SIRT6. Overall, our study identifies a new physiological role of the transcription factor ELK4 in mast cell proliferation and activation

    A genome-wide association study identifies GRK5 and RASGRP1 as type 2 diabetes loci in Chinese Hans.

    Get PDF
    Substantial progress has been made in identification of type 2 diabetes (T2D) risk loci in the past few years, but our understanding of the genetic basis of T2D in ethnically diverse populations remains limited. We performed a genome-wide association study and a replication study in Chinese Hans comprising 8,569 T2D case subjects and 8,923 control subjects in total, from which 10 single nucleotide polymorphisms were selected for further follow-up in a de novo replication sample of 3,410 T2D case and 3,412 control subjects and an in silico replication sample of 6,952 T2D case and 11,865 control subjects. Besides confirming seven established T2D loci (CDKAL1, CDKN2A/B, KCNQ1, CDC123, GLIS3, HNF1B, and DUSP9) at genome-wide significance, we identified two novel T2D loci, including G-protein-coupled receptor kinase 5 (GRK5) (rs10886471: P = 7.1 × 10(-9)) and RASGRP1 (rs7403531: P = 3.9 × 10(-9)), of which the association signal at GRK5 seems to be specific to East Asians. In nondiabetic individuals, the T2D risk-increasing allele of RASGRP1-rs7403531 was also associated with higher HbA(1c) and lower homeostasis model assessment of β-cell function (P = 0.03 and 0.0209, respectively), whereas the T2D risk-increasing allele of GRK5-rs10886471 was also associated with higher fasting insulin (P = 0.0169) but not with fasting glucose. Our findings not only provide new insights into the pathophysiology of T2D, but may also shed light on the ethnic differences in T2D susceptibility

    Theoretical calculation of cesium deposition and co-deposition with electronegative elements on the plasma grid in negative ion sources

    Get PDF
    We studied the work function of cesium deposition and co-deposition with the electronegative element on the plasma grid (PG) using the first-principles calculations. The impurity particles may exist in the background plasma and vacuum chamber wall, and the work function of the PG will be affected. The results indicate that the minimum work functions of pure cesium deposition on Mo (110), W (110), and Mo (112) are reached at a partial monolayer. They are 1.66 eV (σ = 0.56 θ), 1.69 eV (σ = 0.75 θ), and 1.75 eV (σ = 0.88 θ), respectively. An appropriate co-deposition model consisting of cesium with electronegative elements can further decrease the work function. The coverage of cesium and electronegative elements are both 0.34 θ in all the co-deposition models. The F-Cs co-deposition model where the Cs atom and F atom are aligned along the surface normal obtains the lowest work function. They are 1.31 eV for F-Cs on Mo (110), and 1.23 eV for F-Cs on W (110), respectively. The change in work function is linearly related to the change in dipole moment density with a slope of −167.03 VÅ. For pure cesium deposition, two factors control the change in dipole-moment density, one is the electron transfer between adsorbates and the substrate, and another one is the restructuring of surface atoms. There are two additional factors for the co-deposition model. One is the intrinsic dipole moment of the double layer, the other is the angle between the intrinsic dipole moment and the surface. The latter two factors play important roles in increasing the total dipole moment

    Insights into salt tolerance from the genome of Thellungiella salsuginea

    Get PDF
    Thellungiella salsuginea, a close relative of Arabidopsis, represents an extremophile model for abiotic stress tolerance studies. We present the draft sequence of the T. salsuginea genome, assembled based on ∼134-fold coverage to seven chromosomes with a coding capacity of at least 28,457 genes. This genome provides resources and evidence about the nature of defense mechanisms constituting the genetic basis underlying plant abiotic stress tolerance. Comparative genomics and experimental analyses identified genes related to cation transport, abscisic acid signaling, and wax production prominent in T. salsuginea as possible contributors to its success in stressful environments

    AQ Factor Analysis

    No full text
    Testing a theory-driven factor structure of the Autism-Spectrum Quotien
    • …
    corecore