86 research outputs found

    ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Models

    Full text link
    Augmented Language Models (ALMs) blend the reasoning capabilities of Large Language Models (LLMs) with tools that allow for knowledge retrieval and action execution. Existing ALM systems trigger LLM thought processes while pulling observations from these tools in an interleaved fashion. Specifically, an LLM reasons to call an external tool, gets halted to fetch the tool's response, and then decides the next action based on all preceding response tokens. Such a paradigm, though straightforward and easy to implement, often leads to huge computation complexity from redundant prompts and repeated execution. This study addresses such challenges for the first time, proposing a modular paradigm ReWOO (Reasoning WithOut Observation) that detaches the reasoning process from external observations, thus significantly reducing token consumption. Comprehensive evaluations across six public NLP benchmarks and a curated dataset reveal consistent performance enhancements with our proposed methodology. Notably, ReWOO achieves 5x token efficiency and 4% accuracy improvement on HotpotQA, a multi-step reasoning benchmark. Furthermore, ReWOO demonstrates robustness under tool-failure scenarios. Beyond prompt efficiency, decoupling parametric modules from non-parametric tool calls enables instruction fine-tuning to offload LLMs into smaller language models, thus substantially reducing model parameters. Our illustrative work offloads reasoning ability from 175B GPT3.5 into 7B LLaMA, demonstrating the significant potential for truly efficient and scalable ALM systems

    Gentopia: A Collaborative Platform for Tool-Augmented LLMs

    Full text link
    Augmented Language Models (ALMs) empower large language models with the ability to use tools, transforming them into intelligent agents for real-world interactions. However, most existing frameworks for ALMs, to varying degrees, are deficient in the following critical features: flexible customization, collaborative democratization, and holistic evaluation. We present gentopia, an ALM framework enabling flexible customization of agents through simple configurations, seamlessly integrating various language models, task formats, prompting modules, and plugins into a unified paradigm. Furthermore, we establish gentpool, a public platform enabling the registration and sharing of user-customized agents. Agents registered in gentpool are composable such that they can be assembled together for agent collaboration, advancing the democratization of artificial intelligence. To ensure high-quality agents, gentbench, an integral component of gentpool, is designed to thoroughly evaluate user-customized agents across diverse aspects such as safety, robustness, efficiency, etc. We release gentopia on Github and will continuously move forward

    A Novel Role for GADD45\u3ci\u3eβ\u3c/i\u3e as a Mediator of \u3ci\u3eMMP-13\u3c/i\u3e Gene Expression during Chondrocyte Terminal Differentiation

    Get PDF
    The growth arrest and DNA damage-inducible 45β (GADD45β) gene product has been implicated in the stress response, cell cycle arrest, and apoptosis. Here we demonstrated the unexpected expression of GADD45β in the embryonic growth plate and uncovered its novel role as an essential mediator of matrix metalloproteinase-13 (MMP-13) expression during terminal chondrocyte differentiation. We identified GADD45β as a prominent early response gene induced by bone morphogenetic protein-2 (BMP-2) through a Smad1/Runx2-dependent pathway. Because this pathway is involved in skeletal development, we examined mouse embryonic growth plates, and we observed expression of Gadd45β mRNA coincident with Runx2 protein in prehypertrophic chondrocytes, whereas GADD45β protein was localized prominently in the nucleus in late stage hypertrophic chondrocytes where Mmp-13 mRNA was expressed. In Gadd45β−/− mouse embryos, defective mineralization and decreased bone growth accompanied deficient Mmp-13 and Col10a1 gene expression in the hypertrophic zone. Transduction of small interferin

    Prognostic Significance of miR-181b and miR-21 in Gastric Cancer Patients Treated with S-1/Oxaliplatin or Doxifluridine/Oxaliplatin

    Get PDF
    Background: The goal of this study is to evaluate the effectiveness of S-1/Oxaliplatin vs. Doxifluridine/Oxaliplatin regimen and to identify miRNAs as potential prognostic biomarkers in gastric cancer patients. The expression of candidate miRNAs was quantified from fifty-five late stage gastric cancer FFPE specimens. Experimental Design: Gastric cancer patients with KPS>70 were recruited for the trial. The control group was treated with 400 mg/twice/day Doxifluridine plus i.v. with Oxaliplatin at 130 mg/m 2/first day/4 week cycle. The testing group was treated with S-1 at 40 mg/twice/day/4 week cycle plus i.v. with Oxaliplatin at 130 mg/m 2/first day/4 week cycle. Total RNAs were extracted from normal and gastric tumor specimens. The levels of miRNAs were quantified using real time qRT-PCR expression analysis. Results: The overall objective response rate (CR+PR) of patients treated with S-1/Oxaliplatin was 33.3% (CR+PR) vs. 17.6% (CR+PR) with Doxifluridine/Oxaliplatin for advanced stage gastric cancer patients. The average overall survival for patients treated with S-1/Oxaliplatin was 7.80 month vs. 7.30 month with patients treated with Doxifluridine/Oxaliplatin. The expression of miR-181b (P = 0.022) and miR-21 (P = 0.0029) was significantly overexpressed in gastric tumors compared to normal gastric tissues. Kaplan-Meier survival analysis revealed that low levels of miR-21 expression (Log rank test, hazard ratio: 0.17, CI = 0.06-0.45; P = 0.0004) and miR-181b (Log rank test, hazard ratio: 0.37, CI = 0.16-0.87; P = 0.018) are closely associated with better patient's overall survival for both S-1 and Doxifluridine based regimens. Conclusion: Patients treated with S-1/Oxaliplatin had a better response than those treated with Doxifluridine/Oxaliplatin. miR-21 and miR-181b hold great potential as prognostic biomarkers in late stage gastric cancer. © 2011 Jiang et al

    An increased abundance of tumor-infiltrating regulatory t cells is correlated with the progression and prognosis of pancreatic ductal adenocarcinoma

    Get PDF
    CD4+CD25+Foxp3+ regulatory T cells (Tregs) can inhibit cytotoxic responses. Though several studies have analyzed Treg frequency in the peripheral blood mononuclear cells (PBMCs) of pancreatic ductal adenocarcinoma (PDA) patients using flow cytometry (FCM), few studies have examined how intratumoral Tregs might contribute to immunosuppression in the tumor microenvironment. Thus, the potential role of intratumoral Tregs in PDA patients remains to be elucidated. In this study, we found that the percentages of Tregs, CD4+ T cells and CD8+ T cells were all increased significantly in tumor tissue compared to control pancreatic tissue, as assessed via FCM, whereas the percentages of these cell types in PBMCs did not differ between PDA patients and healthy volunteers. The percentages of CD8 + T cells in tumors were significantly lower than in PDA patient PBMCs. In addition, the relative numbers of CD4+CD25+Foxp3+ Tregs and CD8+ T cells were negatively correlated in the tissue of PDA patients, and the abundance of Tregs was significantly correlated with tumor differentiation. Additionally, Foxp3+ T cells were observed more frequently in juxtatumoral stroma (immediately adjacent to the tumor epithelial cells). Patients showing an increased prevalence of Foxp3+ T cells had a poorer prognosis, which was an independent factor for patient survival. These results suggest that Tregs may promote PDA progression by inhibiting the antitumor immunity of CD8+ T cells at local intratumoral sites. Moreover, a high proportion of Tregs in tumor tissues may reflect suppressed antitumor immunity. Copyright: © 2014 Tang et al

    Enhancing Team Member Proactivity Through Career Calling and Mentoring: A Time-Lagged Study

    No full text
    Team member proactivity has become increasingly important for contemporary teams that seek to improve how they function. However, for team members, this proactive team-oriented behavior requires risk taking and a great amount of effort; therefore, organizations must encourage persistence in this behavior. This is the first study to propose that organizations can enhance team member proactivity when they help team members live out their individual callings by offering them mentoring. Our hypotheses are tested by using a multi-source and time-lagged study design with a sample of 296 Chinese employees and their direct supervisors. The results demonstrate the importance of adding career calling constructs as antecedents to the team member proactivity literature and suggest that organizational resources such as mentoring are needed to facilitate the link between team member proactivity and career calling.

    Study of Coating Weight and Utilization Rate in the Modification of Ground Calcium Carbonate

    No full text
    Ground calcium carbonate (GCC) was modified in this work using starch, sodium stearate, and sodium hexametaphosphate. The effects of reaction temperature and the dosage of sodium hexametaphosphate on the coating weight of modified GCC and the utilization rate were considered. The strength (tensile, burst, and tear) of papers filled with modified GCC vs. unmodified GCC was compared. The research showed that lower precipitation reaction temperature was conducive to the increase of modified GCC coating weight and the complex utilization rate. A proper dosage of sodium hexametaphosphate could effectively increase the coating weight of modified GCC and the complex utilization rate. Compared with unmodified GCC filled papers, modified GCC filled papers performed better with respect to paper strength, but the optical properties (brightness and opacity) showed the opposite trend

    Effect of Hydrodynamic Shear on Agglomerated Ground Calcium Carbonate Filler after Surface Modification with Starch and its Effects on Paper Properties

    No full text
    Ground calcium carbonate (GCC) was modified with starch, sodium stearate, and sodium hexametaphosphate prior to the papermaking process. This paper is focused on the effect of shear on the modified GCC and considers the impact of adding modified GCC into paper. The coating efficiency of starch on GCC was investigated in terms of the shear-tolerance of the agglomerated filler. Experimental results showed that the precipitation temperature and the amount of crosslinking agent, sodium hexametaphosphate, both were important relative to shear tolerance. Lower precipitation temperature was beneficial for the starch coating. Within a certain range, more sodium hexametaphosphate led to a stronger complex. The results showed that 1.5% (based on MGCC) of sodium hexametaphosphate and a precipitation temperature of 60 °C were the optimum conditions for shear tolerance
    • …
    corecore