RaLLe: A Framework for Developing and Evaluating Retrieval-Augmented Large Language Models

Retrieval-augmented large language models (R-LLMs) combine pre-trained large language models (LLMs) with information retrieval systems to improve the accuracy of factual question-answering. However, current libraries for building R-LLMs provide high-level abstractions without sufficient transparency for evaluating and optimizing prompts within specific inference processes such as retrieval and generation. To address this gap, we present RaLLe, an open-source framework designed to facilitate the development, evaluation, and optimization of R-LLMs for knowledge-intensive tasks. With RaLLe, developers can easily develop and evaluate R-LLMs, improving hand-crafted prompts, assessing individual inference processes, and objectively measuring overall system performance quantitatively. By leveraging these features, developers can enhance the performance and accuracy of their R-LLMs in knowledge-intensive generation tasks. We open-source our code at https://github.com/yhoshi3/RaLLe.Comment: 18 pages, 2 figures, see https://youtu.be/JYbm75qnfTg for the demonstration screencas

SimplyRetrieve: A Private and Lightweight Retrieval-Centric Generative AI Tool

Large Language Model (LLM) based Generative AI systems have seen significant progress in recent years. Integrating a knowledge retrieval architecture allows for seamless integration of private data into publicly available Generative AI systems using pre-trained LLM without requiring additional model fine-tuning. Moreover, Retrieval-Centric Generation (RCG) approach, a promising future research direction that explicitly separates roles of LLMs and retrievers in context interpretation and knowledge memorization, potentially leads to more efficient implementation. SimplyRetrieve is an open-source tool with the goal of providing a localized, lightweight, and user-friendly interface to these sophisticated advancements to the machine learning community. SimplyRetrieve features a GUI and API based RCG platform, assisted by a Private Knowledge Base Constructor and a Retrieval Tuning Module. By leveraging these capabilities, users can explore the potential of RCG for improving generative AI performance while maintaining privacy standards. The tool is available at https://github.com/RCGAI/SimplyRetrieve with an MIT license.Comment: 12 pages, 6 figure

Efficacy and tolerability of tocilizumab in rheumatoid arthritis patients seen in daily clinical practice in Japan: results from a retrospective study (REACTION study)

Tocilizumab, a humanized monoclonal antibody to the interleukin 6 (IL-6) receptor, was approved for use as rheumatoid arthritis (RA) therapy in Japan in 2008, but its efficacy and tolerability in daily practice has not yet been reported. We report the results of a multicenter retrospective study on the efficacy and safety of tocilizumab involving all patients (n = 229) who were started on tocilizumab therapy at three rheumatology institutes in Japan from April 2008 through to March 2009. Tocilizumab was infused every 4 weeks at a dose of 8 mg/kg according to the drug labeling. Among the 229 patients, 55% concomitantly received methotrexate (MTX) and 63% had previously received anti-tumor necrosis factor (TNF) therapy. Average disease activity score (DAS) 28 of all 229 patients significantly decreased from 5.70 to 3.25 after 24 weeks of therapy. A European League Against Rheumatism (EULAR) good response and DAS28 remission was achieved in 57.4 and 40.7% of the patients, respectively, at 24 weeks. White blood cell counts significantly decreased and liver enzymes and total cholesterol slightly but significantly increased; however, liver enzyme levels did not increase in patients without MTX. Tocilizumab was discontinued in 47 cases (20.5%) due to lack of efficacy (5.2%), adverse events (11.4%), and other reasons (3.9%). The overall retention rate at 24 weeks was 79.5%. Based on these results, we conclude that tocilizumab therapy in daily rheumatology practice appears to be highly efficacious and well tolerated among active RA patients, including the anti-TNF therapy-refractory population. Tocilizumab infusion is therefore applicable not only as an alternative approach for anti-TNF therapy-resistant patients, but also as primary biologic therapy for active RA patients

Preventive effect of statin pretreatment on contrast-induced acute kidney injury in patients undergoing coronary angioplasty: Propensity score analysis from a multicenter registry

BackgroundThe prophylactic benefit of statins in reducing the incidence of contrast-induced acute kidney injury (CI-AKI) has been investigated in several studies with conflicting results. We sought to investigate whether statin pretreatment prevents CI-AKI in coronary artery disease (CAD) patients undergoing percutaneous coronary intervention (PCI).MethodsA total of 2198 CAD patients who underwent PCI, except for those undergoing dialysis or who died within 7 days after angioplasty, were analyzed from the ICAS (Ibaraki Cardiovascular Assessment Study) multicenter registry. Analyzed subjects were divided into 2 groups according to statin pretreatment: statin pretreatment (n = 839) and non-statin pretreatment (n = 1359). Selection bias of statin pretreatment was adjusted by propensity score-matching method: pretreatment statin (n = 565) and non-statin pretreatment (n = 565). CI-AKI was defined as an increase in serum creatinine of ≥ 25% or 0.5 mg/dl from baseline within 1 week of contrast medium exposure.ResultsA total of 192 (8.7%) patients developed CI-AKI. No significant differences were observed in baseline patient characteristics between the statin and non-statin pretreatment groups after propensity score matching. In the propensity score-matched groups, the incidence of CI-AKI was significantly lower in patients with statin pretreatment than in those without statin pretreatment (3.5% vs.10.6%, odds ratio [OR]: 0.31, 95% confidence interval [CI]: 0.18–0.52, P < 0.001). Multivariate logistic regression analysis showed that statin pretreatment remained an independent negative predictor of CI-AKI (OR: 0.31, 95% CI: 0.18–0.53, P < 0.001) among propensity score-matched subjects.ConclusionsStatin pretreatment was associated with a significant decrease in the risk of CI-AKI in CAD patients undergoing PCI in the ICAS Registry

Anatomical atlas-guided diffuse optical tomography of brain activation

We describe a neuroimaging protocol that utilizes an anatomical atlas of the human head to guide diffuse optical tomography of human brain activation. The protocol is demonstrated by imaging the hemodynamic response to median-nerve stimulation in three healthy subjects, and comparing the images obtained using a head atlas with the images obtained using the subject-specific head anatomy. The results indicate that using the head atlas anatomy it is possible to reconstruct the location of the brain activation to the expected gyrus of the brain, in agreement with the results obtained with the subject-specific head anatomy. The benefits of this novel method derive from eliminating the need for subject-specific head anatomy and thus obviating the need for a subject-specific MRI to improve the anatomical interpretation of diffuse optical tomography images of brain activation.National Institutes of Health (U.S.) (U54-EB-005149)National Institutes of Health (U.S.) (P41-RR14075)National Institutes of Health (U.S.) (P41-RR13218

Sound to Language: Different Cortical Processing for First and Second Languages in Elementary School Children as Revealed by a Large-Scale Study Using fNIRS

A large-scale study of 484 elementary school children (6–10 years) performing word repetition tasks in their native language (L1-Japanese) and a second language (L2-English) was conducted using functional near-infrared spectroscopy. Three factors presumably associated with cortical activation, language (L1/L2), word frequency (high/low), and hemisphere (left/right), were investigated. L1 words elicited significantly greater brain activation than L2 words, regardless of semantic knowledge, particularly in the superior/middle temporal and inferior parietal regions (angular/supramarginal gyri). The greater L1-elicited activation in these regions suggests that they are phonological loci, reflecting processes tuned to the phonology of the native language, while phonologically unfamiliar L2 words were processed like nonword auditory stimuli. The activation was bilateral in the auditory and superior/middle temporal regions. Hemispheric asymmetry was observed in the inferior frontal region (right dominant), and in the inferior parietal region with interactions: low-frequency words elicited more right-hemispheric activation (particularly in the supramarginal gyrus), while high-frequency words elicited more left-hemispheric activation (particularly in the angular gyrus). The present results reveal the strong involvement of a bilateral language network in children’s brains depending more on right-hemispheric processing while acquiring unfamiliar/low-frequency words. A right-to-left shift in laterality should occur in the inferior parietal region, as lexical knowledge increases irrespective of language

Relationship between monoclonal gammopathy of undetermined significance and radiation exposure in Nagasaki atomic bomb survivors.

Radiation exposure is a possible predisposing factor for monoclonal gammopathy of undetermined significance (MGUS), but the association has been uncertain. We investigated the relationship between radiation exposure and MGUS prevalence by using data from the M-protein screening for Nagasaki atomic bomb survivors between 1988 and 2004. Radiation exposure was assessed by exposure distance from the hypocenter and exposure radiation dose. We computed prevalence ratios (PRs) and the 95% confidence intervals (CIs) adjusting for exposure age and sex. A total of 1082 cases of MGUS were identified from 52 525 participants. MGUS prevalence was significantly higher in people exposed at distance within 1.5 km than beyond 3.0 km (PR, 1.4; 95% CI, 1.1-1.9) among those exposed at age 20 years or younger, but it was not found among those exposed at age 20 years or older. MGUS prevalence was also significantly higher in people exposed to more than 0.1 Gy than those exposed to less than 0.01 Gy (PR, 1.7; 95% CI, 1.0-2.8) among those exposed at age 20 years or younger. Thus, people exposed at younger age exhibited a significantly high risk of MGUS when exposed to a high radiation dose. There was no clear association between radiation exposure and the malignant progression of MGUS. Further detailed analysis is needed

Hemodynamic Effects of Positive end-expiratory Pressure on Right Ventricular Diastolic Function in Patients with Acute Myocardial Infarction

The effects of positive end-expiratory pressure (PEEP) on the right ventricular (RV) diastolic function in patients with congestive heart failure (CHF) due to acute myocardial infarction (AMI) are unknown. The aim in this study was to investigate PEEP associated variations in RV diastolic function in CHF due to AMI. The subjects comprised the control group (26 subjects) and the AMI group (36 subjects) classified as 20 patients with pulmonary capillary wedge pressure (PCWP) < 18 mmHg (CHF-low PCWP group) and 16 patients with PCWP≧18mmHg (CHF-high PCWP group). PEEP was applied for 30 minutes at 0, 5, 10 and 15 cmH_20. Two-dimensional echocardiography with continuous and pulse wave Doppler studies was performed. RV diastolic functional parameters included the ratio of peak early tricuspid valve filling and peak atrial filling velocities, the decelation time of the tricuspid E valve and the RV isovolumic relaxation time. In the control and CHF-low PCWP groups, right atrial pressure, mean pulmonary arterial pressure (mPAP), total pulmonary resistance (TPR) and systemic vascular resistance (SVR) increased, output (CO) decreased and RV diastolic functional parameters worsened significantly at the transition from 10 to 15 cmH_20 PEEP. In the CHF-high PCWP group, mPAP, TPR and SVR decreased, while CO increased and RV diastolic functional parameters improved significantly at the transition from 10 to 15 cmH_20 PEEP. From these findings, it is clear that PEEP induced hemodynamic deterioration and reduces RV diastolic function in intact and mildly failing hearts. On the other hand, in severely failing hearts, PEEP effers hemodynamic improvement and ameliorates RV diastolic function. It appears possible to predict responses to PEEP by determining RV diastolic function in CHF. Therefore, we conclude that evaluation of the RV diastolic function during PEEP is highly important in terms of recognizing the effectiveness of PEEP therapy in CHF