NLPBench: Evaluating Large Language Models on Solving NLP Problems

Recent developments in large language models (LLMs) have shown promise in enhancing the capabilities of natural language processing (NLP). Despite these successes, there remains a dearth of research dedicated to the NLP problem-solving abilities of LLMs. To fill the gap in this area, we present a unique benchmarking dataset, NLPBench, comprising 378 college-level NLP questions spanning various NLP topics sourced from Yale University's prior final exams. NLPBench includes questions with context, in which multiple sub-questions share the same public information, and diverse question types, including multiple choice, short answer, and math. Our evaluation, centered on LLMs such as GPT-3.5/4, PaLM-2, and LLAMA-2, incorporates advanced prompting strategies like the chain-of-thought (CoT) and tree-of-thought (ToT). Our study reveals that the effectiveness of the advanced prompting strategies can be inconsistent, occasionally damaging LLM performance, especially in smaller models like the LLAMA-2 (13b). Furthermore, our manual assessment illuminated specific shortcomings in LLMs' scientific problem-solving skills, with weaknesses in logical decomposition and reasoning notably affecting results

Efficient Bi-Level Optimization for Recommendation Denoising

The acquisition of explicit user feedback (e.g., ratings) in real-world recommender systems is often hindered by the need for active user involvement. To mitigate this issue, implicit feedback (e.g., clicks) generated during user browsing is exploited as a viable substitute. However, implicit feedback possesses a high degree of noise, which significantly undermines recommendation quality. While many methods have been proposed to address this issue by assigning varying weights to implicit feedback, two shortcomings persist: (1) the weight calculation in these methods is iteration-independent, without considering the influence of weights in previous iterations, and (2) the weight calculation often relies on prior knowledge, which may not always be readily available or universally applicable. To overcome these two limitations, we model recommendation denoising as a bi-level optimization problem. The inner optimization aims to derive an effective model for the recommendation, as well as guiding the weight determination, thereby eliminating the need for prior knowledge. The outer optimization leverages gradients of the inner optimization and adjusts the weights in a manner considering the impact of previous weights. To efficiently solve this bi-level optimization problem, we employ a weight generator to avoid the storage of weights and a one-step gradient-matching-based loss to significantly reduce computational time. The experimental results on three benchmark datasets demonstrate that our proposed approach outperforms both state-of-the-art general and denoising recommendation models. The code is available at https://github.com/CoderWZW/BOD.Comment: 11pages, 5 figures, 6 table

Berberine Improves Insulin Sensitivity by Inhibiting Fat Store and Adjusting Adipokines Profile in Human Preadipocytes and Metabolic Syndrome Patients

Berberine is known to inhibit the differentiation of 3T3-L1 cells in vitro, improve glycemic control, and attenuate dyslipidemia in clinical study. The aim of this study was to investigate the effects of berberine on preadipocytes isolated from human omental fat and in metabolic syndrome patients treated with berberine for 3 months. We have shown that treatment with 10 μM berberine resulted in a major inhibition of human preadipocyte differentiation and leptin and adiponectin secretion accompanied by downregulation of PPARγ2, C/EBPα, adiponectin, and leptin mRNA expression. After 3 months of treatment, metabolic syndrome patients showed decrease in their BMI (31.5 ± 3.6 versus 27.4 ± 2.4 kg/m2) and leptin levels (8.01 versus 5.12 μg/L), as well as leptin/adiponectin ratio and HOMA-IR. These results suggest that berberine improves insulin sensitivity by inhibiting fat store and adjusting adipokine profile in human preadipocytes and metabolic syndrome patients

Au@h-Al2O3 Analogic Yolk–Shell Nanocatalyst for Highly Selective Synthesis of Biomass-Derived D-xylonic Acid via Regulation of Structure Effects

Selective oxidation of biomass-based monosaccharides into value-added sugar acids is highly desired, but limited success of producing D-xylonic acid has been achieved. Herein, we report an efficient catalyst system, viz., Au nanoparticles anchored on the inner walls of hollow Al2O3 nanospheres (Au@h- Al2O3), which could catalyze the selective oxidation of D-xylose into D-xylonic acid under base-free conditions. The mesoporous Al2O3 shell as the adsorbent first adsorbed D-xylose. Then, the interface of Au nanoparticles and Al2O3 as active sites spontaneously dissociated O2, and the exposed Au nanoparticle surface as the catalytic site drove the transformation. With this catalyst system, the valuable D-xylonic acid was produced with excellent yields in the aerobic oxidation of D-xylose. Extensive investigation showed that Au@h- Al2O3 is an efficient catalyst with high stability and recyclability

White Matter Imaging Correlates of Early Cognitive Impairment Detected by the Montreal Cognitive Assessment after Transient Ischemic Attack and Minor Stroke

BACKGROUND AND PURPOSE:  Among screening tools for cognitive impairment in large cohorts, the Montreal Cognitive assessment (MoCA) appears to be more sensitive to early cognitive impairment than the Mini-Mental State Examination (MMSE), particularly after transient ischemic attack (TIA) or minor stroke. We reasoned that if MoCA-detected early cognitive impairment is pathologically significant, then it should be specifically associated with the presence of white matter hyperintensities (WMH) and reduced fractional anisotropy (FA) on MRI. METHODS: Consecutive eligible patients with TIA or minor stroke (Oxford Vascular Study) underwent MRI and cognitive assessment. We correlated MoCA and MMSE scores with WMH and FA, then specifically studied patients with low MoCA and normal MMSE. RESULTS: Among 400 patients, MoCA and MMSE scores were significantly correlated (all p<0.001) with WMH volumes (rMoCA=-0.336, rMMSE=-0.297) and FA (rMoCA=0.409, rMMSE=0.369), and -on voxel-wise analyses- with WMH in frontal white matter and reduced FA in almost all white matter tracts. However, only the MoCA was independently correlated with WMH volumes (r=-0.183, p<0.001), average FA values (r=0.218, p<0.001), and voxel-wise reduced FA in anterior tracts after controlling for the MMSE. In addition, patients with low MoCA but normal MMSE (N=57) had higher WMH volumes (t=3.1,p=0.002), lower average FA (t=-4.0,p<0.001), and lower voxel-wise FA in almost all white matter tracts than those with normal MoCA and MMSE (N=238). CONCLUSIONS: In patients with TIA or minor stroke, early cognitive impairment detected with the MoCA but not with the MMSE was independently associated with white matter damage on MRI, particularly reduced FA

Age-Specific Associations of Renal Impairment With Magnetic Resonance Imaging Markers of Cerebral Small Vessel Disease in Transient Ischemic Attack and Stroke

published_or_final_versio

Risks of recurrent stroke and all serious vascular events after spontaneous intracerebral haemorrhage: pooled analyses of two population-based studies

BACKGROUND: Patients with stroke due to spontaneous (non-traumatic) intracerebral haemorrhage (ICH) are at risk of recurrent ICH, ischaemic stroke, and other serious vascular events. We aimed to analyse these risks in population-based studies and compare them with the risks in RESTART, which assessed antiplatelet therapy after ICH. METHODS: We pooled individual patient data from two prospective, population-based inception cohort studies of all patients with an incident firs-in-a-lifetime ICH in Oxfordshire, England (Oxford Vascular Study; April 1, 2002, to Sept 28, 2018) and Lothian, Scotland, UK (Lothian Audit of the Treatment of Cerebral Haemorrhage; June 1, 2010, to May 31, 2013). We quantified the absolute and relative risks of recurrent ICH, ischaemic stroke, or any serious vascular event (non-fatal stroke, non-fatal myocardial infarction, or vascular death), stratified by ICH location (lobar vs non-lobar) and comorbid atrial fibrillation (AF). We compared pooled event rates with those after allocation to avoid antiplatelet therapy in RESTART. FINDINGS: Among 674 patients (mean age 74·7 years [SD 12·6], 320 [47%] men) with 1553 person-years of follow-up, 46 recurrent ICHs (event rate 3·2 per 100 patient-years, 95% CI 2·0-5·1) and 25 ischaemic strokes (1·7 per 100 patient-years, 0·8-3·3) were reported. Patients with lobar ICH (n=317) had higher risk of recurrent ICH (5·1 per 100 patient-years, 95% CI 3·6-7·2) than patients with non-lobar ICH (n=355; 1·8 per 100 patient-years, 1·0-3·3; hazard ratio [HR] 3·2, 95% CI 1·6-6·3; p=0·0010), but there was no evidence of a difference in the risk of ischaemic stroke (1·8 per 100 patient-years, 1·0-3·2, vs 1·6 per 100 patient-years, 0·6-4·4; HR 1·1, 95% CI 0·5-2·8). Conversely, there was no evidence of a difference in recurrent ICH rate in patients with AF (n=147; 3·3 per 100 patient-years, 95% CI 1·0-10·7) compared with those without (n=526; 3·2 per 100 patient-years, 2·2-4·7; HR 0·9, 95% CI 0·4-2·1), but the risk of ischaemic stroke was higher with AF (6·3 per 100 patient-years, 3·7-10·9, vs 0·7 per 100 patient-years, 0·1-5·6; HR 8·2, 3·3-20·3; p<0·0001), resulting in patients with AF having a higher risk of all serious vascular events than patients without AF (15·5 per 100 patient-years, 10·0-24·1, vs 6·8 per 100 patient-years, 3·6-12·5; HR 1·78, 95% CI 1·16-2·74; p=0·0090). Only for patients with lobar ICH without comorbid AF was the risk of recurrent ICH greater than the risk of ischaemic stroke (5·2 per 100 patient-years, 95% CI 3·6-7·5, vs 0·9 per 100 patient-years, 0·2-4·8; p=0·00034). Comparing data from the pooled population-based studies with that from patients allocated to not receive antiplatelet therapy in RESTART, there was no evidence of a difference in the rate of recurrent ICH (3·5 per 100 patient-years, 95% CI 1·9-6·0, vs 4·4 per 100 patient-years, 2·6-6·1) or ischaemic stroke (3·4 per 100 patient-years, 1·9-5·9, vs 5·3 per 100 patient-years, 3·3-7·2). INTERPRETATION: The risks of recurrent ICH, ischaemic stroke, and all serious vascular events after ICH differ by ICH location and comorbid AF. These data enable risk stratification of patients in clinical practice and ongoing randomised trials. FUNDING: UK Medical Research Council, Stroke Association, British Heart Foundation, Wellcome Trust, and the National Institute for Health Research Oxford Biomedical Research Centre

European Stroke Organisation (ESO) guideline on pharmacological interventions for long-term secondary prevention after ischaemic stroke or transient ischaemic attack

Recurrent stroke affects 9-15% of people after 1 year. This European Stroke Organisation (ESO) guideline provides evidence-based recommendations on pharmacological management of blood pressure (BP), diabetes mellitus, lipid levels and antiplatelet therapy for the prevention of recurrent stroke and other important outcomes in people with ischaemic stroke or transient ischaemic attack (TIA). It does not cover interventions for specific causes of stroke, including treatment of cardioembolic stroke, which are addressed in other guidelines. This guideline was developed through ESO standard operating procedures and the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) methodology. The working group identified clinical questions, selected outcomes, performed systematic reviews, with meta-analyses where appropriate, and made evidence-based recommendations, with expert consensus statements where evidence was insufficient to support a recommendation. To reduce the long-term risk of recurrent stroke or other important outcomes after ischaemic stroke or TIA, we recommend: BP lowering treatment to a target of &lt;130/80 mmHg, except in subgroups at increased risk of harm; HMGCoA-reductase inhibitors (statins) and targeting a low density lipoprotein level of &lt;1.8 mmol/l (70 mg/dl); avoidance of dual antiplatelet therapy with aspirin and clopidogrel after the first 90 days; to not give direct oral anticoagulant drugs (DOACs) for embolic stroke of undetermined source and to consider pioglitazone in people with diabetes or insulin resistance, after careful consideration of potential risks. In addition to the evidence-based recommendations, the majority of working group members supported: out-of-office BP monitoring; use of combination treatment for BP control; consideration of ezetimibe or PCSK9 inhibitors when lipid targets are not achieved; consideration of use of low-dose DOACs in addition to an antiplatelet in selected groups of people with coronary or peripheral artery disease; and aiming for an HbA1c level of &lt;53 mmol/mol (7%) in people with diabetes mellitus. These guidelines aim to standardise long-term pharmacological treatment to reduce the burden of recurrent stroke in Europe