DistillSpec: Improving Speculative Decoding via Knowledge Distillation

Speculative decoding (SD) accelerates large language model inference by employing a faster draft model for generating multiple tokens, which are then verified in parallel by the larger target model, resulting in the text generated according to the target model distribution. However, identifying a compact draft model that is well-aligned with the target model is challenging. To tackle this issue, we propose DistillSpec that uses knowledge distillation to better align the draft model with the target model, before applying SD. DistillSpec makes two key design choices, which we demonstrate via systematic study to be crucial to improving the draft and target alignment: utilizing on-policy data generation from the draft model, and tailoring the divergence function to the task and decoding strategy. Notably, DistillSpec yields impressive 10 - 45% speedups over standard SD on a range of standard benchmarks, using both greedy and non-greedy sampling. Furthermore, we combine DistillSpec with lossy SD to achieve fine-grained control over the latency vs. task performance trade-off. Finally, in practical scenarios with models of varying sizes, first using distillation to boost the performance of the target model and then applying DistillSpec to train a well-aligned draft model can reduce decoding latency by 6-10x with minimal performance drop, compared to standard decoding without distillation

Increased incidence of glomerulonephritis following spleno-renal shunt surgery in non-cirrhotic portal fibrosis

Increased incidence of glomerulonephritis following spleno-renal shunt surgery in non-cirrhotic portal fibrosis. In a prospective study of 200 non-cirrhotic portal fibrosis (NCPF) patients, 7% had mild proteinuria and their renal biopsies showed mild mesangial proliferative glomerulonephritis (mes-PGN). The remaining 93% biopsies were normal. However, following the insertion of a spleno-renal shunt (SRS) for portal hypertension 32% of these patients developed nephrotic syndrome in five years. Renal histology revealed mesangiocapillary glomerulonephritis (MCGN) (18.5%), mes-PGN (9%), minimal change nephropathy (3%), and chronic sclerosing GN (1.5%). Immunofluorescence showed granular deposition of IgA and C3. IgA2 was the predominant form of Ig in the glomerular deposits, indicating that IgA in the immune complexes was derived from the gastrointestinal tract. Electron microscopy revealed electron dense deposits in the mesangium. In contrast to the NCPF patients who underwent a SRS for portal hypertension, the 200 patients in our study who underwent spleno-renal shunting because of extra hepatic portal obstruction did not have renal disease, nor did they develop renal disease during the five-year post-operative follow-up. Fifty percent of the glomerulonephritis (GN) in the NCPF group progressed to renal failure in five years; 46.6% continued to have proteinuria. Low serum complement, C3 (40%) and circulating immune complexes (14.8%) were detected in the glomerulonephritis group. Our study shows that: (i) there is a high rate of the occurrence of GN following SRS in NCPF patients, but not in those with normal livers; (ii) the type of GN is primarily IgA nephropathy; and (iii) the GN could be the result of defective hepatic reticuloendothelial function in the NCPF group that is worsened by the shunting procedure

Dairy food consumption is beneficially linked with iodine status in US children and adults: NHANES 2001 – 2018

Abstract Objectives: The objective of this study was to determine the association between the consumption of dairy foods with urinary iodine concentration (UIC) and iodine deficiency risk in a nationally representative sample of the US population. Design, Setting and Participants: 24-hour dietary recall data and laboratory data for UIC (μg/L) from subjects 2+ years old US population participating in National Health and Nutrition Examination Surveys (NHANES) 2001-2018 were used (N = 26,838) for analyses after adjusting for demographic covariates. Significant associations were assessed at P <0.05. Results: Mean intakes of total dairy were 2.21, 2.17 and 1.70 cup equivalents (cup eq) among those 2-8, 9-18 and 19+ years respectively. Of the dairy components, intake of milk was highest followed cheese and yogurt for all age groups. Total dairy intakes were positively associated with UIC among those 2-8 years (β=29.9±9.9 μg/L urine/cup eq dairy) and 9-18 years (β=26.0±4.8 μg/L urine/cup eq dairy) but not associated among those 19+ years. Total dairy intakes were associated with lowered risks (30%, 21% and 20% for among 2-8, 9-18 and 19+ years respectively) of being classified as iodine insufficient (UIC<100 μg/L) or lowered risk (47%, 30% and 26% among 2-8, 9-18 and 19+ years respectively) of being classified as iodine severely deficient (UIC<20 μg/L). Conclusions: The results indicate that dairy foods are beneficially associated with UIC and lowered iodine deficiency risk

Sex differences in proteomic correlates of coronary microvascular dysfunction among patients with heart failure and preserved ejection fraction

Aims: Little information is available on sex differences in coronary microvascular dysfunction (CMD) in heart failure with preserved ejection fraction (HFpEF). We investigated sex-specific proteomic profiles associated with CMD in patients with HFpEF. Methods and results: Using the prospective multinational PROMIS-HFpEF study (Prevalence of Microvascular Dysfunction in HFpEF; n = 182; 54.6% women), we compared clinical and biomarker correlates of CMD (defined as coronary flow reserve [CFR] <2.5) between men and women with HFpEF. We used lasso penalized regression to analyse 242 biomarkers from high-throughput proximity extension assays, adjusting for age, body mass index, creatinine, smoking and study site. The prevalence of CMD was similarly high in men and women with HFpEF (77% vs. 70%; p = 0.27). Proteomic correlates of CFR differed by sex, with 10 versus 16 non-overlapping biomarkers independently associated with CFR in men versus women, respectively. In men, proteomic correlates of CFR included chemokine ligand 20, brain natriuretic peptide, proteinase 3, transglutaminase 2, pregnancy-associated plasma protein A and tumour necrosis factor receptor superfamily member 14. Among women, the strongest proteomic correlates with CFR were insulin-like growth factor-binding protein 1, phage shock protein D, CUB domain-containing protein 1, prostasin, decorin, FMS-like tyrosine kinase 3, ligand growth differentiation factor 15, spondin-1, delta/notch-like epidermal growth factor-related receptor and tumour necrosis factor receptor superfamily member 13B. Pathway analyses suggested that CMD was related to the inflammation-mediated chemokine and cytokine signalling pathway among men with HFpEF, and the P13-kinase and transforming growth factor-beta signalling pathway among women with HFpEF. Conclusion: While the prevalence of CMD among men and women with HFpEF is similar, the drivers of microvascular dysfunction may differ by sex. The current inflammatory paradigm of CMD in HFpEF potentially predominates in men, while derangement in ventricular remodelling and fibrosis may play a more important role in women

Sex differences in proteomic correlates of coronary microvascular dysfunction among patients with heart failure and preserved ejection fraction

Aims Little information is available on sex differences in coronary microvascular dysfunction (CMD) in heart failure with preserved ejection fraction (HFpEF). We investigated sex-specific proteomic profiles associated with CMD in patients with HFpEF. Methods and results Using the prospective multinational PROMIS-HFpEF study (Prevalence of Microvascular Dysfunction in HFpEF; n = 182; 54.6% women), we compared clinical and biomarker correlates of CMD (defined as coronary flow reserve [CFR] Conclusion While the prevalence of CMD among men and women with HFpEF is similar, the drivers of microvascular dysfunction may differ by sex. The current inflammatory paradigm of CMD in HFpEF potentially predominates in men, while derangement in ventricular remodelling and fibrosis may play a more important role in women.</p

Impact of Sequencing Targeted Therapies With High-dose Interleukin-2 Immunotherapy: An Analysis of Outcome and Survival of Patients With Metastatic Renal Cell Carcinoma From an On-going Observational IL-2 Clinical Trial: PROCLAIM

BACKGROUND: This analysis describes the outcome for patients who received targeted therapy (TT) prior to or following high-dose interleukin-2 (HD IL-2). PATIENTS AND METHODS: Patients with renal cell carcinoma (n = 352) receiving HD IL-2 were enrolled in Proleukin RESULTS: Overall, there were 4% complete response (CR), 13% partial response (PR), 39% stable disease (SD), and 43% progressive disease (PD) with HD IL-2. The median overall survival (mOS) was not reached in patients with CR, PR, or SD, and was 15.5 months in patients with PD (median follow-up, 21 months). Sixty-one patients had prior TT before HD IL-2 with an overall response rate (ORR) to HD IL-2 of 19% (1 CR, 9 PR) and an mOS of 22.1 months. One hundred forty-nine patients received TT only after HD IL-2 with an mOS of 35.5 months. One hundred forty-two patients had no TT before or after HD IL-2, and mOS was not reached. The mOS was 8.5 months in PD patients who received HD IL-2 without follow-on TT and 29.7 months in PD patients who received follow-on TT after HD IL-2. CONCLUSIONS: HD IL-2 as sole front-line therapy, in the absence of added TT, shows extended clinical benefit (CR, PR, and SD). Patients with PD after HD IL-2 appear to benefit from follow-on TT. Patients who progressed on TT and received follow-on HD IL-2 experienced major clinical benefit. HD IL-2 therapy should be considered in eligible patients

Cytochrome P450 1A2 (CYP1A2) activity, mammographic density, and oxidative stress: a cross-sectional study

INTRODUCTION: Mammographically dense breast tissue is a strong predictor of breast cancer risk, and is influenced by both mitogens and mutagens. One enzyme that is able to affect both the mitogenic and mutagenic characteristics of estrogens is cytochrome P450 1A2 (CYP1A2), which is principally responsible for the metabolism of 17β-estradiol. METHODS: In a cross-sectional study of 146 premenopausal and 149 postmenopausal women, we examined the relationships between CYP1A2 activity, malondialdehyde (MDA) levels, and mammographic density. In vivo CYP1A2 activity was assessed by measuring caffeine metabolites in urine. Levels of serum and urinary MDA, and MDA–deoxyguanosine adducts in DNA were measured. Mammograms were digitized and measured using a computer-assisted method. RESULTS: CYP1A2 activity in postmenopausal women, but not in premenopausal women, was positively associated with mammographic density, suggesting that increased CYP1A2 activity after the menopause is a risk factor for breast cancer. In premenopausal women, but not in postmenopausal women, CYP1A2 activity was positively associated with serum and urinary MDA levels; there was also some evidence that CYP1A2 activity was more positively associated with percentage breast density when MDA levels were high, and more negatively associated with percentage breast density when MDA levels were low. CONCLUSION: These findings provide further evidence that variation in the activity level of enzymes involved in estrogen metabolism is related to levels of mammographic density and potentially to breast cancer risk