BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed by resource-rich organizations and are frequently kept from the public. As a step towards democratizing this powerful technology, we present BLOOM, a 176B-parameter open-access language model designed and built thanks to a collaboration of hundreds of researchers. BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages (59 in total). We find that BLOOM achieves competitive performance on a wide variety of benchmarks, with stronger results after undergoing multitask prompted finetuning. To facilitate future research and applications using LLMs, we publicly release our models and code under the Responsible AI License

Efficacy and safety of sparsentan versus irbesartan in patients with IgA nephropathy (PROTECT): 2-year results from a randomised, active-controlled, phase 3 trial

BackgroundSparsentan, a novel, non-immunosuppressive, single-molecule, dual endothelin angiotensin receptor antagonist, significantly reduced proteinuria versus irbesartan, an angiotensin II receptor blocker, at 36 weeks (primary endpoint) in patients with immunoglobulin A nephropathy in the phase 3 PROTECT trial's previously reported interim analysis. Here, we report kidney function and outcomes over 110 weeks from the double-blind final analysis.MethodsPROTECT, a double-blind, randomised, active-controlled, phase 3 study, was done across 134 clinical practice sites in 18 countries throughout the Americas, Asia, and Europe. Patients aged 18 years or older with biopsy-proven primary IgA nephropathy and proteinuria of at least 1·0 g per day despite maximised renin–angiotensin system inhibition for at least 12 weeks were randomly assigned (1:1) to receive sparsentan (target dose 400 mg oral sparsentan once daily) or irbesartan (target dose 300 mg oral irbesartan once daily) based on a permuted-block randomisation method. The primary endpoint was proteinuria change between treatment groups at 36 weeks. Secondary endpoints included rate of change (slope) of the estimated glomerular filtration rate (eGFR), changes in proteinuria, a composite of kidney failure (confirmed 40% eGFR reduction, end-stage kidney disease, or all-cause mortality), and safety and tolerability up to 110 weeks from randomisation. Secondary efficacy outcomes were assessed in the full analysis set and safety was assessed in the safety set, both of which were defined as all patients who were randomly assigned and received at least one dose of randomly assigned study drug. This trial is registered with ClinicalTrials.gov, NCT03762850.FindingsBetween Dec 20, 2018, and May 26, 2021, 203 patients were randomly assigned to the sparsentan group and 203 to the irbesartan group. One patient from each group did not receive the study drug and was excluded from the efficacy and safety analyses (282 [70%] of 404 included patients were male and 272 [67%] were White) . Patients in the sparsentan group had a slower rate of eGFR decline than those in the irbesartan group. eGFR chronic 2-year slope (weeks 6–110) was −2·7 mL/min per 1·73 m2 per year versus −3·8 mL/min per 1·73 m2 per year (difference 1·1 mL/min per 1·73 m2 per year, 95% CI 0·1 to 2·1; p=0·037); total 2-year slope (day 1–week 110) was −2·9 mL/min per 1·73 m2 per year versus −3·9 mL/min per 1·73 m2 per year (difference 1·0 mL/min per 1·73 m2 per year, 95% CI −0·03 to 1·94; p=0·058). The significant reduction in proteinuria at 36 weeks with sparsentan was maintained throughout the study period; at 110 weeks, proteinuria, as determined by the change from baseline in urine protein-to-creatinine ratio, was 40% lower in the sparsentan group than in the irbesartan group (−42·8%, 95% CI −49·8 to −35·0, with sparsentan versus −4·4%, −15·8 to 8·7, with irbesartan; geometric least-squares mean ratio 0·60, 95% CI 0·50 to 0·72). The composite kidney failure endpoint was reached by 18 (9%) of 202 patients in the sparsentan group versus 26 (13%) of 202 patients in the irbesartan group (relative risk 0·7, 95% CI 0·4 to 1·2). Treatment-emergent adverse events were well balanced between sparsentan and irbesartan, with no new safety signals.InterpretationOver 110 weeks, treatment with sparsentan versus maximally titrated irbesartan in patients with IgA nephropathy resulted in significant reductions in proteinuria and preservation of kidney function

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed by resource-rich organizations and are frequently kept from the public. As a step towards democratizing this powerful technology, we present BLOOM, a 176B-parameter open-access language model designed and built thanks to a collaboration of hundreds of researchers. BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages (59 in total). We find that BLOOM achieves competitive performance on a wide variety of benchmarks, with stronger results after undergoing multitask prompted finetuning. To facilitate future research and applications using LLMs, we publicly release our models and code under the Responsible AI License

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed by resource-rich organizations and are frequently kept from the public. As a step towards democratizing this powerful technology, we present BLOOM, a 176B-parameter open-access language model designed and built thanks to a collaboration of hundreds of researchers. BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages (59 in total). We find that BLOOM achieves competitive performance on a wide variety of benchmarks, with stronger results after undergoing multitask prompted finetuning. To facilitate future research and applications using LLMs, we publicly release our models and code under the Responsible AI License

Efficacy and safety of sparsentan versus irbesartan in patients with IgA nephropathy (PROTECT): 2-year results from a randomised, active-controlled, phase 3 trial

Background Sparsentan, a novel, non-immunosuppressive, single-molecule, dual endothelin angiotensin receptor antagonist, significantly reduced proteinuria versus irbesartan, an angiotensin II receptor blocker, at 36 weeks (primary endpoint) in patients with immunoglobulin A nephropathy in the phase 3 PROTECT trial's previously reported interim analysis. Here, we report kidney function and outcomes over 110 weeks from the double-blind final analysis. Methods PROTECT, a double-blind, randomised, active-controlled, phase 3 study, was done across 134 clinical practice sites in 18 countries throughout the Americas, Asia, and Europe. Patients aged 18 years or older with biopsy-proven primary IgA nephropathy and proteinuria of at least 1·0 g per day despite maximised renin–angiotensin system inhibition for at least 12 weeks were randomly assigned (1:1) to receive sparsentan (target dose 400 mg oral sparsentan once daily) or irbesartan (target dose 300 mg oral irbesartan once daily) based on a permuted-block randomisation method. The primary endpoint was proteinuria change between treatment groups at 36 weeks. Secondary endpoints included rate of change (slope) of the estimated glomerular filtration rate (eGFR), changes in proteinuria, a composite of kidney failure (confirmed 40% eGFR reduction, end-stage kidney disease, or all-cause mortality), and safety and tolerability up to 110 weeks from randomisation. Secondary efficacy outcomes were assessed in the full analysis set and safety was assessed in the safety set, both of which were defined as all patients who were randomly assigned and received at least one dose of randomly assigned study drug. This trial is registered with ClinicalTrials.gov, NCT03762850. Findings Between Dec 20, 2018, and May 26, 2021, 203 patients were randomly assigned to the sparsentan group and 203 to the irbesartan group. One patient from each group did not receive the study drug and was excluded from the efficacy and safety analyses (282 [70%] of 404 included patients were male and 272 [67%] were White) . Patients in the sparsentan group had a slower rate of eGFR decline than those in the irbesartan group. eGFR chronic 2-year slope (weeks 6–110) was −2·7 mL/min per 1·73 m2 per year versus −3·8 mL/min per 1·73 m2 per year (difference 1·1 mL/min per 1·73 m2 per year, 95% CI 0·1 to 2·1; p=0·037); total 2-year slope (day 1–week 110) was −2·9 mL/min per 1·73 m2 per year versus −3·9 mL/min per 1·73 m2 per year (difference 1·0 mL/min per 1·73 m2 per year, 95% CI −0·03 to 1·94; p=0·058). The significant reduction in proteinuria at 36 weeks with sparsentan was maintained throughout the study period; at 110 weeks, proteinuria, as determined by the change from baseline in urine protein-to-creatinine ratio, was 40% lower in the sparsentan group than in the irbesartan group (−42·8%, 95% CI −49·8 to −35·0, with sparsentan versus −4·4%, −15·8 to 8·7, with irbesartan; geometric least-squares mean ratio 0·60, 95% CI 0·50 to 0·72). The composite kidney failure endpoint was reached by 18 (9%) of 202 patients in the sparsentan group versus 26 (13%) of 202 patients in the irbesartan group (relative risk 0·7, 95% CI 0·4 to 1·2). Treatment-emergent adverse events were well balanced between sparsentan and irbesartan, with no new safety signals. Interpretation Over 110 weeks, treatment with sparsentan versus maximally titrated irbesartan in patients with IgA nephropathy resulted in significant reductions in proteinuria and preservation of kidney function.</p

Health-status outcomes with invasive or conservative care in coronary disease

BACKGROUND In the ISCHEMIA trial, an invasive strategy with angiographic assessment and revascularization did not reduce clinical events among patients with stable ischemic heart disease and moderate or severe ischemia. A secondary objective of the trial was to assess angina-related health status among these patients. METHODS We assessed angina-related symptoms, function, and quality of life with the Seattle Angina Questionnaire (SAQ) at randomization, at months 1.5, 3, and 6, and every 6 months thereafter in participants who had been randomly assigned to an invasive treatment strategy (2295 participants) or a conservative strategy (2322). Mixed-effects cumulative probability models within a Bayesian framework were used to estimate differences between the treatment groups. The primary outcome of this health-status analysis was the SAQ summary score (scores range from 0 to 100, with higher scores indicating better health status). All analyses were performed in the overall population and according to baseline angina frequency. RESULTS At baseline, 35% of patients reported having no angina in the previous month. SAQ summary scores increased in both treatment groups, with increases at 3, 12, and 36 months that were 4.1 points (95% credible interval, 3.2 to 5.0), 4.2 points (95% credible interval, 3.3 to 5.1), and 2.9 points (95% credible interval, 2.2 to 3.7) higher with the invasive strategy than with the conservative strategy. Differences were larger among participants who had more frequent angina at baseline (8.5 vs. 0.1 points at 3 months and 5.3 vs. 1.2 points at 36 months among participants with daily or weekly angina as compared with no angina). CONCLUSIONS In the overall trial population with moderate or severe ischemia, which included 35% of participants without angina at baseline, patients randomly assigned to the invasive strategy had greater improvement in angina-related health status than those assigned to the conservative strategy. The modest mean differences favoring the invasive strategy in the overall group reflected minimal differences among asymptomatic patients and larger differences among patients who had had angina at baseline

Initial invasive or conservative strategy for stable coronary disease

BACKGROUND Among patients with stable coronary disease and moderate or severe ischemia, whether clinical outcomes are better in those who receive an invasive intervention plus medical therapy than in those who receive medical therapy alone is uncertain. METHODS We randomly assigned 5179 patients with moderate or severe ischemia to an initial invasive strategy (angiography and revascularization when feasible) and medical therapy or to an initial conservative strategy of medical therapy alone and angiography if medical therapy failed. The primary outcome was a composite of death from cardiovascular causes, myocardial infarction, or hospitalization for unstable angina, heart failure, or resuscitated cardiac arrest. A key secondary outcome was death from cardiovascular causes or myocardial infarction. RESULTS Over a median of 3.2 years, 318 primary outcome events occurred in the invasive-strategy group and 352 occurred in the conservative-strategy group. At 6 months, the cumulative event rate was 5.3% in the invasive-strategy group and 3.4% in the conservative-strategy group (difference, 1.9 percentage points; 95% confidence interval [CI], 0.8 to 3.0); at 5 years, the cumulative event rate was 16.4% and 18.2%, respectively (difference, 121.8 percentage points; 95% CI, 124.7 to 1.0). Results were similar with respect to the key secondary outcome. The incidence of the primary outcome was sensitive to the definition of myocardial infarction; a secondary analysis yielded more procedural myocardial infarctions of uncertain clinical importance. There were 145 deaths in the invasive-strategy group and 144 deaths in the conservative-strategy group (hazard ratio, 1.05; 95% CI, 0.83 to 1.32). CONCLUSIONS Among patients with stable coronary disease and moderate or severe ischemia, we did not find evidence that an initial invasive strategy, as compared with an initial conservative strategy, reduced the risk of ischemic cardiovascular events or death from any cause over a median of 3.2 years. The trial findings were sensitive to the definition of myocardial infarction that was used