BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed by resource-rich organizations and are frequently kept from the public. As a step towards democratizing this powerful technology, we present BLOOM, a 176B-parameter open-access language model designed and built thanks to a collaboration of hundreds of researchers. BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages (59 in total). We find that BLOOM achieves competitive performance on a wide variety of benchmarks, with stronger results after undergoing multitask prompted finetuning. To facilitate future research and applications using LLMs, we publicly release our models and code under the Responsible AI License

Treatment with tocilizumab or corticosteroids for COVID-19 patients with hyperinflammatory state: a multicentre cohort study (SAM-COVID-19)

Objectives: The objective of this study was to estimate the association between tocilizumab or corticosteroids and the risk of intubation or death in patients with coronavirus disease 19 (COVID-19) with a hyperinflammatory state according to clinical and laboratory parameters. Methods: A cohort study was performed in 60 Spanish hospitals including 778 patients with COVID-19 and clinical and laboratory data indicative of a hyperinflammatory state. Treatment was mainly with tocilizumab, an intermediate-high dose of corticosteroids (IHDC), a pulse dose of corticosteroids (PDC), combination therapy, or no treatment. Primary outcome was intubation or death; follow-up was 21 days. Propensity score-adjusted estimations using Cox regression (logistic regression if needed) were calculated. Propensity scores were used as confounders, matching variables and for the inverse probability of treatment weights (IPTWs). Results: In all, 88, 117, 78 and 151 patients treated with tocilizumab, IHDC, PDC, and combination therapy, respectively, were compared with 344 untreated patients. The primary endpoint occurred in 10 (11.4%), 27 (23.1%), 12 (15.4%), 40 (25.6%) and 69 (21.1%), respectively. The IPTW-based hazard ratios (odds ratio for combination therapy) for the primary endpoint were 0.32 (95%CI 0.22-0.47; p < 0.001) for tocilizumab, 0.82 (0.71-1.30; p 0.82) for IHDC, 0.61 (0.43-0.86; p 0.006) for PDC, and 1.17 (0.86-1.58; p 0.30) for combination therapy. Other applications of the propensity score provided similar results, but were not significant for PDC. Tocilizumab was also associated with lower hazard of death alone in IPTW analysis (0.07; 0.02-0.17; p < 0.001). Conclusions: Tocilizumab might be useful in COVID-19 patients with a hyperinflammatory state and should be prioritized for randomized trials in this situatio

Mortality from gastrointestinal congenital anomalies at 264 hospitals in 74 low-income, middle-income, and high-income countries: a multicentre, international, prospective cohort study

Summary Background Congenital anomalies are the fifth leading cause of mortality in children younger than 5 years globally. Many gastrointestinal congenital anomalies are fatal without timely access to neonatal surgical care, but few studies have been done on these conditions in low-income and middle-income countries (LMICs). We compared outcomes of the seven most common gastrointestinal congenital anomalies in low-income, middle-income, and high-income countries globally, and identified factors associated with mortality. Methods We did a multicentre, international prospective cohort study of patients younger than 16 years, presenting to hospital for the first time with oesophageal atresia, congenital diaphragmatic hernia, intestinal atresia, gastroschisis, exomphalos, anorectal malformation, and Hirschsprung’s disease. Recruitment was of consecutive patients for a minimum of 1 month between October, 2018, and April, 2019. We collected data on patient demographics, clinical status, interventions, and outcomes using the REDCap platform. Patients were followed up for 30 days after primary intervention, or 30 days after admission if they did not receive an intervention. The primary outcome was all-cause, in-hospital mortality for all conditions combined and each condition individually, stratified by country income status. We did a complete case analysis. Findings We included 3849 patients with 3975 study conditions (560 with oesophageal atresia, 448 with congenital diaphragmatic hernia, 681 with intestinal atresia, 453 with gastroschisis, 325 with exomphalos, 991 with anorectal malformation, and 517 with Hirschsprung’s disease) from 264 hospitals (89 in high-income countries, 166 in middleincome countries, and nine in low-income countries) in 74 countries. Of the 3849 patients, 2231 (58·0%) were male. Median gestational age at birth was 38 weeks (IQR 36–39) and median bodyweight at presentation was 2·8 kg (2·3–3·3). Mortality among all patients was 37 (39·8%) of 93 in low-income countries, 583 (20·4%) of 2860 in middle-income countries, and 50 (5·6%) of 896 in high-income countries (p<0·0001 between all country income groups). Gastroschisis had the greatest difference in mortality between country income strata (nine [90·0%] of ten in lowincome countries, 97 [31·9%] of 304 in middle-income countries, and two [1·4%] of 139 in high-income countries; p≤0·0001 between all country income groups). Factors significantly associated with higher mortality for all patients combined included country income status (low-income vs high-income countries, risk ratio 2·78 [95% CI 1·88–4·11], p<0·0001; middle-income vs high-income countries, 2·11 [1·59–2·79], p<0·0001), sepsis at presentation (1·20 [1·04–1·40], p=0·016), higher American Society of Anesthesiologists (ASA) score at primary intervention (ASA 4–5 vs ASA 1–2, 1·82 [1·40–2·35], p<0·0001; ASA 3 vs ASA 1–2, 1·58, [1·30–1·92], p<0·0001]), surgical safety checklist not used (1·39 [1·02–1·90], p=0·035), and ventilation or parenteral nutrition unavailable when needed (ventilation 1·96, [1·41–2·71], p=0·0001; parenteral nutrition 1·35, [1·05–1·74], p=0·018). Administration of parenteral nutrition (0·61, [0·47–0·79], p=0·0002) and use of a peripherally inserted central catheter (0·65 [0·50–0·86], p=0·0024) or percutaneous central line (0·69 [0·48–1·00], p=0·049) were associated with lower mortality. Interpretation Unacceptable differences in mortality exist for gastrointestinal congenital anomalies between lowincome, middle-income, and high-income countries. Improving access to quality neonatal surgical care in LMICs will be vital to achieve Sustainable Development Goal 3.2 of ending preventable deaths in neonates and children younger than 5 years by 2030

Endoscopic mucosal resection for proximal superficial lesions: efficacy and safety study in 59 consecutive resections Resección endoscópica mucosa de lesiones superficiales altas: estudio de su eficacia y seguridad en 59 resecciones consecutivas

Introduction: endoscopic mucosal resection is an accepted technique for the treatment of proximal gastrointestinal tract superficial lesions. Objectives: to evaluate the efficacy and safety of this procedure in the proximal gastrointestinal tract. Material and methods: forty one consecutive patients (23 males and 18 females, mean age of 61 ± 11.5 years) were included in our study. Fifty nine resections were performed in these patients in 69 sessions. Lesions treated consisted of elevated lesions with high grade dysplasia in the context of Barrett's esophagus (group A), high grade dysplasia appearing in random biopsies taken during the follow-up of Barrett's esophagus (group B) and superficial gastroduodenal lesions (group C). Snare resection after submucosal injection, band ligator-assisted or cap-assisted mucosal resection were the chosen techniques. Results: we resected 7 elevated lesions with high grade dysplasia in the context of Barrett's esophagus, 6 complete Barrett's esophagus with high grade dysplasia in 16 sequential sessions and 46 gastroduodenal superficial lesions (10 adenomas, 9 gastric superficial carcinomas, 18 carcinoid tumours and 9 lesions of different histological nature). Resections in the two first groups were complete in 100% of the cases, and in 97.9% of the cases in group C. Complications included 2 cases of limited deferred bleeding (groups A and B) and another two cases of stenosis with little clinical relevance in Group B. Conclusions: a) endoscopic mucosal resection is an efficient technique for the treatment of proximal gastrointestinal tract superficial lesions; b) it is a safe procedure with a low percentage of complications, which can generally be managed endoscopically; and c) in contrast with other ablative techniques, endoscopic mucosal resection offers the possibility of a pathologic analysis of the samples.<br>Introducción: la resección endoscópica mucosa es una técnica aceptada en el tratamiento de lesiones superficiales del tracto digestivo. Objetivos: evaluar la eficacia y seguridad de dicho procedimiento en el tracto digestivo superior. Material y métodos: se incluyeron en nuestro estudio 41 pacientes consecutivos (23 hombres y 18 mujeres, edad media de 60,6 años) a los que se les realizaron 59 resecciones en 69 sesiones. Se trataron las siguientes patologías: lesiones sobreelevadas con displasia de alto grado sobre esófago de Barrett (grupo A), displasia de alto grado en biopsias aleatorias del seguimiento de esófago de Barrett (grupo B) y lesiones superficiales gastroduodenales (grupo C). Las técnicas utilizadas fueron la resección con asa tras inyección submucosa, la asistida por bandas o por capuchón. Resultados: se resecaron 7 lesiones sobreelevadas con displasia de alto grado sobre esófago de Barrett, 6 esófagos de Barrett con displasia de alto grado de forma completa en 16 sesiones secuenciales de resección mucosa y 46 lesiones superficiales gastroduodenales (10 adenomas, 9 carcinomas gástricos superficiales, 18 carcinoides y 9 lesiones de diferente estirpe). Las resecciones se realizaron con éxito en el 100% de los dos primeros grupos y en el 97,9% del grupo C. Como complicaciones tuvimos 2 sangrados diferidos autolimitados (grupos A y B) y dos casos de estenosis con escasa relevancia clínica en el grupo B. Conclusiones: a) la resección endoscópica mucosa es una técnica eficaz en el tratamiento de lesiones superficiales del tracto digestivo superior; b) se trata de un procedimiento seguro, con un porcentaje de complicaciones muy bajo y que generalmente pueden ser manejadas de forma endoscópica; y c) al contrario que otras técnicas ablativas, permite el estudio anatomopatológico de las muestras

Clinical guidelines for endoscopic mucosal resection of non-pedunculated colorectal lesions

This document summarizes the contents of the Clinical Guidelines for the Endoscopic Mucosal Resection of Non-Pedunculated Colorectal Lesions that was developed by the working group of the Spanish Society of Digestive Endoscopy (GSEED of Endoscopic Resection). This document presents recommendations for the endoscopic management of superficial colorectal neoplastic lesions

Clinical guidelines for endoscopic mucosal resection of non-pedunculated colorectal lesions.

This document summarizes the contents of the Clinical Guidelines for the Endoscopic Mucosal Resection of Non-Pedunculated Colorectal Lesions that was developed by the working group of the Spanish Society of Digestive Endoscopy (GSEED of Endoscopic Resection). This document presents recommendations for the endoscopic management of superficial colorectal neoplastic lesions

Guía clínica para la resección mucosa endoscópica de lesiones colorrectales no pediculadas.

This document summarizes the contents of the Clinical Guidelines for the Endoscopic Mucosal Resection of Non-Pedunculated Colorectal Lesions that was developed by the working group of the Spanish Society of Digestive Endoscopy (GSEED of Endoscopic Resection). This document presents recommendations for the endoscopic management of superficial colorectal neoplastic lesions

A Scoring System to Determine Risk of Delayed Bleeding After Endoscopic Mucosal Resection of Large Colorectal Lesions.

After endoscopic mucosal resection (EMR) of colorectal lesions, delayed bleeding is the most common serious complication, but there are no guidelines for its prevention. We aimed to identify risk factors associated with delayed bleeding that required medical attention after discharge until day 15 and develop a scoring system to identify patients at risk. We performed a prospective study of 1214 consecutive patients with nonpedunculated colorectal lesions 20 mm or larger treated by EMR (n = 1255) at 23 hospitals in Spain, from February 2013 through February 2015. Patients were examined 15 days after the procedure, and medical data were collected. We used the data to create a delayed bleeding scoring system, and assigned a weight to each risk factor based on the β parameter from multivariate logistic regression analysis. Patients were classified as being at low, average, or high risk for delayed bleeding. Delayed bleeding occurred in 46 cases (3.7%, 95% confidence interval, 2.7%-4.9%). In multivariate analysis, factors associated with delayed bleeding included age ≥75 years (odds ratio [OR], 2.36; P The risk of delayed bleeding after EMR of large colorectal lesions is 3.7%. We developed a risk scoring system based on 6 factors that determined the risk for delayed bleeding (receiver operating characteristic curve, 0.77). The factors most strongly associated with delayed bleeding were right-sided lesions, aspirin use, and mucosal defects not closed by hemoclips. Patients considered to be high risk (score, 8-10) had a 40% probability of delayed bleeding