BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed by resource-rich organizations and are frequently kept from the public. As a step towards democratizing this powerful technology, we present BLOOM, a 176B-parameter open-access language model designed and built thanks to a collaboration of hundreds of researchers. BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages (59 in total). We find that BLOOM achieves competitive performance on a wide variety of benchmarks, with stronger results after undergoing multitask prompted finetuning. To facilitate future research and applications using LLMs, we publicly release our models and code under the Responsible AI License

Effect of Engaging Trainees by Assessing Peer Performance:A Randomised Controlled Trial Using Simulated Patient Scenarios

Introduction. The aim of this study was to explore the learning effect of engaging trainees by assessing peer performance during simulation-based training. Methods. Eighty-four final year medical students participated in the study. The intervention involved trainees assessing peer performance during training. Outcome measures were in-training performance and performance, both of which were measured two weeks after the course. Trainees’ performances were videotaped and assessed by two expert raters using a checklist that included a global rating. Trainees’ satisfaction with the training was also evaluated. Results. The intervention group obtained a significantly higher overall in-training performance score than the control group: mean checklist score 20.87 (SD 2.51) versus 19.14 (SD 2.65) P=0.003 and mean global rating 3.25 SD (0.99) versus 2.95 (SD 1.09) P=0.014. Postcourse performance did not show any significant difference between the two groups. Trainees who assessed peer performance were more satisfied with the training than those who did not: mean 6.36 (SD 1.00) versus 5.74 (SD 1.33) P=0.025. Conclusion. Engaging trainees in the assessment of peer performance had an immediate effect on in-training performance, but not on the learning outcome measured two weeks later. Trainees had a positive attitude towards the training format

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed by resource-rich organizations and are frequently kept from the public. As a step towards democratizing this powerful technology, we present BLOOM, a 176B-parameter open-access language model designed and built thanks to a collaboration of hundreds of researchers. BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages (59 in total). We find that BLOOM achieves competitive performance on a wide variety of benchmarks, with stronger results after undergoing multitask prompted finetuning. To facilitate future research and applications using LLMs, we publicly release our models and code under the Responsible AI License