BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting

The BLOOM model is a large publicly available multilingual language model, but its pretraining was limited to 46 languages. To extend the benefits of BLOOM to other languages without incurring prohibitively large costs, it is desirable to adapt BLOOM to new languages not seen during pretraining. In this work, we apply existing language adaptation strategies to BLOOM and benchmark its zero-shot prompting performance on eight new languages in a resource-constrained setting. We find language adaptation to be effective at improving zero-shot performance in new languages. Surprisingly, we find that adapter-based finetuning is more effective than continued pretraining for large models. In addition, we discover that prompting performance is not significantly affected by language specifics, such as the writing system. It is primarily determined by the size of the language adaptation data. We also add new languages to BLOOMZ, which is a multitask finetuned version of BLOOM capable of following task instructions zero-shot. We find including a new language in the multitask fine-tuning mixture to be the most effective method to teach BLOOMZ a new language. We conclude that with sufficient training data language adaptation can generalize well to diverse languages. Our code is available at https://github.com/bigscience-workshop/multilingual-modeling

Diagnostics and treatment challenges of Ph-like acute lymphoblastic leukemia: a description of 3 clinical cases

B-cell acute lymphoblastic leukemia (B-ALL) is a diverse group of malignant blood disorders both with regard to the biological properties of the tumor and to therapeutic approaches. Immunophenotyping, molecular genetic techniques, whole-genome sequencing characterize B-ALL as a very diverse group for sensitivity to chemotherapy and prognosis. We present three clinical cases of patients with B-ALL and expected good response to standard therapy, in whom standard protocol treatment failured: refractoriness, persistence of minimal residual disease (MRD), and progression (MRD increase). The remission in these patients was achieved after chemotherapy change to immunological targeted therapy. Nowadays a unified therapeutic approach to all primary patients of the B-ALL is considered generally outdated. Great efforts are carrying out to develop molecular genetic classifications. The molecular dissection of subtypes of B-ALL goes on, and new protocols for selective treatment with targeting are clearly outlined for each subtype of B-ALL

Subnational climate entrepreneurship: innovative climate action in California and São Paulo

The distinct role of subnational governments such as states and provinces in addressing climate change has been increasingly acknowledged. But while most studies investigate the causes and consequences of particular governments’ actions and networking activities, this article argues that subnational governments can develop climate action as a collective entrepreneurial activity. Addressing many elements explored in this special issue, it focuses on the second question and identifies climate entrepreneurship in two subnational governments—the states of California (USA) and São Paulo (Brazil). Examining internal action, as well as interaction with local authorities, national governments and the international regime, entrepreneurial activities are identified in the invention, diffusion and evaluation of subnational climate policy in each case. The article draws from the recent scholarship on policy innovation, entrepreneurship and climate governance. It contributes to the literature by exploring entrepreneurial subnational government activity in addressing climate change and expanding the understanding of the effects of policy innovation at the subnational level

Partitioning variability in animal behavioral videos using semi-supervised variational autoencoders

Action Contro

The impact of Participatory Budgeting on health and wellbeing:A scoping review of evaluations

Background: Participatory budgeting (PB), citizens deliberating among themselves and with officials to decide how to allocate funds for public goods, has been increasingly implemented across Europe and worldwide. While PB is recommended as good practice by the World Bank and the United Nations, with potential to improve health and wellbeing, it is unclear what evaluations have been conducted on the impact of PB on health and wellbeing. Methods: For this scoping review, we searched 21 databases with no restrictions on publication date or language. The search term ‘participatory budget’ was used as the relevant global label for the intervention of interest. Studies were included if they reported original analysis of health, social, political, or economic and budgetary outcomes of PB. We examined the study design, analysis, outcomes and location of included articles. Findings are reported narratively. Results: From 1458 identified references, 37 studies were included. The majority of evaluations (n = 24) were of PB in South America, seven were in Europe. Most evaluations were case studies (n = 23) conducting ethnography and surveys, focussing on political outcomes such as participation in PB or impacts on political activities. All of the quantitative observational studies analysing population level data, except one in Russia, were conducted in South America. Conclusion: Despite increasing interest in PB, evaluations applying robust methods to analyse health and wellbeing outcomes are scarce, particularly beyond Brazil. Therefore, implementation of PB schemes should be accompanied by rigorous qualitative and quantitative evaluation to identify impacts and the processes by which they are realised