Adaptive Machine Translation with Large Language Models

Consistency is a key requirement of high-quality translation. It is especially important to adhere to pre-approved terminology and adapt to corrected translations in domain-specific projects. Machine translation (MT) has achieved significant progress in the area of domain adaptation. However, real-time adaptation remains challenging. Large-scale language models (LLMs) have recently shown interesting capabilities of in-context learning, where they learn to replicate certain input-output text generation patterns, without further fine-tuning. By feeding an LLM at inference time with a prompt that consists of a list of translation pairs, it can then simulate the domain and style characteristics. This work aims to investigate how we can utilize in-context learning to improve real-time adaptive MT. Our extensive experiments show promising results at translation time. For example, GPT-3.5 can adapt to a set of in-domain sentence pairs and/or terminology while translating a new sentence. We observe that the translation quality with few-shot in-context learning can surpass that of strong encoder-decoder MT systems, especially for high-resource languages. Moreover, we investigate whether we can combine MT from strong encoder-decoder models with fuzzy matches, which can further improve translation quality, especially for less supported languages. We conduct our experiments across five diverse language pairs, namely English-to-Arabic (EN-AR), English-to-Chinese (EN-ZH), English-to-French (EN-FR), English-to-Kinyarwanda (EN-RW), and English-to-Spanish (EN-ES)

Dynamics of laser-bumped electron–hole semiconductor plasma

Electron–hole pairs in semiconductors can be stimulated by a laser beam with energy larger than the energy gap of the semiconductor. The interaction between an electron–hole plasma with a laser beam can be a source of instability. The dependence of the instability on the electron and hole temperatures and the unperturbed potential of the incident laser are examined. Using Maxwell’s equations along with electron–hole fluid equations, an evolution equation describing the system is obtained. The latter is reduced to an energy equation that characterizes localized pulse propagation

Domain Terminology Integration into Machine Translation: Leveraging Large Language Models

This paper discusses the methods that we used for our submissions to the WMT 2023 Terminology Shared Task for German-to-English (DE-EN), English-to-Czech (EN-CS), and Chinese-to-English (ZH-EN) language pairs. The task aims to advance machine translation (MT) by challenging participants to develop systems that accurately translate technical terms, ultimately enhancing communication and understanding in specialised domains. To this end, we conduct experiments that utilise large language models (LLMs) for two purposes: generating synthetic bilingual terminology-based data, and post-editing translations generated by an MT model through incorporating pre-approved terms. Our system employs a four-step process: (i) using an LLM to generate bilingual synthetic data based on the provided terminology, (ii) fine-tuning a generic encoder-decoder MT model, with a mix of the terminology-based synthetic data generated in the first step and a randomly sampled portion of the original generic training data, (iii) generating translations with the fine-tuned MT model, and (iv) finally, leveraging an LLM for terminology-constrained automatic post-editing of the translations that do not include the required terms. The results demonstrate the effectiveness of our proposed approach in improving the integration of pre-approved terms into translations. The number of terms incorporated into the translations of the blind dataset increases from an average of 36.67% with the generic model to an average of 72.88% by the end of the process. In other words, successful utilisation of terms nearly doubles across the three language pairs.Comment: WMT 202

Domain-specific text generation for machine translation

Preservation of domain knowledge from the source to target is crucial in any translation workflow. It is common in the translation industry to receive highly specialized projects, where there is hardly any parallel in-domain data. In such scenarios where there is insufficient in-domain data to fine-tune Machine Translation (MT) models, producing translations that are consistent with the relevant context is challenging. In this work, we propose a novel approach to domain adaptation leveraging state-of-the-art pretrained language models (LMs) for domain-specific data augmentation for MT, simulating the domain characteristics of either (a) a small bilingual dataset, or (b) the monolingual source text to be translated. Combining this idea with back-translation, we can generate huge amounts of synthetic bilingual in-domain data for both use cases. For our investigation, we use the state-of-the-art Transformer architecture. We employ mixed fine-tuning to train models that significantly improve translation of in-domain texts. More specifically, in both scenarios, our proposed methods achieve improvements of approximately 5-6 BLEU and 2-3 BLEU, respectively, on the Arabic-to-English and English-to-Arabic language pairs. Furthermore, the outcome of human evaluation corroborates the automatic evaluation results

Global, regional, and national burden of Alzheimer's disease and other dementias, 1990-2016: a systematic analysis for the Global Burden of Disease Study 2016.

BACKGROUND: The number of individuals living with dementia is increasing, negatively affecting families, communities, and health-care systems around the world. A successful response to these challenges requires an accurate understanding of the dementia disease burden. We aimed to present the first detailed analysis of the global prevalence, mortality, and overall burden of dementia as captured by the Global Burden of Diseases, Injuries, and Risk Factors (GBD) Study 2016, and highlight the most important messages for clinicians and neurologists. METHODS: GBD 2016 obtained data on dementia from vital registration systems, published scientific literature and surveys, and data from health-service encounters on deaths, excess mortality, prevalence, and incidence from 195 countries and territories from 1990 to 2016, through systematic review and additional data-seeking efforts. To correct for differences in cause of death coding across time and locations, we modelled mortality due to dementia using prevalence data and estimates of excess mortality derived from countries that were most likely to code deaths to dementia relative to prevalence. Data were analysed by standardised methods to estimate deaths, prevalence, years of life lost (YLLs), years of life lived with disability (YLDs), and disability-adjusted life-years (DALYs; computed as the sum of YLLs and YLDs), and the fractions of these metrics that were attributable to four risk factors that met GBD criteria for assessment (high body-mass index [BMI], high fasting plasma glucose, smoking, and a diet high in sugar-sweetened beverages). FINDINGS: In 2016, the global number of individuals who lived with dementia was 43·8 million (95% uncertainty interval [UI] 37·8-51·0), increased from 20.2 million (17·4-23·5) in 1990. This increase of 117% (95% UI 114-121) contrasted with a minor increase in age-standardised prevalence of 1·7% (1·0-2·4), from 701 cases (95% UI 602-815) per 100 000 population in 1990 to 712 cases (614-828) per 100 000 population in 2016. More women than men had dementia in 2016 (27·0 million, 95% UI 23·3-31·4, vs 16.8 million, 14.4-19.6), and dementia was the fifth leading cause of death globally, accounting for 2·4 million (95% UI 2·1-2·8) deaths. Overall, 28·8 million (95% UI 24·5-34·0) DALYs were attributed to dementia; 6·4 million (95% UI 3·4-10·5) of these could be attributed to the modifiable GBD risk factors of high BMI, high fasting plasma glucose, smoking, and a high intake of sugar-sweetened beverages. INTERPRETATION: The global number of people living with dementia more than doubled from 1990 to 2016, mainly due to increases in population ageing and growth. Although differences in coding for causes of death and the heterogeneity in case-ascertainment methods constitute major challenges to the estimation of the burden of dementia, future analyses should improve on the methods for the correction of these biases. Until breakthroughs are made in prevention or curative treatment, dementia will constitute an increasing challenge to health-care systems worldwide

Diminishing benefits of urban living for children and adolescents’ growth and development

Optimal growth and development in childhood and adolescence is crucial for lifelong health and well-being1–6. Here we used data from 2,325 population-based studies, with measurements of height and weight from 71 million participants, to report the height and body-mass index (BMI) of children and adolescents aged 5–19 years on the basis of rural and urban place of residence in 200 countries and territories from 1990 to 2020. In 1990, children and adolescents residing in cities were taller than their rural counterparts in all but a few high-income countries. By 2020, the urban height advantage became smaller in most countries, and in many high-income western countries it reversed into a small urban-based disadvantage. The exception was for boys in most countries in sub-Saharan Africa and in some countries in Oceania, south Asia and the region of central Asia, Middle East and north Africa. In these countries, successive cohorts of boys from rural places either did not gain height or possibly became shorter, and hence fell further behind their urban peers. The difference between the age-standardized mean BMI of children in urban and rural areas was <1.1 kg m–2 in the vast majority of countries. Within this small range, BMI increased slightly more in cities than in rural areas, except in south Asia, sub-Saharan Africa and some countries in central and eastern Europe. Our results show that in much of the world, the growth and developmental advantages of living in cities have diminished in the twenty-first century, whereas in much of sub-Saharan Africa they have amplified

Trends in future health financing and coverage: future health spending and universal health coverage in 188 countries, 2016–40

Background: Achieving universal health coverage (UHC) requires health financing systems that provide prepaid pooled resources for key health services without placing undue financial stress on households. Understanding current and future trajectories of health financing is vital for progress towards UHC. We used historical health financing data for 188 countries from 1995 to 2015 to estimate future scenarios of health spending and pooled health spending through to 2040. Methods: We extracted historical data on gross domestic product (GDP) and health spending for 188 countries from 1995 to 2015, and projected annual GDP, development assistance for health, and government, out-of-pocket, and prepaid private health spending from 2015 through to 2040 as a reference scenario. These estimates were generated using an ensemble of models that varied key demographic and socioeconomic determinants. We generated better and worse alternative future scenarios based on the global distribution of historic health spending growth rates. Last, we used stochastic frontier analysis to investigate the association between pooled health resources and UHC index, a measure of a country's UHC service coverage. Finally, we estimated future UHC performance and the number of people covered under the three future scenarios. Findings: In the reference scenario, global health spending was projected to increase from US$10 trillion (95$20 trillion (18 trillion to 22 trillion) in 2040. Per capita health spending was projected to increase fastest in upper-middle-income countries, at 4·2% (3·4–5·1) per year, followed by lower-middle-income countries (4·0%, 3·6–4·5) and low-income countries (2·2%, 1·7–2·8). Despite global growth, per capita health spending was projected to range from only $40 (24–65) to$413 (263–668) in 2040 in low-income countries, and from $140 (90–200) to$1699 (711–3423) in lower-middle-income countries. Globally, the share of health spending covered by pooled resources would range widely, from 19·8% (10·3–38·6) in Nigeria to 97·9% (96·4–98·5) in Seychelles. Historical performance on the UHC index was significantly associated with pooled resources per capita. Across the alternative scenarios, we estimate UHC reaching between 5·1 billion (4·9 billion to 5·3 billion) and 5·6 billion (5·3 billion to 5·8 billion) lives in 2030. Interpretation: We chart future scenarios for health spending and its relationship with UHC. Ensuring that all countries have sustainable pooled health resources is crucial to the achievement of UHC. Funding: The Bill & Melinda Gates Foundation