Robust Domain Adaptation for Pre-trained Multilingual Neural Machine Translation Models

Recent literature has demonstrated the potential of multilingual Neural Machine Translation (mNMT) models. However, the most efficient models are not well suited to specialized industries. In these cases, internal data is scarce and expensive to find in all language pairs. Therefore, fine-tuning a mNMT model on a specialized domain is hard. In this context, we decided to focus on a new task: Domain Adaptation of a pre-trained mNMT model on a single pair of language while trying to maintain model quality on generic domain data for all language pairs. The risk of loss on generic domain and on other pairs is high. This task is key for mNMT model adoption in the industry and is at the border of many others. We propose a fine-tuning procedure for the generic mNMT that combines embeddings freezing and adversarial loss. Our experiments demonstrated that the procedure improves performances on specialized data with a minimal loss in initial performances on generic domain for all languages pairs, compared to a naive standard approach (+10.0 BLEU score on specialized data, -0.01 to -0.5 BLEU on WMT and Tatoeba datasets on the other pairs with M2M100).Comment: Accepted by EMNLP 2022 MMNLU Worksho

X-raying the Beating Heart of a Newborn Star: Rotational Modulation of High-energy Radiation from V1647 Ori

We report a periodicity of ~1 day in the highly elevated X-ray emission from the protostar V1647 Ori during its two recent multiple-year outbursts of mass accretion. This periodicity is indicative of protostellar rotation at near-breakup speed. Modeling of the phased X-ray light curve indicates the high-temperature (~50 MK), X-ray-emitting plasma, which is most likely heated by accretion-induced magnetic reconnection, resides in dense (>~5e10 cm-3), pancake-shaped magnetic footprints where the accretion stream feeds the newborn star. The sustained X-ray periodicity of V1647 Ori demonstrates that such protostellar magnetospheric accretion configurations can be stable over timescales of years.Comment: 26 pages, 10 figure

Detection of a Cool, Accretion-Shock-Generated X-Ray Plasma in EX Lupi During the 2008 Optical Eruption

EX Lupi is the prototype for a class of young, pre-main-sequence stars which are observed to undergo irregular, presumably accretion-generated, optical outbursts that result in a several magnitude rise of the optical flux. EX Lupi was observed to optically erupt in 2008 January, triggering Chandra ACIS Target of Opportunity observations shortly thereafter. We find very strong evidence that most of the X-ray emission in the first few months after the optical outburst is generated by accretion of circumstellar material onto the stellar photosphere. Specifically, we find a strong correlation between the decreasing optical and X-ray fluxes following the peak of the outburst in the optical, which suggests that these observed declines in both the optical and X-ray fluxes are the result of declining accretion rate. In addition, in our models of the X-ray spectrum, we find strong evidence for an approx 0.4 keV plasma component, as expected for accretion shocks on low-mass, pre-main-sequence stars. From 2008 March through October, this cool plasma component appeared to fade as EX Lupi returned to its quiescent level in the optical, consistent with a decrease in the overall emission measure of accretion-shock-generated plasma. The overall small increase of the X-ray flux during the optical outburst of EX Lupi is similar to what was observed in previous X-ray observations of the 2005 optical outburst of the EX Lupi-type star V1118 Ori but contrasts with the large increase of the X-ray flux from the erupting young star V1647 Ori during its 2003 and 2008 optical outbursts

Age-Related Mushroom Body Expansion in Male Sweat Bees and Bumble Bees

A well-documented phenomenon among social insects is that brain changes occur prior to or at the onset of certain experiences, potentially serving to prime the brain for specific tasks. This insight comes almost exclusively from studies considering developmental maturation in females. As a result, it is unclear whether age-related brain plasticity is consistent across sexes, and to what extent developmental patterns differ. Using confocal microscopy and volumetric analyses, we investigated age-related brain changes coinciding with sexual maturation in the males of the facultatively eusocial sweat bee, Megalopta genalis, and the obligately eusocial bumble bee, Bombus impatiens. We compared volumetric measurements between newly eclosed and reproductively mature males kept isolated in the lab. We found expansion of the mushroom bodies—brain regions associated with learning and memory—with maturation, which were consistent across both species. This age-related plasticity may, therefore, play a functionally-relevant role in preparing male bees for mating, and suggests that developmentally-driven neural restructuring can occur in males, even in species where it is absent in females

Assessing precipitation, evapotranspiration, and NDVI as controls of U.S. Great Plains plant production

Productivity throughout the North American Great Plains grasslands is generally considered to be water limited, with the strength of this limitation increasing as precipitation decreases. We hypothesize that cumulative actual evapotranspiration water loss (AET) from April to July is the precipitation-related variable most correlated to aboveground net primary production (ANPP) in the U.S. Great Plains (GP). We tested this by evaluating the relationship of ANPP to AET, precipitation, and plant transpiration (Tr). We used multi-year ANPP data from five sites ranging from semiarid grasslands in Colorado and Wyoming to mesic grasslands in Nebraska and Kansas, mean annual NRCS ANPP, and satellite-derived normalized difference vegetation index (NDVI) data. Results from the five sites showed that cumulative April-to-July AET, precipitation, and Tr were well correlated (R2: 0.54–0.70) to annual changes in ANPP for all but the wettest site. AET and Tr were better correlated to annual changes in ANPP compared to precipitation for the drier sites, and precipitation in August and September had little impact on productivity in drier sites. April-to-July cumulative precipitation was best correlated (R2 = 0.63) with interannual variability in ANPP in the most mesic site, while AET and Tr were poorly correlated with ANPP at this site. Cumulative growing season (May-to-September) NDVI (iNDVI) was strongly correlated with annual ANPP at the five sites (R2 = 0.90). Using iNDVI as a surrogate for ANPP, we found that county-level cumulative April–July AET was more strongly correlated to ANPP than precipitation for more than 80% of the GP counties, with precipitation tending to perform better in the eastern more mesic portion of the GP. Including the ratio of AET to potential evapotranspiration (PET) improved the correlation of AET to both iNDVI and mean county-level NRCS ANPP. Accounting for how different precipitation-related variables control ANPP (AET in drier portion, precipitation in wetter portion) provides opportunity to develop spatially explicit forecasting of ANPP across the GP for enhancing decision-making by land managers and use of grassland ANPP for biofuels

Coibacins A D, Antileishmanial Marine Cyanobacterial Polyketides with Intriguing Biosynthetic Origins

Four unsaturated polyketide lactone derivatives, coibacins A-D, were isolated from a Panamanian marine cyanobacterium, cf. Oscillatoria sp. The two different types of termini observed in these co-occurring metabolites, either a methyl cyclopropyl ring as seen in curacin A or a methyl vinyl chloride similar to that observed in the jamaicamides, suggest an intriguing flexibility in the “beta branch” forming biosynthetic process. The coibacins possess selective antileishmanial activity as well as potent anti-inflammatory activity.Four unsaturated polyketide lactone derivatives, coibacins A-D, were isolated from a Panamanian marine cyanobacterium, cf. Oscillatoria sp. The two different types of termini observed in these co-occurring metabolites, either a methyl cyclopropyl ring as seen in curacin A or a methyl vinyl chloride similar to that observed in the jamaicamides, suggest an intriguing flexibility in the “beta branch” forming biosynthetic process. The coibacins possess selective antileishmanial activity as well as potent anti-inflammatory activity

Antiviral Responses following L-Leucyl-L-Leucine Methyl Esther (LLME)-Treated Lymphocyte Infusions: Graft-versus-Infection without Graft-versus-Host Disease

Although allogeneic hematopoietic progenitor cell transplant (HPCT) is curative therapy for many disorders, it is associated with significant morbidity and mortality, which can be related to graft-versus-host disease (GVHD) and the immunosuppressive measures required for its prevention and/or treatment. Whether the immunosuppression is pharmacologic or secondary to graft manipulation, the graft recipient is left at increased risk of the threatening opportunistic infection. Refractory viral diseases in the immunocompromised host have been treated by infusion of virus-specific lymphotyces and by unmanipulated donor lymphocyte infusion (DLI) therapy. L-leucyl-L-leucine methyl ester (LLME) is a compound that induces programmed cell death of natural killer (NK) cells, monocytes, granulocytes, most CD8+ T cells, and a small fraction of CD4+ T cells. We have undertaken a study of the use of LLME-treated DLI following T cell-depleted allogeneic HPCT, specifically to aid with immune reconstitution. In this ongoing clinical trial, we have demonstrated the rapid emergence of virus-specific responses following LLME DLI with minimal associated GVHD. This paper examines the pace of immune recovery and the rapid development of antiviral responses in 6 patients who developed viral infections during the time period immediately preceding or coincident with the administration of the LLME DLI

Increased Expression of Cytotoxic T-Lymphocyte-Associated Protein 4 by T Cells, Induced by B7 in Sera, Reduces Adaptive Immunity in Patients With Acute Liver Failure.

BACKGROUND & AIMS: Patients with acute liver failure (ALF) have defects in innate immune responses to microbes (immune paresis) and are susceptible to sepsis. Cytotoxic T-lymphocyte-associated protein 4 (CTLA4), which interacts with the membrane receptor B7 (also called CD80 and CD86), is a negative regulator of T-cell activation. We collected T cells from patients with ALF and investigated whether inhibitory signals down-regulate adaptive immune responses in patients with ALF. METHODS: We collected peripheral blood mononuclear cells from patients with ALF and controls from September 2013 through September 2015 (45 patients with ALF, 20 patients with acute-on-chronic liver failure, 15 patients with cirrhosis with no evidence of acute decompensation, 20 patients with septic shock but no cirrhosis or liver disease, and 20 healthy individuals). Circulating CD4+ T cells were isolated and analyzed by flow cytometry. CD4+ T cells were incubated with antigen, or agonist to CD3 and dendritic cells, with or without antibody against CTLA4; T-cell proliferation and protein expression were quantified. We measured levels of soluble B7 molecules in supernatants of isolated primary hepatocytes, hepatic sinusoidal endothelial cells, and biliary epithelial cells from healthy or diseased liver tissues. We also measured levels of soluble B7 serum samples from patients and controls, and mice with acetaminophen-induced liver injury using enzyme-linked immunosorbent assays. RESULTS: Peripheral blood samples from patients with ALF had a higher proportion of CD4+ CTLA4+ T cells than controls; patients with infections had the highest proportions. CD4+ T cells from patients with ALF had a reduced proliferative response to antigen or CD3 stimulation compared to cells from controls; incubation of CD4+ T cells from patients with ALF with an antibody against CTLA4 increased their proliferative response to antigen and to CD3 stimulation, to the same levels as cells from controls. CD4+ T cells from controls up-regulated expression of CTLA4 after 24-48 hours culture with sera from patients with ALF; these sera were found to have increased concentrations of soluble B7 compared to sera from controls. Necrotic human primary hepatocytes exposed to acetaminophen, but not hepatic sinusoidal endothelial cells and biliary epithelial cells from patients with ALF, secreted high levels of soluble B7. Sera from mice with acetaminophen-induced liver injury contained high levels of soluble B7 compared to sera from mice without liver injury. Plasma exchange reduced circulating levels of soluble B7 in patients with ALF and expression of CTLA4 on T cells. CONCLUSIONS: Peripheral CD4+ T cells from patients with ALF have increased expression of CTLA4 compared to individuals without ALF; these cells have a reduced response to antigen and CD3 stimulation. We found sera of patients with ALF and from mice with liver injury to have high concentrations of soluble B7, which up-regulates CTLA4 expression by T cells and reduces their response to antigen. Plasma exchange reduces levels of B7 in sera from patients with ALF and might be used to restore antimicrobial responses to patients