HLT-MT: High-resource Language-specific Training for Multilingual Neural Machine Translation

Multilingual neural machine translation (MNMT) trained in multiple language pairs has attracted considerable attention due to fewer model parameters and lower training costs by sharing knowledge among multiple languages. Nonetheless, multilingual training is plagued by language interference degeneration in shared parameters because of the negative interference among different translation directions, especially on high-resource languages. In this paper, we propose the multilingual translation model with the high-resource language-specific training (HLT-MT) to alleviate the negative interference, which adopts the two-stage training with the language-specific selection mechanism. Specifically, we first train the multilingual model only with the high-resource pairs and select the language-specific modules at the top of the decoder to enhance the translation quality of high-resource directions. Next, the model is further trained on all available corpora to transfer knowledge from high-resource languages (HRLs) to low-resource languages (LRLs). Experimental results show that HLT-MT outperforms various strong baselines on WMT-10 and OPUS-100 benchmarks. Furthermore, the analytic experiments validate the effectiveness of our method in mitigating the negative interference in multilingual training.Comment: 7 pages, 7 figures, IJCAI-ECAI 202

Inducible and Selective Erasure of Memories in the Mouse Brain via Chemical-Genetic Manipulation

SummaryRapid and selective erasures of certain types of memories in the brain would be desirable under certain clinical circumstances. By employing an inducible and reversible chemical-genetic technique, we find that transient αCaMKII overexpression at the time of recall impairs the retrieval of both newly formed one-hour object recognition memory and fear memories, as well as 1-month-old fear memories. Systematic analyses suggest that excessive αCaMKII activity-induced recall deficits are not caused by disrupting the retrieval access to the stored information but are, rather, due to the active erasure of the stored memories. Further experiments show that the recall-induced erasure of fear memories is highly restricted to the memory being retrieved while leaving other memories intact. Therefore, our study reveals a molecular genetic paradigm through which a given memory, such as new or old fear memory, can be rapidly and specifically erased in a controlled and inducible manner in the brain

HanoiT: Enhancing Context-aware Translation via Selective Context

Context-aware neural machine translation aims to use the document-level context to improve translation quality. However, not all words in the context are helpful. The irrelevant or trivial words may bring some noise and distract the model from learning the relationship between the current sentence and the auxiliary context. To mitigate this problem, we propose a novel end-to-end encoder-decoder model with a layer-wise selection mechanism to sift and refine the long document context. To verify the effectiveness of our method, extensive experiments and extra quantitative analysis are conducted on four document-level machine translation benchmarks. The experimental results demonstrate that our model significantly outperforms previous models on all datasets via the soft selection mechanism

The Genomes of Oryza sativa: A History of Duplications

We report improved whole-genome shotgun sequences for the genomes of indica and japonica rice, both with multimegabase contiguity, or almost 1,000-fold improvement over the drafts of 2002. Tested against a nonredundant collection of 19,079 full-length cDNAs, 97.7% of the genes are aligned, without fragmentation, to the mapped super-scaffolds of one or the other genome. We introduce a gene identification procedure for plants that does not rely on similarity to known genes to remove erroneous predictions resulting from transposable elements. Using the available EST data to adjust for residual errors in the predictions, the estimated gene count is at least 38,000–40,000. Only 2%–3% of the genes are unique to any one subspecies, comparable to the amount of sequence that might still be missing. Despite this lack of variation in gene content, there is enormous variation in the intergenic regions. At least a quarter of the two sequences could not be aligned, and where they could be aligned, single nucleotide polymorphism (SNP) rates varied from as little as 3.0 SNP/kb in the coding regions to 27.6 SNP/kb in the transposable elements. A more inclusive new approach for analyzing duplication history is introduced here. It reveals an ancient whole-genome duplication, a recent segmental duplication on Chromosomes 11 and 12, and massive ongoing individual gene duplications. We find 18 distinct pairs of duplicated segments that cover 65.7% of the genome; 17 of these pairs date back to a common time before the divergence of the grasses. More important, ongoing individual gene duplications provide a never-ending source of raw material for gene genesis and are major contributors to the differences between members of the grass family

31st Annual Meeting and Associated Programs of the Society for Immunotherapy of Cancer (SITC 2016) : part two

Background The immunological escape of tumors represents one of the main ob- stacles to the treatment of malignancies. The blockade of PD-1 or CTLA-4 receptors represented a milestone in the history of immunotherapy. However, immune checkpoint inhibitors seem to be effective in specific cohorts of patients. It has been proposed that their efficacy relies on the presence of an immunological response. Thus, we hypothesized that disruption of the PD-L1/PD-1 axis would synergize with our oncolytic vaccine platform PeptiCRAd. Methods We used murine B16OVA in vivo tumor models and flow cytometry analysis to investigate the immunological background. Results First, we found that high-burden B16OVA tumors were refractory to combination immunotherapy. However, with a more aggressive schedule, tumors with a lower burden were more susceptible to the combination of PeptiCRAd and PD-L1 blockade. The therapy signifi- cantly increased the median survival of mice (Fig. 7). Interestingly, the reduced growth of contralaterally injected B16F10 cells sug- gested the presence of a long lasting immunological memory also against non-targeted antigens. Concerning the functional state of tumor infiltrating lymphocytes (TILs), we found that all the immune therapies would enhance the percentage of activated (PD-1pos TIM- 3neg) T lymphocytes and reduce the amount of exhausted (PD-1pos TIM-3pos) cells compared to placebo. As expected, we found that PeptiCRAd monotherapy could increase the number of antigen spe- cific CD8+ T cells compared to other treatments. However, only the combination with PD-L1 blockade could significantly increase the ra- tio between activated and exhausted pentamer positive cells (p= 0.0058), suggesting that by disrupting the PD-1/PD-L1 axis we could decrease the amount of dysfunctional antigen specific T cells. We ob- served that the anatomical location deeply influenced the state of CD4+ and CD8+ T lymphocytes. In fact, TIM-3 expression was in- creased by 2 fold on TILs compared to splenic and lymphoid T cells. In the CD8+ compartment, the expression of PD-1 on the surface seemed to be restricted to the tumor micro-environment, while CD4 + T cells had a high expression of PD-1 also in lymphoid organs. Interestingly, we found that the levels of PD-1 were significantly higher on CD8+ T cells than on CD4+ T cells into the tumor micro- environment (p < 0.0001). Conclusions In conclusion, we demonstrated that the efficacy of immune check- point inhibitors might be strongly enhanced by their combination with cancer vaccines. PeptiCRAd was able to increase the number of antigen-specific T cells and PD-L1 blockade prevented their exhaus- tion, resulting in long-lasting immunological memory and increased median survival

Selenium-Functionalized Corn Starch as a Biodegradable GPx Mimic with High Catalytic Performance

Selenium-functionalized starch (Se-starch80) is one of the main functional foods used for selenium supplementation. In traditional agriculture, Se-starch has some deficiencies such as long growth cycle and unstable selenium content that prevent its antioxidant performance. In this study, Se-starch was prepared by the nucleophilic addition between NaSeH and carbon-carbon double bond of octenyl succinic anhydride waxy corn starch ester (OSA starch). Some techniques such as 1HNMR, XPS, SEM-EDS, XRD and FT-IR were used to characterize the relevant samples and the results showed that the modification did not destroy the starch framework significantly and the catalytic center (negative divalent selenium) was anchored on the starch framework. The intensive distribution of catalytic center on the starch surface and the hydrophobic microenvironments derived from the OSA chains furnished the Se-starch80 with a high GPx-like catalytic activity (initial reaction rate = 3.64 μM/min). This value was about 1.5 × 105 times higher than that of a typical small-molecule GPx mimic (PhSeSePh). In addition, the Se-starch80, without any cytotoxicity, showed a saturated kinetic catalytic behavior that is similar to a typical enzyme. This work exemplifies a biodegradable selenium-functionalized polymer platform for the high-performing GPx mimic

Analysis of the Enantioselective Effects of PCB95 in Zebrafish (Danio rerio) Embryos through Targeted Metabolomics by UPLC-MS/MS.

As persistent organic pollutants, polychlorinated biphenyls (PCBs) accumulate in the bodies of animals and humans, resulting in toxic effects on the reproductive, immune, nervous, and endocrine systems. The biological and toxicological characteristics of enantiomers of chiral PCBs may differ, but these enantioselective effects of PCBs have not been fully characterized. In this study, we performed metabolomics analysis, using ultra-high performance liquid chromatography tandem mass spectrometry (UPLC-MS/MS) to investigate the enantioselective toxic effects of PCB95 in zebrafish (Danio rerio) embryos after exposure to three dose levels of 0.1, 1, and 10 μg/L for 72 h. Multivariate analysis directly reflected the metabolic perturbations caused by PCB95. The effects of (-)-PCB95 and (+)-PCB95 were more prominent than those of the racemate in zebrafish embryos. A total of 26 endogenous metabolites were selected as potential marker metabolites with variable importance at projection values larger than 1 and significant differences (p<0.05). These metabolites included amino acids, organic acids, nucleosides, betaine, and choline. The changes in these biomarkers were dependent on the enantiomer-specific structures of PCB95. Fifteen metabolic pathways were significantly affected, and several nervous and immune system-related metabolites were significantly validated after exposure. These metabolic changes indicated that the toxic effects of PCB95 may be associated with the interaction of PCB95 with the nervous and immune systems, thus resulting in disruption of energy metabolism and liver function

Effects of silicon on <i>Oryza sativa</i> L. seedling roots under simulated acid rain stress

<div><p>Silicon (Si) has an important function in reducing the damage of environmental stress on plants. Acid rain is a serious abiotic stress factor, and Si can alleviate the stress induced by acid rain on plants. Based on these assumptions, we investigated the effects of silicon on the growth, root phenotype, mineral element contents, hydrogen peroxide (H₂O₂) and antioxidative enzymes of rice (<i>Oryza sativa</i> L.) seedling roots under simulated acid rain (SAR) stress. The results showed that the combined or single effects of Si and/or SAR on rice roots depend on the concentration of Si and the pH of the SAR. The combined or single effects of a low or moderate concentration of Si (1.0 or 2.0 mM) and light SAR (pH 4.0) enhanced the growth of rice roots, and the combined effects were stronger than those of the single treatment. A high concentration of Si (4.0 mM) or severe SAR (pH 2.0) exerted deleterious effects. The incorporation of Si (1.0, 2.0 or 4.0 mM) into SAR with pH 3.0 or 2.0 promoted the rice root growth, decreased the H₂O₂ content, increased the Si concentration and the superoxide dismutase (SOD), catalase (CAT), peroxidase (POD) and ascorbate peroxidase (APX) activities, maintained the balance of mineral element (K, Ca, Mg, Fe, Zn, and Cu) concentrations in the roots of rice seedlings compared with SAR alone. The alleviatory effects observed with a moderate concentration of Si (2.0 mM) were better than the effects obtained with a low or high concentration of Si (1.0 or 4.0 mM). The observed effects were due to disruptions in the absorption and utilization of mineral nutrients and impacts on the activity of antioxidant enzymes in roots, and this conclusion suggests that the degree of rice root damage caused by acid rain might be attributed to not only acid rain but also the level of Si in the soil.</p></div