Boosting Neural Machine Translation with Dependency-Scaled Self-Attention Network

Syntax knowledge contributes its powerful strength in Neural machine translation (NMT) tasks. Early NMT works supposed that syntax details can be automatically learned from numerous texts via attention networks. However, succeeding researches pointed out that limited by the uncontrolled nature of attention computation, the NMT model requires an external syntax to capture the deep syntactic awareness. Although existing syntax-aware NMT methods have bored great fruits in combining syntax, the additional workloads they introduced render the model heavy and slow. Particularly, these efforts scarcely involve the Transformer-based NMT and modify its core self-attention network (SAN). To this end, we propose a parameter-free, dependency-scaled self-attention network (Deps-SAN) for syntax-aware Transformer-based NMT. A quantified matrix of dependency closeness between tokens is constructed to impose explicit syntactic constraints into the SAN for learning syntactic details and dispelling the dispersion of attention distributions. Two knowledge sparsing techniques are further integrated to avoid the model overfitting the dependency noises introduce by the external parser. Experiments and analyses on IWSLT14 German-to-English and WMT16 German-to-English benchmark NMT tasks verify the effectiveness of our approach

Differential gene expression in liver and small intestine from lactating rats compared to age-matched virgin controls detects increased mRNA of cholesterol biosynthetic genes

BACKGROUND: Lactation increases energy demands four- to five-fold, leading to a two- to three-fold increase in food consumption, requiring a proportional adjustment in the ability of the lactating dam to absorb nutrients and to synthesize critical biomolecules, such as cholesterol, to meet the dietary needs of both the offspring and the dam. The size and hydrophobicity of the bile acid pool increases during lactation, implying an increased absorption and disposition of lipids, sterols, nutrients, and xenobiotics. In order to investigate changes at the transcriptomics level, we utilized an exon array and calculated expression levels to investigate changes in gene expression in the liver, duodenum, jejunum, and ileum of lactating dams when compared against age-matched virgin controls. RESULTS: A two-way mixed models ANOVA was applied to detect differentially expressed genes. Significance calls were defined as a p \u3c 0.05 for the overall physiologic state effect (lactation vs. control), and a within tissue pairwise comparison of p \u3c 0.01. The proportion of false positives, an estimate of the ratio of false positives in the list of differentially expressed genes, was calculated for each tissue. The number of differentially expressed genes was 420 in the liver, 337 in the duodenum, 402 in the jejunum, and 523 in the ileum. The list of differentially expressed genes was in turn analyzed by Ingenuity Pathways Analysis (IPA) to detect biological pathways that were overrepresented. In all tissues, sterol regulatory element binding protein (Srebp)-regulated genes involved in cholesterol synthesis showed increased mRNA expression, with the fewest changes detected in the jejunum. We detected increased Scap mRNA in the liver only, suggesting an explanation for the difference in response to lactation between the liver and small intestine. Expression of Cyp7a1, which catalyzes the rate limiting step in the bile acid biosynthetic pathway, was also significantly increased in liver. In addition, decreased levels of mRNA associated with T-cell signaling were found in the jejunum and ileum. Several members of the Solute Carrier (SLC) and Adenosine Triphosphate Binding Cassette (ABC) superfamilies of membrane transporters were found to be differentially expressed; these genes may play a role in differences in nutrient and xenobiotic absorption and disposition. mRNA expression of SLC39a4_predicted, a zinc transporter, was increased in all tissues, suggesting that it is involved in increased zinc uptake during lactation. Microarray data are available through GEO under GSE19175. CONCLUSIONS: We detected differential expression of mRNA from several pathways in lactating dams, including upregulation of the cholesterol biosynthetic pathway in liver and intestine, consistent with Srebp activation. Differential T-Cell signaling in the two most distal regions of the small intestine (ileum and jejunum) was also noted, as well as differential expression of transporters that likely play a key role in nutrient uptake

IL-8 Enhances Therapeutic Effects of BMSCs on Bone Regeneration via CXCR2-Mediated PI3k/Akt Signaling Pathway

Background/Aims: Tissue engineering bone transplantation with bone marrow mesenchymal stem cells (BMSCs) is an effective technology to treat massive bone loss, while molecular regulation of the bone regeneration processes remains poorly understood. Here, we aimed to assess the role of interleukin-8 (IL-8) in the recruitment of host cells by seeded BMSCs and in the bone regeneration. Methods: A transwell assay was performed to examine the role of IL-8/CXCR1/CXCR2/PI3k/Akt on the migration potential of hBMSCs. The in vitro chondrogenic differentiation of hBMSCs was assessed by examination of 2 chondrogenic markers, Sox9 and type 2 collagen (COL2). mBMSCs were used in tissue engineered bone (TEB) with/without IL-8 implanted into bone defect area with CXCR2 or Akt inhibitors. Density and Masson staining of the regenerated bone were assessed. The chondrogenesis was assessed by expression levels of associated proteins, Sox9 and COL2, by RT-qPCR and by immunohistochemistry. Results: IL-8 may trigger in vitro migration of hBMSCs via CXCR2-mediated PI3k/Akt signaling pathway. IL-8 enhances osteogenesis in the TEB-implanted bone defect in mice. IL-8 induces chondrogenic differentiation of hBMSCs via CXCR2-mediated PI3k/Akt signaling pathway in vitro and in vivo. Conclusions: IL-8 enhances therapeutic effects of MSCs on bone regeneration via CXCR2-mediated PI3k/Akt signaling pathway

New Exact Traveling Wave Solutions of the Time Fractional Complex Ginzburg-Landau Equation via the Conformable Fractional Derivative

In this study, the exact traveling wave solutions of the time fractional complex Ginzburg-Landau equation with the Kerr law and dual-power law nonlinearity are studied. The nonlinear fractional partial differential equations are converted to a nonlinear ordinary differential equation via a traveling wave transformation in the sense of conformable fractional derivatives. A range of solutions, which include hyperbolic function solutions, trigonometric function solutions, and rational function solutions, is derived by utilizing the new extendedG′/G-expansion method. By selecting appropriate parameters of the solutions, numerical simulations are presented to explain further the propagation of optical pulses in optic fibers.</jats:p

Classification of All Single Traveling Wave Solutions of Fractional Coupled Boussinesq Equations via the Complete Discrimination System Method

In this paper, the complete discrimination system method is used to construct the exact traveling wave solutions for fractional coupled Boussinesq equations in the sense of conformable fractional derivatives. As a result, we get the exact traveling wave solutions of fractional coupled Boussinesq equations, which include rational function solutions, Jacobian elliptic function solutions, implicit solutions, hyperbolic function solutions, and trigonometric function solutions. Finally, the obtained solution is compared with the existing literature

New Exact Traveling Wave Solutions of the Time Fractional Complex Ginzburg-Landau Equation via the Conformable Fractional Derivative

In this study, the exact traveling wave solutions of the time fractional complex Ginzburg-Landau equation with the Kerr law and dual-power law nonlinearity are studied. The nonlinear fractional partial differential equations are converted to a nonlinear ordinary differential equation via a traveling wave transformation in the sense of conformable fractional derivatives. A range of solutions, which include hyperbolic function solutions, trigonometric function solutions, and rational function solutions, is derived by utilizing the new extended G′/G-expansion method. By selecting appropriate parameters of the solutions, numerical simulations are presented to explain further the propagation of optical pulses in optic fibers

Bifurcation and exact solutions for the (2+12+1)-dimensional conformable time-fractional Zoomeron equation

AbstractIn this paper, the bifurcation and new exact solutions for the ($2+1$2+1)-dimensional conformable time-fractional Zoomeron equation are investigated by utilizing two reliable methods, which are generalized$(G'/G)$(G′/G)-expansion method and the integral bifurcation method. The exact solutions of the ($2+1$2+1)-dimensional conformable time-fractional Zoomeron equation are obtained by utilizing the generalized$(G'/G)$(G′/G)-expansion method, these solutions are classified as hyperbolic function solutions, trigonometric function solutions, and rational function solutions. Giving different parameter conditions, many integral bifurcations, phase portraits, and traveling wave solutions for the equation are obtained via the integral bifurcation method. Graphical representations of different kinds of the exact solutions reveal that the two methods are of significance for constructing the exact solutions of fractional partial differential equation.</jats:p

Classification of All Single Traveling Wave Solutions of Fractional Perturbed Gerdjikov–Ivanov Equation

The fractional perturbed Gerdjikov–Ivanov (pGI) equation plays a momentous role in nonlinear fiber optics, especially in the application of photonic crystal fibers. Constructing traveling wave solutions to this equation is a very challenging task in physics and mathematics. In the current article, our main purpose is to give the classifications of traveling wave solutions of the fractional pGI equation. These results can help physicists to further explain the complex fractional pGI equation.</jats:p