Learning to Selectively Transfer: Reinforced Transfer Learning for Deep Text Matching

Deep text matching approaches have been widely studied for many applications including question answering and information retrieval systems. To deal with a domain that has insufficient labeled data, these approaches can be used in a Transfer Learning (TL) setting to leverage labeled data from a resource-rich source domain. To achieve better performance, source domain data selection is essential in this process to prevent the "negative transfer" problem. However, the emerging deep transfer models do not fit well with most existing data selection methods, because the data selection policy and the transfer learning model are not jointly trained, leading to sub-optimal training efficiency. In this paper, we propose a novel reinforced data selector to select high-quality source domain data to help the TL model. Specifically, the data selector "acts" on the source domain data to find a subset for optimization of the TL model, and the performance of the TL model can provide "rewards" in turn to update the selector. We build the reinforced data selector based on the actor-critic framework and integrate it to a DNN based transfer learning model, resulting in a Reinforced Transfer Learning (RTL) method. We perform a thorough experimental evaluation on two major tasks for text matching, namely, paraphrase identification and natural language inference. Experimental results show the proposed RTL can significantly improve the performance of the TL model. We further investigate different settings of states, rewards, and policy optimization methods to examine the robustness of our method. Last, we conduct a case study on the selected data and find our method is able to select source domain data whose Wasserstein distance is close to the target domain data. This is reasonable and intuitive as such source domain data can provide more transferability power to the model.Comment: Accepted to WSDM 201

Incidence of first primary central nervous system tumors in California, 2001–2005

We examined the incidence of first primary central nervous system tumors (PCNST) in California from 2001–2005. This study period represents the first five years of data collection of benign PCNST by the California Cancer Registry. California’s age-adjusted incidence rates (AAIR) for malignant and benign PCNST (5.5 and 8.5 per 100,000, respectively). Malignant PCNST were highest among non-Hispanic white males (7.8 per 100,000). Benign PCNST were highest among African American females (10.5 per 100,000). Hispanics, those with the lowest socioeconomic status, and those who lived in rural California were found to be significantly younger at diagnosis. Glioblastoma was the most frequent malignant histology, while meningioma had the highest incidence among benign histologies (2.6 and 4.5 per 100,000, respectively). This study is the first in the US to compare malignant to benign PCNST using a population-based data source. It illustrates the importance of PCNST surveillance in California and in diverse communities

Evaluation of Wuchereria bancrofti GST as a Vaccine Candidate for Lymphatic Filariasis

Lymphatic parasites survive for years in a complex immune environment by adopting various strategies of immune modulation, which includes counteracting the oxidative free radical damage caused by the host. We now know that the filarial parasites secrete antioxidant enzymes. Among these, the glutathione-S-transferases (GSTs) have the potent ability to effectively neutralize cytotoxic products arising from reactive oxygen species (ROS) that attack cell membranes. Thus, GSTs have the potential to protect the parasite against host oxidative stress. GSTs of several helminthes, including schistosomes, fasciola and the filarial parasite Seteria cervi, are also involved in inducing protective immunity in the host. The schistosome 28 kDa GST has been successfully developed into a vaccine and is currently in Phase II clinical trials. Thus, GST appears to be a potential target for vaccine development. Therefore, in the present study, we cloned W. bancrofti GST, and expressed and purified the recombinant protein. Immunization and challenge experiments showed that 61% of protection could be achieved against B. malayi infections in a jird model. In vitro studies confirm that the anti-WbGST antibodies participate in the killing of B. malayi L3 through an ADCC mechanism and enzymatic activity of WbGST appears to be critical for this larvicidal function

Search for Kaluza-Klein Graviton Emission in ppˉp\bar{p} Collisions at s=1.8\sqrt{s}=1.8 TeV using the Missing Energy Signature

We report on a search for direct Kaluza-Klein graviton production in a data sample of 84 ${pb}^{-1}$ of \ppb collisions at $\sqrt{s}$ = 1.8 TeV, recorded by the Collider Detector at Fermilab. We investigate the final state of large missing transverse energy and one or two high energy jets. We compare the data with the predictions from a $3+1+n$-dimensional Kaluza-Klein scenario in which gravity becomes strong at the TeV scale. At 95% confidence level (C.L.) for $n$=2, 4, and 6 we exclude an effective Planck scale below 1.0, 0.77, and 0.71 TeV, respectively.Comment: Submitted to PRL, 7 pages 4 figures/Revision includes 5 figure

Measurement of the average time-integrated mixing probability of b-flavored hadrons produced at the Tevatron

We have measured the number of like-sign (LS) and opposite-sign (OS) lepton pairs arising from double semileptonic decays of $b$ and $\bar{b}$-hadrons, pair-produced at the Fermilab Tevatron collider. The data samples were collected with the Collider Detector at Fermilab (CDF) during the 1992-1995 collider run by triggering on the existence of $\mu \mu$ and $e \mu$ candidates in an event. The observed ratio of LS to OS dileptons leads to a measurement of the average time-integrated mixing probability of all produced $b$-flavored hadrons which decay weakly, $\bar{\chi} = 0.152 \pm 0.007$ (stat.) $\pm 0.011$ (syst.), that is significantly larger than the world average $\bar{\chi} = 0.118 \pm 0.005$.Comment: 47 pages, 10 figures, 15 tables Submitted to Phys. Rev.

Metabolomic Profiling of Drug Responses in Acute Myeloid Leukaemia Cell Lines

Combined bezafibrate (BEZ) and medroxyprogesterone acetate (MPA) exert unexpected antileukaemic activities against acute myeloid leukaemia (AML) and these activities are associated with the generation of reactive oxygen species (ROS) within the tumor cells. Although the generation of ROS by these drugs is supported by preceding studies including our own, the interrelationship between the cellular effects of the drugs and ROS generation is not well understood. Here we report the use of NMR metabolomic profiling to further study the effect of BEZ and MPA on three AML cell lines and to shed light on the underlying mechanism of action. For this we focused on drug effects induced during the initial 24 hours of treatment prior to the onset of overt cellular responses and examined these in the context of basal differences in metabolic profiles between the cell lines. Despite their ultimately profound cellular effects, the early changes in metabolic profiles engendered by these drugs were less pronounced than the constitutive metabolic differences between cell types. Nonetheless, drug treatments engendered common metabolic changes, most markedly in the response to the combination of BEZ and MPA. These responses included changes to TCA cycle intermediates consistent with recently identified chemical actions of ROS. Notable amongst these was the conversion of α-ketoglutarate to succinate which was recapitulated by the treatment of cell extracts with exogenous hydrogen peroxide. These findings indicate that the actions of combined BEZ and MPA against AML cells are indeed mediated downstream of the generation of ROS rather than some hitherto unsuspected mechanism. Moreover, our findings demonstrate that metabolite profiles represent highly sensitive markers for genomic differences between cells and their responses to external stimuli. This opens new perspectives to use metabolic profiling as a tool to study the rational redeployment of drugs in new disease settings

Smoking cessation, alcohol intake and transient increase in the risk of metabolic syndrome among Japanese smokers at one health checkup institution

<p>Abstract</p> <p>Background</p> <p>Metabolic syndrome (MetS) is potentially effective measures to identify individuals at risk of coronary heart disease (CHD) and type 2 diabetes. To verify the hypothesis that smoking cessation may increase the risk of MetS, a follow-up study taking drinking habit into account was conducted for the examinees at one health checkup institution.</p> <p>Methods</p> <p>Subjects were the examinees who visited the Institution for Disease Prevention and Health Checkup, Seirei Mikatabara Hospital for annual health checkup from January 2003 to December 2006. Among them, 5,872 smokers (5,479 men, 93.3%) free from MetS at the first year in two consecutive years were selected. For the long term follow-up, the risk of MetS among those who maintained their nonsmoking status for 1 or 2 additional years was evaluated.</p> <p>Results</p> <p>Relative to non-quitters, quitters showed a significantly elevated adjusted hazard ratio (aHR) of MetS in two consecutive years (aHR = 2.09, 95% confidence interval: 1.43–3.04, <it>P </it>< 0.001). The aHR was higher among the quitters who had a drinking habit at the first year (aHR = 2.42, 95% CI: 1.48–3.94, <it>P </it>< 0.001). Analyses for 1 or 2 additional years of follow-up revealed that this significant increase in risk of MetS was transient.</p> <p>Conclusion</p> <p>The present study revealed that smoking cessation elevated the risk of MetS significantly, especially among drinkers. Although this detrimental effect of smoking cessation was found to be during only a short term, our results suggested that we should take measures, presumably including interventions for alcohol cessation, not to expose smoking quitters to this adverse effect. Further investigations are required to confirm our findings.</p

Innate Signaling in Otitis Media: Pathogenesis and Recovery

Otitis media (OM) is the most prevalent childhood disease in developed countries. Involvement of innate immunity mediated by Toll-like receptors (TLRs) in OM has been implicated primarily in cell lines and by association studies of innate immune gene polymorphisms with OM prevalence. However, the precise role of innate immunity in OM is incompletely understood. We review recent research that has advanced our understanding of how innate immunity in the middle ear is mediated by the interaction of pathogen molecules with receptors such as the TLRs, leading to the activation of adaptor molecules and production of proinflammatory cytokines. TLR genes and signaling molecules are upregulated in OM in a murine model. Deletion of several key innate immune genes results in persistent OM in mice, coupled with an inability to clear bacterial infection from the middle ear. It is concluded that an intact innate immune signaling system is critical to recovery from bacterial OM

Alternative splicing and nonsense-mediated decay regulate telomerase reverse transcriptase (TERT) expression during virus-induced lymphomagenesis in vivo

<p>Abstract</p> <p>Background</p> <p>Telomerase activation, a critical step in cell immortalization and oncogenesis, is partly regulated by alternative splicing. In this study, we aimed to use the Marek's disease virus (MDV) T-cell lymphoma model to evaluate TERT regulation by splicing during lymphomagenesis <it>in vivo</it>, from the start point to tumor establishment.</p> <p>Results</p> <p>We first screened cDNA libraries from the chicken MDV lymphoma-derived MSB-1 T- cell line, which we compared with B (DT40) and hepatocyte (LMH) cell lines. The chTERT splicing pattern was cell line-specific, despite similar high levels of telomerase activity. We identified 27 alternative transcripts of chicken TERT (chTERT). Five were in-frame alternative transcripts without <it>in vitro </it>telomerase activity in the presence of viral or chicken telomerase RNA (vTR or chTR), unlike the full-length transcript. Nineteen of the 22 transcripts with a premature termination codon (PTC) harbored a PTC more than 50 nucleotides upstream from the 3' splice junction, and were therefore predicted targets for nonsense-mediated decay (NMD). The major PTC-containing alternatively spliced form identified in MSB1 (ie10) was targeted to the NMD pathway, as demonstrated by UPF1 silencing. We then studied three splicing events separately, and the balance between in-frame alternative splice variants (d5f and d10f) plus the NMD target i10ec and constitutively spliced chTERT transcripts during lymphomagenesis induced by MDV indicated that basal telomerase activity in normal T cells was associated with a high proportion of in-frame non functional isoforms and a low proportion of constitutively spliced chTERT. Telomerase upregulation depended on an increase in active constitutively spliced chTERT levels and coincided with a switch in alternative splicing from an in-frame variant to NMD-targeted variants.</p> <p>Conclusions</p> <p>TERT regulation by splicing plays a key role in telomerase upregulation during lymphomagenesis, through the sophisticated control of constitutive and alternative splicing. Using the MDV T-cell lymphoma model, we identified a chTERT splice variant as a new NMD target.</p

Rhinosinusitis derived Staphylococcal enterotoxin B possibly associates with pathogenesis of ulcerative colitis

BACKGROUND: During clinical practice, we noticed that some patients with both ulcerative colitis (UC) and chronic rhinosinusitis (CRS) showed amelioration of UC after treatment of CRS. This study was designed to identify a possible association between CRS and UC. METHODS: Thirty-two patients with both CRS and UC received treatment with functional endoscopic sinus surgery (FESS) for CRS. Clinical symptom scores for CRS and UC, as well as serum levels of anti-Staphylococcal enterotoxin B (SEB) were evaluated at week 0 and week 12. Sinus wash fluid SEB content was measured with enzyme-linked immunosorbent assay (ELISA). The surgically removed tissues were cultured to identify growth of Staphylococcus. aureus (S. aureus). Immunohistochemistry was employed to identify anti-SEB positive cells in the colonic mucosa. Colonic biopsies were obtained and incubated with SEB. Mast cell activation in the colonic mucosa in response to incubation with SEB was observed with electron microscopy and immunoassay. RESULTS: The clinical symptom scores of CRS and UC severe scores (UCSS) were significantly reduced in the UC-CRS patients after FESS. The number of cultured S. aureus colonies from the surgically removed sinus mucosa significantly correlated with the decrease in UCSS. High levels of SEB were detected in the sinus wash fluids of the patients with UC-CRS. Histamine and tryptase release was significantly higher in the culture supernate in the patients with UC-CRS than the patients with UC-only and normal controls. Anti-SEB positive cells were located in the colonic mucosa. CONCLUSION: The pathogenesis of UC in some patients may be associated with their pre-existing CRS by a mechanism of swallowing sinusitis-derived SEB. We speculate that SEB initiates inappropriate immune reactions and inflammation in the colonic mucosa that further progresses to UC