Toward Interpretable Deep Reinforcement Learning with Linear Model U-Trees

Deep Reinforcement Learning (DRL) has achieved impressive success in many applications. A key component of many DRL models is a neural network representing a Q function, to estimate the expected cumulative reward following a state-action pair. The Q function neural network contains a lot of implicit knowledge about the RL problems, but often remains unexamined and uninterpreted. To our knowledge, this work develops the first mimic learning framework for Q functions in DRL. We introduce Linear Model U-trees (LMUTs) to approximate neural network predictions. An LMUT is learned using a novel on-line algorithm that is well-suited for an active play setting, where the mimic learner observes an ongoing interaction between the neural net and the environment. Empirical evaluation shows that an LMUT mimics a Q function substantially better than five baseline methods. The transparent tree structure of an LMUT facilitates understanding the network's learned knowledge by analyzing feature influence, extracting rules, and highlighting the super-pixels in image inputs.Comment: This paper is accepted by ECML-PKDD 201

Raf/MEK/MAPK signaling stimulates the nuclear translocation and transactivating activity of FOXM1c

The forkhead box (FOX) transcription factor FOXM1 is ubiquitously expressed in proliferating cells. FOXM1 expression peaks at the G2/M phase of the cell cycle and its functional deficiency in mice leads to defects in mitosis. To investigate the role of FOXM1 in the cell cycle, we used synchronized hTERT-BJ1 fibroblasts to examine the cell cycle-dependent regulation of FOXM1 function. We observed that FOXM1 is localized mainly in the cytoplasm in cells at late-G1 and S phases. Nuclear translocation occurs just before entry into the G2/M phase and is associated with phosphorylation of FOXM1. Consistent with the dependency of FOXM1 function on mitogenic signals, nuclear translocation of FOXM1 requires activity of the Raf/MEK/MAPK signaling pathway and is enhanced by the MAPK activator aurintricarboxylic acid. This activating effect was suppressed by the MEK1/2 inhibitor U0126. In transient reporter assays, constitutively active MEK1 enhances the transactivating effect of FOXM1c, but not FOXM1b, on the cyclin B1 promoter. RT-PCR analysis confirmed that different cell lines and tissues predominantly express the FOXM1c transcript. Mutations of two ERK1/2 target sequences within FOXM1c completely abolish the MEK1 enhancing effect, suggesting a direct link between Raf/MEK/MAPK signaling and FOXM1 function. Importantly, inhibition of Raf/MEK/MAPK signaling by U0126 led to suppression of FOXM1 target gene expression and delayed progression through G2/M, verifying the functional relevance of FOXM1 activation by MEK1. In summary, we provide the first evidence that Raf/MEK/MAPK signaling exerts its G2/M regulatory effect via FOXM1c.published_or_final_versio

Effectiveness of porous silicon nanoparticle treatment at inhibiting the migration of a heterogeneous glioma cell population

Background: Approximately 80% of brain tumours are gliomas. Despite treatment, patient mortality remains high due to local metastasis and relapse. It has been shown that transferrin-functionalised porous silicon nanoparticles (Tf@pSiNPs) can inhibit the migration of U87 glioma cells. However, the underlying mechanisms and the effect of glioma cell heterogeneity, which is a hallmark of the disease, on the efficacy of Tf@pSiNPs remains to be addressed. Results: Here, we observed that Tf@pSiNPs inhibited heterogeneous patient-derived glioma cells’ (WK1) migration across small perforations (3 μm) by approximately 30%. A phenotypical characterisation of the migrated subpopulations revealed that the majority of them were nestin and fibroblast growth factor receptor 1 positive, an indication of their cancer stem cell origin. The treatment did not inhibit cell migration across large perforations (8 μm), nor cytoskeleton formation. This is in agreement with our previous observations that cellular-volume regulation is a mediator of Tf@pSiNPs’ cell migration inhibition. Since aquaporin 9 (AQP9) is closely linked to cellular-volume regulation, and is highly expressed in glioma, the effect of AQP9 expression on WK1 migration was investigated. We showed that WK1 migration is correlated to the differential expression patterns of AQP9. However, AQP9-silencing did not affect WK1 cell migration across perforations, nor the efficacy of cell migration inhibition mediated by Tf@pSiNPs, suggesting that AQP9 is not a mediator of the inhibition. Conclusion: This in vitro investigation highlights the unique therapeutic potentials of Tf@pSiNPs against glioma cell migration and indicates further optimisations that are required to maximise its therapeutic efficacies. Graphic Abstract: [Figure not available: see fulltext.

Mixed Feelings about the Diagnosis of Type 2 Diabetes Mellitus: A Consequence of Adjusting To Health Related Quality Of Life

This study aims to explore patients’ reactions to the diagnosis of type 2 diabetes mellitus (T2DM) and their health related quality of life. We adopted a qualitative exploratory study design using a thematic analysis. Twelve patients with T2DM for more than a 2-year duration were interviewed using a semi-structured interview guide. Both purposive and theoretical samplings were used for data collection. The in-depth interviews were audio-taped and transcribed verbatim, followed by line-by-line coding and constant comparison to identify the themes. Data management was facilitated using Nvivo 10. Patients shared their mixed feelings about the diagnosis of T2DM. Six domains of quality of life emerged from these interviews, namely physical and social functioning, work function and social obligations, dietary freedom and conforming to treatment standard. Diabetes management needs to take these themes and patients’ feelings associated with their quality of life into consideration

Profiling biomolecules at cell-biomaterial interface by quantitative proteomics

Session: Controlling Microenvironment and Cell Fate: abstract no. 789INTRODUCTION: Implant surface structure and chemistry determines the contacting cell’s fate. Therefore, the fate of those cells directly affect bone-implant incorporation in clinical practice1-5. However, how these chemical and mechanical signals translating to cellular responses are not yet known. The major drawback is a lack of systematic study of cellbiomaterial interaction in terms of protein expression, specifically, at the attachment interface between the cell and biomaterial (adherence surface, AS). Therefore, we have proposed to unbiasedly identify the biomolecules at the interface by proteomics. This method combines the use of a subcellular fractionation with quantitative mass …postprintThe 2010 North America Conference of the Tissue Engineering and Regenerative Medicine International Society (TERMIS-NA 2010), Orlando, FL., 5-8 December 2010

Identification and Expression Profiling of MicroRNAs in the Brain, Liver and Gonads of Marine Medaka (Oryzias melastigma) and in Response to Hypoxia

The marine medaka (Oryzias melastigma) has been increasingly used as a fish model for detecting environmental stresses and chemical contaminants in the marine environment. Recent mammalian studies have shown that environmental stresses can alter the expression profiles of microRNAs (miRNAs), leading to transgenerational effects. Here, we use high-throughput Illumina RNA sequencing (RNA-Seq) for miRNA transcriptome analysis of brain, liver, and gonads from sexually mature male and female marine medaka. A total of 128,883,806 filtered sequence reads were generated from six small RNA libraries, identifying a total of 2,125,663 non-redundant sequences. These sequences were aligned and annotated to known animal miRNAs (miRBase) using the BLAST method. A total of 223 distinct miRNA types were identified, with the greatest number expressed in brain tissue. Our data suggested that 55 miRNA types from 34 families are common to all tested tissues, while some of the miRNAs are tissue-enriched or sex-enriched. Quantitative real-time PCR analysis further demonstrated that let-7a, miR-122, and miR-9-3p were downregulated in hypoxic female medaka, while miR-2184 was specifically upregulated in the testis of hypoxic male fish. This is the first study to identify miRNAs in O. melastigma using small RNA deep sequencing technology. Because miRNA expression is highly conserved between marine medaka and other vertebrates, marine medaka may serve as a good model for studies on the functional roles of miRNAs in hypoxia stress response and signaling in marine fish.published_or_final_versio

The Complexity of Vascular and Non-Vascular Complications of Diabetes: The Hong Kong Diabetes Registry

Diabetes is a complex disease characterized by chronic hyperglycemia and multiple phenotypes. In 1995, we used a doctor-nurse-clerk team and structured protocol to establish the Hong Kong Diabetes Registry in a quality improvement program. By 2009, we had accrued 2616 clinical events in 9588 Chinese type 2 diabetic patients with a follow-up duration of 6 years. The detailed phenotypes at enrollment and follow-up medications have allowed us to develop a series of risk equations to predict multiple endpoints with high sensitivity and specificity. In this prospective database, we were able to validate findings from clinical trials in real practice, confirm close links between cardiovascular and renal disease, and demonstrate the emerging importance of cancer as a leading cause of death. In addition to serving as a tool for risk stratification and quality assurance, ongoing data analysis of the registry also reveals secular changes in disease patterns and identifies unmet needs

A meta-analysis of narrow-band imaging for the diagnosis of primary nasopharyngeal carcinoma [version 1; referees: 2 approved]

Background: Narrow band imaging (NBI), an endoscopic technique featuring an augmented definition of microvasculature and mucosal patterns. NBI is increasingly advocated as a tool to characterize neoplasia and intestinal metaplasia in endoscopic standards, such as for colorectal polyps and tumors. Recently NBI has also been studied in the detection of Nasopharyngeal Carcinoma (NPC). Here we aimed to assess the diagnostic utility of NBI for the diagnosis of NPC. Methods: A meta-analysis of studies comparing narrow-band imaging and white light endoscopy in the diagnosis of primary nasopharyngeal carcinoma was performed. The review process involved two independent investigators. The databases used were MEDLINE, PubMed, the Cochrane library, Embase, and the Web of Science. Statistical analysis was performed with OpenMetaAnalyst, MetaDiSc version 1.4, and Medcalc version 17.9.7.  Results: Five studies including 2480 patients were included. The sensitivity and specificity for narrow-band imaging were 0.90 (0.73-0.97) and 0.95 (0.81-0.99) respectively. The positive likelihood ratio and negative likelihood ratio were 18.82 (0.31-82.1) and 0.08 (0.02-0.31). For white light endoscopy, the sensitivity and specificity were 0.77 (0.58-0.89) and 0.91 (0.79-0.96). The positive likelihood ratio was 7.61 (3.61-16.04), and the negative likelihood ratio was 0.21 (0.11-0.39). The odds ratio for detection rates between narrow-band imaging and white light endoscopy was 4.29 (0.56-33.03, p = 0.16). Area under the curve for narrow-band imaging was 0.98 (SE: 0.02), and for white light it was 0.93 (SE: 0.03). There was no significant difference in the receiver operating characteristic curves between the two modalities (p = 0.14). Conclusion: Narrow-band imaging showed a higher sensitivity and positive likelihood ratio for the diagnosis of nasopharyngeal carcinoma. However, there was no significant difference in detection rates compared to white light endoscopy. Further investigation with a uniform diagnostic criteria and terminology is needed for narrow-band imaging in the diagnosis of nasopharyngeal carcinoma

From design to implementation - The Joint Asia Diabetes Evaluation (JADE) program: A descriptive report of an electronic web-based diabetes management program

<p>Abstract</p> <p>Background</p> <p>The Joint Asia Diabetes Evaluation (JADE) Program is a web-based program incorporating a comprehensive risk engine, care protocols, and clinical decision support to improve ambulatory diabetes care.</p> <p>Methods</p> <p>The JADE Program uses information technology to facilitate healthcare professionals to create a diabetes registry and to deliver an evidence-based care and education protocol tailored to patients' risk profiles. With written informed consent from participating patients and care providers, all data are anonymized and stored in a databank to establish an Asian Diabetes Database for research and publication purpose.</p> <p>Results</p> <p>The JADE electronic portal (e-portal: <url>http://www.jade-adf.org</url>) is implemented as a Java application using the Apache web server, the mySQL database and the Cocoon framework. The JADE e-portal comprises a risk engine which predicts 5-year probability of major clinical events based on parameters collected during an annual comprehensive assessment. Based on this risk stratification, the JADE e-portal recommends a care protocol tailored to these risk levels with decision support triggered by various risk factors. Apart from establishing a registry for quality assurance and data tracking, the JADE e-portal also displays trends of risk factor control at each visit to promote doctor-patient dialogues and to empower both parties to make informed decisions.</p> <p>Conclusions</p> <p>The JADE Program is a prototype using information technology to facilitate implementation of a comprehensive care model, as recommended by the International Diabetes Federation. It also enables health care teams to record, manage, track and analyze the clinical course and outcomes of people with diabetes.</p

On the Morphology, Structure and Field Emission Properties of Silver-Tetracyanoquinodimethane Nanostructures

Silver-tetracyanoquinodimethane(Ag-TCNQ) nanostructured arrays with different morphologies were grown by an organic vapor-transport reaction under different conditions. The field emission properties of nanostructured arrays were studied systematically. Their morphology and crystal structure were characterized by SEM and XRD, respectively. It was found that the field emission properties were strongly dependent on the reaction temperature and the initial Ag film thickness. The lowest turn-on field with 10-nm-thick silver film is about 2.0 V/μm, comparable to that of carbon nanotubes. The film crystal structure and the morphology are contributed to the final emission performance