Taking gradients through experiments: LSTMs and memory proximal policy optimization for black-box quantum control

In this work we introduce the application of black-box quantum control as an interesting rein- forcement learning problem to the machine learning community. We analyze the structure of the reinforcement learning problems arising in quantum physics and argue that agents parameterized by long short-term memory (LSTM) networks trained via stochastic policy gradients yield a general method to solving them. In this context we introduce a variant of the proximal policy optimization (PPO) algorithm called the memory proximal policy optimization (MPPO) which is based on this analysis. We then show how it can be applied to specific learning tasks and present results of nu- merical experiments showing that our method achieves state-of-the-art results for several learning tasks in quantum control with discrete and continouous control parameters

Recognising facial expressions in video sequences

We introduce a system that processes a sequence of images of a front-facing human face and recognises a set of facial expressions. We use an efficient appearance-based face tracker to locate the face in the image sequence and estimate the deformation of its non-rigid components. The tracker works in real-time. It is robust to strong illumination changes and factors out changes in appearance caused by illumination from changes due to face deformation. We adopt a model-based approach for facial expression recognition. In our model, an image of a face is represented by a point in a deformation space. The variability of the classes of images associated to facial expressions are represented by a set of samples which model a low-dimensional manifold in the space of deformations. We introduce a probabilistic procedure based on a nearest-neighbour approach to combine the information provided by the incoming image sequence with the prior information stored in the expression manifold in order to compute a posterior probability associated to a facial expression. In the experiments conducted we show that this system is able to work in an unconstrained environment with strong changes in illumination and face location. It achieves an 89\% recognition rate in a set of 333 sequences from the Cohn-Kanade data base

Accounting Problems Under the Excess Profits Tax

DNA vaccines based on subunits from pathogens have several advantages over other vaccine strategies. DNA vaccines can easily be modified, they show good safety profiles, are stable and inexpensive to produce, and the immune response can be focused to the antigen of interest. However, the immunogenicity of DNA vaccines which is generally quite low needs to be improved. Electroporation and co-delivery of genetically encoded immune adjuvants are two strategies aiming at increasing the efficacy of DNA vaccines. Here, we have examined whether targeting to antigen-presenting cells (APC) could increase the immune response to surface envelope glycoprotein (Env) gp120 from Human Immunodeficiency Virus type 1 (HIV- 1). To target APC, we utilized a homodimeric vaccine format denoted vaccibody, which enables covalent fusion of gp120 to molecules that can target APC. Two molecules were tested for their efficiency as targeting units: the antibody-derived single chain Fragment variable (scFv) specific for the major histocompatilibility complex (MHC) class II I-E molecules, and the CC chemokine ligand 3 (CCL3). The vaccines were delivered as DNA into muscle of mice with or without electroporation. Targeting of gp120 to MHC class II molecules induced antibodies that neutralized HIV-1 and that persisted for more than a year after one single immunization with electroporation. Targeting by CCL3 significantly increased the number of HIV-1 gp120-reactive CD8(+) T cells compared to non-targeted vaccines and gp120 delivered alone in the absence of electroporation. The data suggest that chemokines are promising molecular adjuvants because small amounts can attract immune cells and promote immune responses without advanced equipment such as electroporation.Funding Agencies|Research Council of Norway; Odd Fellow</p

Non-Visual Effects of Light on Melatonin, Alertness and Cognitive Performance: Can Blue-Enriched Light Keep Us Alert?

Light exposure can cascade numerous effects on the human circadian process via the non-imaging forming system, whose spectral relevance is highest in the short-wavelength range. Here we investigated if commercially available compact fluorescent lamps with different colour temperatures can impact on alertness and cognitive performance

Identification of JAK/STAT signalling components by genome-wide RNA interference

Signalling pathways mediating the transduction of information between cells are essential for development, cellular differentiation and homeostasis. Their dysregulation is also frequently associated with human malignancies. The Janus tyrosine kinase/signal transducer and activator of transcription (JAK/STAT) pathway represents one such signalling cascade whose evolutionarily conserved roles include cell proliferation and haematopoiesis. Here we describe a systematic genome-wide survey for genes required for JAK/STAT pathway activity. Analysis of 20,026 RNA interference (RNAi)-induced phenotypes in cultured Drosophila melanogaster haemocyte-like cells identified interacting genes encoding 4 known and 86 previously uncharacterized proteins. Subsequently, cell-based epistasis experiments were used to classify these proteins on the basis of their interaction with known components of the signalling cascade. In addition to multiple human disease gene homologues, we have found the tyrosine phosphatase Ptp61F and the Drosophila homologue of BRWD3, a bromo-domain-containing protein disrupted in leukaemia. Moreover, in vivo analysis demonstrates that disrupted dBRWD3 and overexpressed Ptp61F function as suppressors of leukaemia-like blood cell tumours. This screen represents a comprehensive identification of novel loci required for JAK/STAT signalling and provides molecular insights into an important pathway relevant for human cancer. Human homologues of identified pathway modifiers may constitute targets for therapeutic interventions.publishe

Overexpression of microRNA-206 in the skeletal muscle from myotonic dystrophy type 1 patients

<p>Abstract</p> <p>Background</p> <p>MicroRNAs are highly conserved, noncoding RNAs involved in post-transcriptional gene silencing. They have been shown to participate in a wide range of biological processes, including myogenesis and muscle regeneration. The goal of this study is to test the hypothesis that myo-miRs (myo = muscle + miR = miRNA) expression is altered in muscle from patients affected by myotonic dystrophy type 1 (DM1), the most frequently inherited neuromuscular disease in adults. In order to gain better insights about the role of miRNAs in the DM1 pathogenesis, we have also analyzed the muscular expression of miR-103 and miR-107, which have been identified <it>in silico </it>as attractive candidates for binding to the <it>DMPK </it>mRNA.</p> <p>Methods</p> <p>To this aim, we have profiled the expression of miR-133 (miR-133a, miR-133b), miR-1, miR-181 (miR-181a, miR-181b, miR-181c) and miR-206, that are specifically induced during myogenesis in cardiac and skeletal muscle tissues. miR-103 and miR-107, highly expressed in brain, heart and muscle have also been included in this study. QRT-PCR experiments have been performed on RNA from vastus lateralis biopsies of DM1 patients (n = 7) and control subjects (n = 4). Results of miRNAs expression have been confirmed by Northern blot, whereas <it>in situ </it>hybridization technique have been performed to localize misexpressed miRNAs on muscle sections from DM1 and control individuals.</p> <p>Results</p> <p>Only miR-206 showed an over-expression in 5 of 7 DM1 patients (threshold = 2, fold change between 1.20 and 13.22, average = 5.37) compared to the control group. This result has been further confirmed by Northern blot analysis (3.37-fold overexpression, <it>R</it>²= 0.89). <it>In situ </it>hybridization localized miR-206 to nuclear site both in normal and DM1 tissues. Cellular distribution in DM1 tissues includes also the nuclear regions of centralized nuclei, with a strong signal corresponding to nuclear clumps.</p> <p>Conclusions</p> <p>This work provides, for the first time, evidences about miRNAs misexpression in DM1 muscle tissues, adding a new element in the pathogenesis of this complex genetic disease.</p

Cyclopentenyl cytosine increases gemcitabine radiosensitisation in human pancreatic cancer cells

The deoxycytidine analogue 2′,2′-difluoro-2′-deoxycytidine (dFdC, gemcitabine) is a potent radiosensitiser, but has limited efficacy in combination with radiotherapy in patients with pancreatic cancer due to acute toxicity. We investigated whether cyclopentenyl cytosine (CPEC), targetting the ‘de novo' biosynthesis of cytidine triphosphate (CTP), could increase dFdC cytotoxicity alone or in combination with irradiation in a panel of human pancreatic cancer cells (Panc-1, Miapaca-2, BxPC-3). To investigate the role of deoxycytidine kinase (dCK), the rate-limiting enzyme in the activation of dFdC, human lung cancer cells without (dFdC-resistant SWg) and with an intact dCK gene (dFdC-sensitive SWp) were included. We found that CPEC (100–1000 nmol l−1) specifically reduced CTP levels in a dose-dependent manner that lasted up to 72 h in all cell lines. Preincubation with CPEC resulted in a dose-dependent increase in dFdC incorporated into the DNA only in dFdC-sensitive cells. Consequently, CPEC increased the effectiveness of dFdC (300 nmol l−1 for 4 h) only in dFdC-sensitive cells, which was accompanied by an increase in apoptosis. We also found that CPEC enhanced the radiosensitivity of cells treated with dFdC (30–300 nmol l−1 for 4 h). These results indicate that CPEC enhances the cytotoxicity of dFdC alone and in combination with irradiation in several human tumour cell lines with an intact dCK gene

Opposition and dissidence: two modes of resistance against international rule

Rule is commonly conceptualized with reference to the compliance it invokes. In this article, we propose a conception of rule via the practice of resistance instead. In contrast to liberal approaches, we stress the possibility of illegitimate rule, and, as opposed to critical approaches, the possibility of legitimate authority. In the international realm, forms of rule and the changes they undergo can thus be reconstructed in terms of the resistance they provoke. To this end, we distinguish between two types of resistance - opposition and dissidence - in order to demonstrate how resistance and rule imply each other. We draw on two case studies of resistance in and to international institutions to illustrate the relationship between rule and resistance and close with a discussion of the normative implications of such a conceptualization

The Network Structure of Childhood Psychopathology in International Adoptees

International adoptees are at an increased risk of emotional and behavioral problems, especially those who are adopted at an older age. We took a new approach in our study of the network structure and predictability of emotional and behavioral problems in internationally adopted children in Finland. Our sample was from the on-going adoption study and comprised 778 internationally adopted children (387 boys and 391 girls, mean age 10.5 (SD 3.4) years). Networks were estimated using Gaussian graphical models and lasso regularization for all the children, and separately for those who were adopted at different ages. The results showed that anxiety/depressive symptoms, social problems, and aggressiveness were the most central symptom domains. Somatic symptoms were the least central and had the weakest effect on the other domains. Similarly, aggressiveness, social problems, and attention problems were high in terms of predictability (73-65%), whereas internalizing problems were relatively low (28-56%). There were clear but local age-group differences in network structure, symptom centrality, and predictability. According to our findings, network models provide important additional information about the centrality and predictability of specific symptom domains, and thus may facilitate targeted interventions among international adoptees.Peer reviewe

Low-intensity blue-enriched white light (750 lux) and standard bright light (10 000 lux) are equally effective in treating SAD. A randomized controlled study

<p>Abstract</p> <p>Background</p> <p>Photoreceptor cells containing melanopsin play a role in the phase-shifting effects of short-wavelength light. In a previous study, we compared the standard light treatment (SLT) of SAD with treatment using short-wavelength blue-enriched white light (BLT). Both treatments used the same illuminance (10 000 lux) and were equally highly effective. It is still possible, however, that neither the newly-discovered photoreceptor cells, nor the biological clock play a major role in the therapeutic effects of light on SAD. Alternatively, these effects may at least be partly mediated by these receptor cells, which may have become saturated as a result of the high illuminances used in the therapy. This randomized controlled study compares the effects of low-intensity BLT to those of high-intensity SLT.</p> <p>Method</p> <p>In a 22-day design, 22 patients suffering from a major depression with a seasonal pattern (SAD) were given light treatment (10 000 lux) for two weeks on workdays. Subjects were randomly assigned to either of the two conditions, with gender and age evenly distributed over the groups. Light treatment either consisted of 30 minutes SLT (5000°K) with the EnergyLight^®(Philips, Consumer Lifestyle) with a vertical illuminance of 10 000 lux at eye position or BLT (17 000°K) with a vertical illuminance of 750 lux using a prototype of the EnergyLight^®which emitted a higher proportion of short-wavelengths. All participants completed questionnaires concerning mood, activation and sleep quality on a daily basis. Mood and energy levels were also assessed on a weekly basis by means of the SIGH-SAD and other assessment tools.</p> <p>Results</p> <p>On day 22, SIGH-SAD ratings were significantly lower than on day 1 (SLT 65.2% and BLT 76.4%). On the basis of all assessments no statistically significant differences were found between the two conditions.</p> <p>Conclusion</p> <p>With sample size being small, conclusions can only be preliminary. Both treatment conditions were found to be highly effective. The therapeutic effects of low-intensity blue-enriched light were comparable to those of the standard light treatment. Saturation effects may play a role, even with a light intensity of 750 lux. The therapeutic effects of blue-enriched white light in the treatment of SAD at illuminances as low as 750 lux help bring light treatment for SAD within reach of standard workplace and educational lighting systems.</p