Ant-based Neural Topology Search (ANTS) for Optimizing Recurrent Networks

Hand-crafting effective and efficient structures for recurrent neural networks (RNNs) is a difficult, expensive, and time-consuming process. To address this challenge, we propose a novel neuro-evolution algorithm based on ant colony optimization (ACO), called Ant-based Neural Topology Search (ANTS), for directly optimizing RNN topologies. The procedure selects from multiple modern recurrent cell types such as ∆-RNN, GRU, LSTM, MGU and UGRNN cells, as well as recurrent connections which may span multiple layers and/or steps of time. In order to introduce an inductive bias that encourages the formation of sparser synaptic connectivity patterns, we investigate several variations of the core algorithm. We do so primarily by formulating different functions that drive the underlying pheromone simulation process (which mimic L1 and L2 regularization in standard machine learning) as well as by introducing ant agents with specialized roles (inspired by how real ant colonies operate), i.e., explorer ants that construct the initial feed forward structure and social ants which select nodes from the feed forward connections to subsequently craft recurrent memory structures. We also incorporate communal intelligence, where best weights are shared by the ant colony for weight initialization, reducing the number of backpropagation epochs required to locally train candidate RNNs, speeding up the neuro-evolution process. Our results demonstrate that the sparser RNNs evolved by ANTS significantly outperform traditional one and two layer architectures consisting of modern memory cells, as well as the well-known NEAT algorithm. Furthermore, we improve upon prior state-of-the-art results on the time series dataset utilized in our experiments

IFNβ Protects Neurons from Damage in a Murine Model of HIV-1 Associated Brain Injury.

Infection with human immunodeficiency virus-1 (HIV-1) causes brain injury. Type I interferons (IFNα/β) are critical mediators of any anti-viral immune response and IFNβ has been implicated in the temporary control of lentiviral infection in the brain. Here we show that transgenic mice expressing HIV-1 envelope glycoprotein 120 in their central nervous system (HIVgp120tg) mount a transient IFNβ response and provide evidence that IFNβ confers neuronal protection against HIVgp120 toxicity. In cerebrocortical cell cultures, neuroprotection by IFNβ against gp120 toxicity is dependent on IFNα receptor 1 (IFNAR1) and the β-chemokine CCL4, as IFNAR1 deficiency and neutralizing antibodies against CCL4, respectively, abolish the neuroprotective effects. We find in vivo that IFNβ mRNA is significantly increased in HIVgp120tg brains at 1.5, but not 3 or 6 months of age. However, a four-week intranasal IFNβ treatment of HIVgp120tg mice starting at 3.5 months of age increases expression of CCL4 and concomitantly protects neuronal dendrites and pre-synaptic terminals in cortex and hippocampus from gp120-induced damage. Moreover, in vivo and in vitro data suggests astrocytes are a major source of IFNβ-induced CCL4. Altogether, our results suggest exogenous IFNβ as a neuroprotective factor that has potential to ameliorate in vivo HIVgp120-induced brain injury

Effectiveness of neonatal pulse oximetry screening for detection of critical congenital heart disease in daily clinical routine—results from a prospective multicenter study

Pulse oximetry screening (POS) has been proposed as an effective, noninvasive, inexpensive tool allowing earlier diagnosis of critical congenital heart disease (cCHD). Our aim was to test the hypothesis that POS can reduce the diagnostic gap in cCHD in daily clinical routine in the setting of tertiary, secondary and primary care centres. We conducted a prospective multicenter trial in Saxony, Germany. POS was performed in healthy term and post-term newborns at the age of 24–72 h. If an oxygen saturation (SpO2) of ≤95% was measured on lower extremities and confirmed after 1 h, complete clinical examination and echocardiography were performed. POS was defined as false-negative when a diagnosis of cCHD was made after POS in the participating hospitals/at our centre. From July 2006–June 2008, 42,240 newborns from 34 institutions have been included. Seventy-two children were excluded due to prenatal diagnosis (n = 54) or clinical signs of cCHD (n = 18) before POS. Seven hundred ninety-five newborns did not receive POS, mainly due to early discharge after birth (n = 727; 91%). In 41,445 newborns, POS was performed. POS was true positive in 14, false positive in 40, true negative in 41,384 and false negative in four children (three had been excluded for violation of study protocol). Sensitivity, specificity, positive and negative predictive value were 77.78%, 99.90%, 25.93% and 99.99%, respectively. With POS as an adjunct to prenatal diagnosis, physical examination and clinical observation, the percentage of newborns with late diagnosis of cCHD was 4.4%. POS can substantially reduce the postnatal diagnostic gap in cCHD, and false-positive results leading to unnecessary examinations of healthy newborns are rare. POS should be implemented in routine postnatal care

Updating Fearful Memories with Extinction Training during Reconsolidation: A Human Study Using Auditory Aversive Stimuli

Learning to fear danger in the environment is essential to survival, but dysregulation of the fear system is at the core of many anxiety disorders. As a consequence, a great interest has emerged in developing strategies for suppressing fear memories in maladaptive cases. Recent research has focused in the process of reconsolidation where memories become labile after being retrieved. In a behavioral manipulation, Schiller et al., (2010) reported that extinction training, administrated during memory reconsolidation, could erase fear responses. The implications of this study are crucial for the possible treatment of anxiety disorders without the administration of drugs. However, attempts to replicate this effect by other groups have been so far unsuccessful. We sought out to reproduce Schiller et al., (2010) findings in a different fear conditioning paradigm based on auditory aversive stimuli instead of electric shock. Following a within-subject design, participants were conditioned to two different sounds and skin conductance response (SCR) was recorded as a measure of fear. Our results demonstrated that only the conditioned stimulus that was reminded 10 minutes before extinction training did not reinstate a fear response after a reminder trial consisting of the presentation of the unconditioned stimuli. For the first time, we replicated Schiller et al., (2010) behavioral manipulation and extended it to an auditory fear conditioning paradigm

Exposure–response relationship of AMG 386 in combination with weekly paclitaxel in recurrent ovarian cancer and its implication for dose selection

To characterize exposure-response relationships of AMG 386 in a phase 2 study in advanced ovarian cancer for the facilitation of dose selection in future studies.A population pharmacokinetic model of AMG 386 (N = 141) was developed and applied in an exposure-response analysis using data from patients (N = 160) with recurrent ovarian cancer who received paclitaxel plus AMG 386 (3 or 10 mg/kg once weekly) or placebo. Reduction in the risk of progression or death with increasing exposure (steady-state area under the concentration-versus-time curve [AUC(ss)]) was assessed using Cox regression analyses. Confounding factors were tested in multivariate analysis. Alternative AMG 386 doses were explored with Monte Carlo simulations using population pharmacokinetic and parametric survival models.There was a trend toward increased PFS with increased AUC(ss) (hazard ratio [HR] for each one-unit increment in AUC(ss), 0.97; P = 0.097), suggesting that the maximum effect on prolonging PFS was not achieved at the highest dose tested (10 mg/kg). Among patients with AUC(ss) ≥ 9.6 mg h/mL, PFS was 8.1 months versus 5.7 months for AUC(ss) < 9.6 mg h/mL and 4.6 months for placebo. No relationship between AUC(ss) and grade ≥ 3 adverse events was observed. Simulations predicted that AMG 386 15 mg/kg once weekly would result in an AUC(ss) ≥ 9.6 mg h/mL in > 90% of patients with median PFS of 8.2 months versus 5.0 months for placebo (HR [15 mg/kg vs. placebo], 0.56).Increased exposure to AMG 386 was associated with improved clinical outcomes in recurrent ovarian cancer, supporting the evaluation of a higher dose in future studies

Amputation-induced reactive oxygen species are required for successful Xenopus tadpole tail regeneration.

Understanding the molecular mechanisms that promote successful tissue regeneration is critical for continued advancements in regenerative medicine. Vertebrate amphibian tadpoles of the species Xenopus laevis and Xenopus tropicalis have remarkable abilities to regenerate their tails following amputation, through the coordinated activity of numerous growth factor signalling pathways, including the Wnt, Fgf, Bmp, Notch and TGF-β pathways. Little is known, however, about the events that act upstream of these signalling pathways following injury. Here, we show that Xenopus tadpole tail amputation induces a sustained production of reactive oxygen species (ROS) during tail regeneration. Lowering ROS levels, using pharmacological or genetic approaches, reduces the level of cell proliferation and impairs tail regeneration. Genetic rescue experiments restored both ROS production and the initiation of the regenerative response. Sustained increased ROS levels are required for Wnt/β-catenin signalling and the activation of one of its main downstream targets, fgf20 (ref. 7), which, in turn, is essential for proper tail regeneration. These findings demonstrate that injury-induced ROS production is an important regulator of tissue regeneration

Formation of a morphine-conditioned place preference does not change the size of evoked potentials in the ventral hippocampus–nucleus accumbens projection

Abstract In opioid addiction, cues and contexts associated with drug reward can be powerful triggers for drug craving and relapse. The synapses linking ventral hippocampal outputs to medium spiny neurons of the accumbens may be key sites for the formation and storage of associations between place or context and reward, both drug-related and natural. To assess this, we implanted rats with electrodes in the accumbens shell to record synaptic potentials evoked by electrical stimulation of the ventral hippocampus, as well as continuous local-field-potential activity. Rats then underwent morphine-induced (10 mg/kg) conditioned-place-preference training, followed by extinction. Morphine caused an acute increase in the slope and amplitude of accumbens evoked responses, but no long-term changes were evident after conditioning or extinction of the place preference, suggesting that the formation of this type of memory does not lead to a net change in synaptic strength in the ventral hippocampal output to the accumbens. However, analysis of the local field potential revealed a marked sensitization of theta- and high-gamma-frequency activity with repeated morphine administration. This phenomenon may be linked to the behavioral changes—such as psychomotor sensitization and the development of drug craving—that are associated with chronic use of addictive drugs

Development and Psychometric Evaluation of an Item Bank for Computerized Adaptive Testing of the EORTC Insomnia Dimension in Cancer Patients (EORTC CAT-SL)

To further advance assessment of patient-reported outcomes, the European Organisation of Research and Treatment of Cancer (EORTC) Quality of Life Group has developed computerized adaptive test (CAT) versions of all EORTC Quality of Life Core Questionnaire (QLQ-C30) scales/items. The aim of this study was to develop and evaluate an item bank for CAT measurement of insomnia (CAT-SL). In line with the EORTC guidelines, the developmental process comprised four phases: (I) defining the concept insomnia and literature search, (II) selection and formulation of new items, (III) pre-testing and (IV) field-testing, including psychometric analyses of the final item bank. In phase I, the literature search identified 155 items that were compatible with our conceptualisation of insomnia, including both quantity and quality of sleep. In phase II, following a multistep-approach, this number was reduced to 15 candidate items. Pre-testing of these items in cancer patients (phase III) resulted in an item list of 14 items, which were field-tested among 1094 patients in phase IV. Psychometric evaluations showed that eight items could be retained in a unidimensional model. The final item bank yielded greater measurement precision than the original QLQ-C30 insomnia item. It was estimated that administering two or more items from the insomnia item bank with CAT results in a saving in sample size between approximately 15–25%. The 8-item EORTC CAT-SL item bank facilitates precise and efficient measurement of insomnia as part of the EORTC CAT system of health-related quality life assessment in both clinical research and practice