46,792 research outputs found

    Faster Deep Q-learning using Neural Episodic Control

    Full text link
    The research on deep reinforcement learning which estimates Q-value by deep learning has been attracted the interest of researchers recently. In deep reinforcement learning, it is important to efficiently learn the experiences that an agent has collected by exploring environment. We propose NEC2DQN that improves learning speed of a poor sample efficiency algorithm such as DQN by using good one such as NEC at the beginning of learning. We show it is able to learn faster than Double DQN or N-step DQN in the experiments of Pong.Comment: 6 pages, 6 figures, COMPSAC2018 short pape

    Prospective memory impairments in Alzheimer's Disease and behavioral variant frontotemporal dementia: Clinical and neural correlates

    Get PDF
    BACKGROUND: Prospective memory (PM) refers to a future-oriented form of memory in which the individual must remember to execute an intended action either at a future point in time (Time-based) or in response to a specific event (Event-based). Lapses in PM are commonly exhibited in neurodegenerative disorders including Alzheimer's disease (AD) and frontotemporal dementia (FTD), however, the neurocognitive mechanisms driving these deficits remain unknown. OBJECTIVE: To investigate the clinical and neural correlates of Time- and Event-based PM disruption in AD and the behavioral-variant FTD (bvFTD). METHODS: Twelve AD, 12 bvFTD, and 12 healthy older Control participants completed a modified version of the Cambridge Prospective Memory test, which examines Time- and Event-based aspects of PM. All participants completed a standard neuropsychological assessment and underwent whole-brain structural MRI. RESULTS: AD and bvFTD patients displayed striking impairments across Time- and Event-based PM relative to Controls, however, Time-based PM was disproportionately affected in the AD group. Episodic memory dysfunction and hippocampal atrophy was found to correlate strongly with PM integrity in both patient groups, however, dissociable neural substrates were also evident for PM performance across dementia syndromes. CONCLUSION: Our study reveals the multifaceted nature of PM dysfunction in neurodegenerative disorders, and suggests common and dissociable neurocognitive mechanisms, which subtend these deficits in each patient group. Future studies of PM disturbance in dementia syndromes will be crucial for the development of successful interventions to improve functional independence in the patient's daily life

    Towards dynamical network biomarkers in neuromodulation of episodic migraine

    Get PDF
    Computational methods have complemented experimental and clinical neursciences and led to improvements in our understanding of the nervous systems in health and disease. In parallel, neuromodulation in form of electric and magnetic stimulation is gaining increasing acceptance in chronic and intractable diseases. In this paper, we firstly explore the relevant state of the art in fusion of both developments towards translational computational neuroscience. Then, we propose a strategy to employ the new theoretical concept of dynamical network biomarkers (DNB) in episodic manifestations of chronic disorders. In particular, as a first example, we introduce the use of computational models in migraine and illustrate on the basis of this example the potential of DNB as early-warning signals for neuromodulation in episodic migraine.Comment: 13 pages, 5 figure
    • …
    corecore