Pseudorehearsal in value function approximation

Catastrophic forgetting is of special importance in reinforcement learning, as the data distribution is generally non-stationary over time. We study and compare several pseudorehearsal approaches for Q-learning with function approximation in a pole balancing task. We have found that pseudorehearsal seems to assist learning even in such very simple problems, given proper initialization of the rehearsal parameters

Examining links between anxiety, reinvestment and walking when talking by older adults during adaptive gait

Falls by older adults often result in reduced quality of life and debilitating fear of further falls. Stopping walking when talking (SWWT) is a significant predictor of future falls by older adults and is thought to reflect age-related increases in attentional demands of walking. We examine whether SWWT is associated with use of explicit movement cues during locomotion, and evaluate if conscious control (i.e., movement specific reinvestment) is causally linked to falls-related anxiety during a complex walking task. We observed whether twenty-four older adults stopped walking when talking when asked a question during an adaptive gait task. After certain trials, participants completed a visual-spatial recall task regarding walkway features, or answered questions about their movements during the walk. In a subsequent experimental condition, participants completed the walking task under conditions of raised postural threat. Compared to a control group, participants who SWWT reported higher scores for aspects of reinvestment relating to conscious motor processing but not movement self-consciousness. The higher scores for conscious motor processing were preserved when scores representing cognitive function were included as a covariate. There were no group differences in measures of general cognitive function, visual spatial working memory or balance confidence. However, the SWWT group reported higher scores on a test of external awareness when walking, indicating allocation of attention away from task-relevant environmental features. Under conditions of increased threat, participants self-reported significantly greater state anxiety and reinvestment and displayed more accurate responses about their movements during the task. SWWT is not associated solely with age-related cognitive decline or generic increases in age-related attentional demands of walking. SWWT may be caused by competition for phonological resources of working memory associated with consciously processing motor actions and appears to be causally linked with fall-related anxiety and increased vigilance.This research was supported by The Royal Society (IE131576) and British Academy (SG132820)

'Everyday memory' impairments in autism spectrum disorders

‘Everyday memory’ is conceptualised as memory within the context of day-to-day life and, despite its functional relevance, has been little studied in individuals with autism spectrum disorders (ASDs). In the first study of its kind, 94 adolescents with an ASD and 55 without an ASD completed measures of everyday memory from the Rivermead Behavioural Memory Test (RBMT) and a standard word recall task (Children’s Auditory Verbal Learning Test-2: CAVLT-2). The ASD group showed significant impairments on the RBMT, including in prospective memory, alongside impaired performance on the CAVLT-2. Social and communication ability was significantly associated with prospective remembering in an everyday memory context but not with the CAVLT-2. The complex nature of everyday memory and its relevance to ASD is discussed

Positive Interactions between Desert Granivores: Localized Facilitation of Harvester Ants by Kangaroo Rats

Facilitation, when one species enhances the environment or performance of another species, can be highly localized in space. While facilitation in plant communities has been intensely studied, the role of facilitation in shaping animal communities is less well understood. In the Chihuahuan Desert, both kangaroo rats and harvester ants depend on the abundant seeds of annual plants. Kangaroo rats, however, are hypothesized to facilitate harvester ants through soil disturbance and selective seed predation rather than competing with them. I used a spatially explicit approach to examine whether a positive or negative interaction exists between banner-tailed kangaroo rat (Dipodomys spectabilis) mounds and rough harvester ant (Pogonomyrmex rugosus) colonies. The presence of a scale-dependent interaction between mounds and colonies was tested by comparing fitted spatial point process models with and without interspecific effects. Also, the effect of proximity to a mound on colony mortality and spatial patterns of surviving colonies was examined. The spatial pattern of kangaroo rat mounds and harvester ant colonies was consistent with a positive interspecific interaction at small scales (<10 m). Mortality risk of vulnerable, recently founded harvester ant colonies was lower when located close to a kangaroo rat mound and proximity to a mound partly predicted the spatial pattern of surviving colonies. My findings support localized facilitation of harvester ants by kangaroo rats, likely mediated through ecosystem engineering and foraging effects on plant cover and composition. The scale-dependent effect of kangaroo rats on abiotic and biotic factors appears to result in greater founding and survivorship of young colonies near mounds. These results suggest that soil disturbance and foraging by rodents can have subtle impacts on the distribution and demography of other species

Supernatural belief is not modulated by intuitive thinking style or cognitive inhibition

According to the Intuitive Belief Hypothesis, supernatural belief relies heavily on intuitive thinking—and decreases when analytic thinking is engaged. After pointing out various limitations in prior attempts to support this Intuitive Belief Hypothesis, we test it across three new studies using a variety of paradigms, ranging from a pilgrimage field study to a neurostimulation experiment. In all three studies, we found no relationship between intuitive or analytical thinking and supernatural belief. We conclude that it is premature to explain belief in gods as ‘intuitive’, and that other factors, such as socio-cultural upbringing, are likely to play a greater role in the emergence and maintenance of supernatural belief than cognitive style

Verbal thinking and inner speech use in autism spectrum disorder

The extent to which cognition is verbally mediated in neurotypical individuals is the subject of debate in cognitive neuropsychology, as well as philosophy and psychology. Studying “verbal thinking” in developmental/neuropsychological disorders provides a valuable opportunity to inform theory building, as well as clinical practice. In this paper, we provide a comprehensive, critical review of such studies among individuals with autism spectrum disorder (ASD). ASD involves severe social-communication deficits and limitations in cognitive/behavioural flexibility. The prevailing view in the field is that neither cognition nor behaviour is mediated verbally in ASD, and that this contributes to diagnostic features. However, our review suggests that, on the contrary, most studies to date actually find that among people with ASD cognitive task performance is either a) mediated verbally in a typical fashion, or b) not mediated verbally, but at no obvious cost to overall task performance. Overall though, these studies have methodological limitations and thus clear-cut conclusions are not possible at this stage. The aim of the review is to take stock of existing empirical findings, as well as to help develop the directions for future research that will resolve the many outstanding issues in this field

Interference between Sentence Processing and Probabilistic Implicit Sequence Learning

During sentence processing we decode the sequential combination of words, phrases or sentences according to previously learned rules. The computational mechanisms and neural correlates of these rules are still much debated. Other key issue is whether sentence processing solely relies on language-specific mechanisms or is it also governed by domain-general principles.In the present study, we investigated the relationship between sentence processing and implicit sequence learning in a dual-task paradigm in which the primary task was a non-linguistic task (Alternating Serial Reaction Time Task for measuring probabilistic implicit sequence learning), while the secondary task were a sentence comprehension task relying on syntactic processing. We used two control conditions: a non-linguistic one (math condition) and a linguistic task (word processing task). Here we show that the sentence processing interfered with the probabilistic implicit sequence learning task, while the other two tasks did not produce a similar effect.Our findings suggest that operations during sentence processing utilize resources underlying non-domain-specific probabilistic procedural learning. Furthermore, it provides a bridge between two competitive frameworks of language processing. It appears that procedural and statistical models of language are not mutually exclusive, particularly for sentence processing. These results show that the implicit procedural system is engaged in sentence processing, but on a mechanism level, language might still be based on statistical computations