Strategic Cognitive Sequencing: A Computational Cognitive Neuroscience Approach

We address strategic cognitive sequencing, the “outer loop” of human cognition: how the brain decides what cognitive process to apply at a given moment to solve complex, multistep cognitive tasks. We argue that this topic has been neglected relative to its importance for systematic reasons but that recent work on how individual brain systems accomplish their computations has set the stage for productively addressing how brain regions coordinate over time to accomplish our most impressive thinking. We present four preliminary neural network models. The first addresses how the prefrontal cortex (PFC) and basal ganglia (BG) cooperate to perform trial-and-error learning of short sequences; the next, how several areas of PFC learn to make predictions of likely reward, and how this contributes to the BG making decisions at the level of strategies. The third models address how PFC, BG, parietal cortex, and hippocampus can work together to memorize sequences of cognitive actions from instruction (or “self-instruction”). The last shows how a constraint satisfaction process can find useful plans. The PFC maintains current and goal states and associates from both of these to find a “bridging” state, an abstract plan. We discuss how these processes could work together to produce strategic cognitive sequencing and discuss future directions in this area

Forced Moves or Good Tricks in Design Space? Landmarks in the Evolution of Neural Mechanisms for Action Selection

This review considers some important landmarks in animal evolution, asking to what extent specialized action-selection mechanisms play a role in the functional architecture of different nervous system plans, and looking for “forced moves” or “good tricks” (see Dennett, D., 1995, Darwin’s Dangerous Idea, Penguin Books, London) that could possibly transfer to the design of robot control systems. A key conclusion is that while cnidarians (e.g. jellyfish) appear to have discovered some good tricks for the design of behavior-based control systems—largely lacking specialized selection mechanisms—the emergence of bilaterians may have forced the evolution of a central ganglion, or “archaic brain”, whose main function is to resolve conflicts between peripheral systems. Whilst vertebrates have many interesting selection substrates it is likely that here too the evolution of centralized structures such as the medial reticular formation and the basal ganglia may have been a forced move because of the need to limit connection costs as brains increased in size

Dopamine, affordance and active inference.

The role of dopamine in behaviour and decision-making is often cast in terms of reinforcement learning and optimal decision theory. Here, we present an alternative view that frames the physiology of dopamine in terms of Bayes-optimal behaviour. In this account, dopamine controls the precision or salience of (external or internal) cues that engender action. In other words, dopamine balances bottom-up sensory information and top-down prior beliefs when making hierarchical inferences (predictions) about cues that have affordance. In this paper, we focus on the consequences of changing tonic levels of dopamine firing using simulations of cued sequential movements. Crucially, the predictions driving movements are based upon a hierarchical generative model that infers the context in which movements are made. This means that we can confuse agents by changing the context (order) in which cues are presented. These simulations provide a (Bayes-optimal) model of contextual uncertainty and set switching that can be quantified in terms of behavioural and electrophysiological responses. Furthermore, one can simulate dopaminergic lesions (by changing the precision of prediction errors) to produce pathological behaviours that are reminiscent of those seen in neurological disorders such as Parkinson's disease. We use these simulations to demonstrate how a single functional role for dopamine at the synaptic level can manifest in different ways at the behavioural level

Deficits in visuo-spatial working memory, inhibition and oculomotor control in boys with ADHD and their non-affected brothers.

Few studies have assessed visuo-spatial working memory and inhibition in attention-deficit/hyperactivity disorder (ADHD) by recording saccades and consequently little additional knowledge has been gathered on oculomotor functioning in ADHD. Moreover, this is the first study to report the performance of non-affected siblings of children with ADHD, which may shed light on the familiality of deficits. A total of 14 boys with ADHD, 18 non-affected brothers, and 15 control boys aged 7-14 years, were administered a memory-guided saccade task with delays of three and seven seconds. Familial deficits were found in accuracy of visuo-spatial working memory, percentage of anticipatory saccades, and tendency to overshoot saccades relative to controls. These findings suggest memory-guided saccade deficits may relate to a familial predisposition for ADHD