Eye and hand movements during reconstruction of spatial memory

© 2012 a Pion publicationRecent behavioural and biological evidence indicates common mechanisms serving working memory and attention (e.g., Awh et al, 2006 Neuroscience 139 201-208). This study explored the role of spatial attention and visual search in an adapted Corsi spatial memory task. Eye movements and touch responses were recorded from participants who recalled locations (signalled by colour or shape change) from an array presented either simultaneously or sequentially. The time delay between target presentation and recall (0, 5, or 10 s) and the number of locations to be remembered (2-5) were also manipulated. Analysis of the response phase revealed subjects were less accurate (touch data) and fixated longer (eye data) when responding to sequentially presented targets suggesting higher cognitive effort. Fixation duration on target at recall was also influenced by whether spatial location was initially signalled by colour or shape change. Finally, we found that the sequence tasks encouraged longer fixations on the signalled targets than simultaneous viewing during encoding, but no difference was observed during recall. We conclude that the attentional manipulations (colour/shape) mainly affected the eye movement parameters, whereas the memory manipulation (sequential versus simultaneous, number of items) mainly affected the performance of the hand during recall, and thus the latter is more important for ascertaining if an item is remembered or forgotten. In summary, the nature of the stimuli that is used and how it is presented play key roles in determining subject performance and behaviour during spatial memory tasks

Mental Imagery and Chunks: Empirical and Computational Findings

To investigate experts’ imagery in chess, players were required to recall briefly-presented positions in which the pieces were placed on the intersections between squares (intersection positions). Position types ranged from game positions to positions where both the piece distribution and location were randomized. Simulations were run with the CHREST model (Gobet & Simon, 2000). The simulations assumed that pieces had to be centered back one by one to the middle of the squares in the mind’s eye before chunks could be recognized. Consistent with CHREST’s predictions, chess players (N = 36), ranging from weak amateurs to grandmasters, exhibited much poorer recall on intersection positions than on standard positions (pieces placed on centers of squares). On the intersection positions, the skill difference in recall was larger on game positions than on the randomized positions. Participants recalled bishops better than knights, suggesting that Stroop-like interference impairs recall of the latter. The data supported both the time parameter in CHREST for shifting pieces in the mind’s eye (125 ms per piece) and the seriality assumption. In general, the study reinforces the plausibility of CHREST as a model of cognition

Representation, space and Hollywood Squares: Looking at things that aren't there anymore

It has been argued that the human cognitive system is capable of using spatial indexes or oculomotor coordinates to relieve working memory load (Ballard, Hayhoe, Pook & Rao, 1997) track multiple moving items through occlusion (Scholl & Pylyshyn, 1999) or link incompatible cognitive and sensorimotor codes (Bridgeman and Huemer, 1998). Here we examine the use of such spatial information in memory for semantic information. Previous research has often focused on the role of task demands and the level of automaticity in the encoding of spatial location in memory tasks. We present five experiments where location is irrelevant to the task, and participants' encoding of spatial information is measured implicitly by their looking behavior during recall. In a paradigm developed from Spivey and Geng (submitted), participants were presented with pieces of auditory, semantic information as part of an event occurring in one of four regions of a computer screen. In front of a blank grid, they were asked a question relating to one of those facts. Under certain conditions it was found that during the question period participants made significantly more saccades to the empty region of space where the semantic information had been previously presented. Our findings are discussed in relation to previous research on memory and spatial location, the dorsal and ventral streams of the visual system, and the notion of a cognitive-perceptual system using spatial indexes to exploit the stability of the external world

An investigation into the effect of ageing on expert memory with CHREST

CHREST is a cognitive architecture that models human perception, learning, memory, and problem solving, and which has successfully simulated numerous human experimental data on chess. In this paper, we describe an investigation into the effects of ageing on expert memory using CHREST. The results of the simulations are related to the literature on ageing. The study illustrates how Computational Intelligence can be used to understand complex phenomena that are affected by multiple variables dynamically evolving as a function of time and that have direct practical implications for human societies

Expertise in chess

This chapter provides an overview of research into chess expertise. After an historical background and a brief description of the game and the rating system, it discusses the information processes enabling players to choose good moves, and in particular the trade-offs between knowledge and search. Other topics include blindfold chess, talent, and the role of deliberate practice and tournament experience

Expertise and intuition: A tale of three theories

Several authors have hailed intuition as one of the defining features of expertise. In particular, while disagreeing on almost anything that touches on human cognition and artificial intelligence, Hubert Dreyfus and Herbert Simon agreed on this point. However, the highly influential theories of intuition they proposed differed in major ways, especially with respect to the role given to search and as to whether intuition is holistic or analytic. Both theories suffer from empirical weaknesses. In this paper, we show how, with some additions, a recent theory of expert memory (the template theory) offers a coherent and wide-ranging explanation of intuition in expert behaviour. It is shown that the theory accounts for the key features of intuition: it explains the rapid onset of intuition and its perceptual nature, provides mechanisms for learning, incorporates processes showing how perception is linked to action and emotion, and how experts capture the entirety of a situation. In doing so, the new theory addresses the issues problematic for Dreyfus’s and Simon’s theories. Implications for research and practice are discussed

Computational Modelling of Mental Imagery in Chess: A Sensitivity Analysis

An important aim of cognitive science is to build computational models that account for a large number of phenomena but have few free parameters, and to obtain more veridical values for the models’ parameters by successive approximations. A good example of this approach is the CHREST model (Gobet & Simon, 2000), which has simulated numerous phenomena on chess expertise and in other domains. In this paper, we are interested in the parameter the model uses for shifting chess pieces in its mind’s eye (125 ms per piece), a parameter that had been estimated based on relatively sparse experimental evidence. Recently, Waters and Gobet (2008) tested the validity of this parameter in a memory experiment that required players to recall briefly presented positions in which the pieces were placed on the intersections between squares. Position types ranged from game positions to positions where both the piece distribution and location were randomised. CHREST, which assumed that pieces must be centred back to the middle of the squares in the mind’s eye before chunks can be recognized, simulated the data fairly well using the default parameter for shifting pieces. The sensitivity analysis presented in the current paper shows that the fit was nearly optimal for all groups of players except the grandmaster group for which, counterintuitively, a slower shifting time gave a better fit. The implications for theory development are discussed

The mind's eye in blindfold chess

Visual imagery plays an important role in problem solving, and research into blindfold chess has provided a wealth of empirical data on this question. We show how a recent theory of expert memory (the template theory, Gobet & Simon, 1996, 2000) accounts for most of these data. However, how the mind’s eye filters out relevant from irrelevant information is still underspecified in the theory. We describe two experiments addressing this question, in which chess games are presented visually, move by move, on a board that contains irrelevant information (static positions, semi-static positions, and positions changing every move). The results show that irrelevant information affects chess masters only when it changes during the presentation of the target game. This suggests that novelty information is used by the mind’s eye to select incoming visual information and separate “figure” and “ground.” Mechanisms already present in the template theory can be used to account for this novelty effect

What checkers actually check: an eye tracking study of inhibitory control and working memory

<p>Background - Not only is compulsive checking the most common symptom in Obsessive Compulsive Disorder (OCD) with an estimated prevalence of 50–80% in patients, but approximately ~15% of the general population reveal subclinical checking tendencies that impact negatively on their performance in daily activities. Therefore, it is critical to understand how checking affects attention and memory in clinical as well as subclinical checkers. Eye fixations are commonly used as indicators for the distribution of attention but research in OCD has revealed mixed results at best.</p> <p>Methodology/Principal Finding - Here we report atypical eye movement patterns in subclinical checkers during an ecologically valid working memory (WM) manipulation. Our key manipulation was to present an intermediate probe during the delay period of the memory task, explicitly asking for the location of a letter, which, however, had not been part of the encoding set (i.e., misleading participants). Using eye movement measures we now provide evidence that high checkers’ inhibitory impairments for misleading information results in them checking the contents of WM in an atypical manner. Checkers fixate more often and for longer when misleading information is presented than non-checkers. Specifically, checkers spend more time checking stimulus locations as well as locations that had actually been empty during encoding.</p> <p>Conclusions/Significance - We conclude that these atypical eye movement patterns directly reflect internal checking of memory contents and we discuss the implications of our findings for the interpretation of behavioural and neuropsychological data. In addition our results highlight the importance of ecologically valid methodology for revealing the impact of detrimental attention and memory checking on eye movement patterns.</p&gt