Overcoming Form: reflections on immersive listening

This short collection of essays focuses on four areas of immersive sound environments: repetition, sustained tones, performed installations and approaches to extended forms. Through in depth exploration of the experiential nature of these subjects, the authors offer reflections upon the materials used for these environments, how they are organised, and the consequences of this on how we listen.Publishe

Motor processes in mental rotation

Much indirect evidence supports the hypothesis that transformations of mental images are at least in part guided by motor processes, even in the case of images of abstract objects rather than of body parts. For example, rotation may be guided by processes that also prime one to see results of a specific motor action. We directly test the hypothesis by means of a dual-task paradigm in which subjects perform the Cooper-Shepard mental rotation task while executing an unseen motor rotation in a given direction and at a previously learned speed. Four results support the inference that mental rotation relies on motor processes. First, motor rotation that is compatible with mental rotation results in faster times and fewer errors in the imagery task than when the two rotations are incompatible. Second, the angle through which subjects rotate their mental images, and the angle through which they rotate a joystick handle are correlated, but only if the directions of the two rotations are compatible. Third, motor rotation modifies the classical inverted V-shaped mental rotation response time function, favoring the direction of the motor rotation; indeed, in some cases motor rotation even shifts the location of the minimum of this curve in the direction of the motor rotation. Fourth, the preceding effect is sensitive not only to the direction of the motor rotation, but also to the motor speed. A change in the speed of motor rotation can correspondingly slow down or speed up the mental rotation

Eye movements in children during reading: a review

International audienceOver the last decades, the analysis of eye movements has proven very useful to investigatethe cognitive processes underlying reading. However, from a developmental perspective, thistechnique has yet hardly been used to better understand the children’s acquisition of reading. Thischapter aims at presenting a review of the studies comparing the eye-movement patterns observedin children with those observed in adult readers. Firstly, it presents the differences and similaritiesin eye-movement patterns between those two groups, and then it proposes different attempts atexplaining these differences in terms of oculomotor, visual and linguistic constraints

The time course of attentional and oculomotor capture reveals a common cause

Eye movements are often misdirected toward a distractor when it appears abruptly, an effect known as oculomotor capture. Fundamental differences between eye movements and attention have led to questions about the relationship of oculomotor capture to the more general effect of sudden onsets on performance, known as attentional capture. This study explores that issue by examining the time course of eye movements and manual localization responses to targets in the presence of sudden-onset distractors. The results demonstrate that for both response types, the proportion of trials on which responses are erroneously directed to sudden onsets reflects the quality of information about the visual display at a given point in time. Oculomotor capture appears to be a specific instance of a more general attentional capture effect. Differences and similarities between the two types of capture can be explained by the critical idea that the quality of information about a visual display changes over time and that different response systems tend to access this information at different moments in time

Dynamics of Perceptual Organization in Complex Visual Search: The Identification of Self Organized Criticality with Respect to Visual Grouping Principles

The current project applies modern quantitative theories of visual perception to examine the effect of the Gestalt Law of proximity on visual cognition. Gestalt Laws are spontaneous dynamic processes (Brunswik & Kamiya, 1953; Wertheimer, 1938) that underlie the principles of perceptual organization. These principles serve as mental short-cuts, heuristic rule-of-thumb strategies that shorten decision-making time and allow continuous, efficient processing and flow of information (Hertwig & Todd, 2002). The proximity heuristic refers to the observation that objects near each other in the visual field tend to be grouped together by the perceptual system (Smith-Gratto & Fisher, 1999). Proximity can be directly quantified as the distance between adjacent objects (inter-object distances) in a visual array. Recent studies on eye movements have revealed the interactive nature of self organizing dynamic processes in visual cognition (Aks, Zelinsky, & Sprott, 2002; Stephen, & Mirman, 2010). Research by Aks and colleagues (2002) recorded eye-movements during a complex visual search task in which participants searched for a target among distracters. Their key finding was that visual search patterns are not randomly distributed, and that a simple form of temporal memory exists across the sequence of eye movements. The objective of the present research was to identify how the law of proximity impacts visual search behavior as reflected in eye movement patterns. We discovered that 1) eye movements are fractal; 2) more fractality will result in decreased reaction time during visual search, and 3) fractality facilitates the improvement of reaction times over blocks of trials. Results were interpreted in view of theories of cognitive resource allocation and perceptual efficiency. The current research could inspire potential innovations in computer vision, user interface design and visual cognition

Eye-tracking the emergence of attentional anchors in a mathematics learning tablet activity

Little is known about micro-processes by which sensorimotor interaction gives rise to conceptual development. Per embodiment theory, these micro-processes are mediated by dynamical attentional structures. Accordingly this study investigated eye-gaze behaviors during engagement in solving tablet-based bimanual manipulation tasks designed to foster proportional reasoning. Seventy-six elementary- and vocational-school students (9-15 yo) participated in individual task-based clinical interviews. Data gathered included action-logging, eye-tracking, and videography. Analyses revealed the emergence of stable eye-path gaze patterns contemporaneous with first enactments of effective manipulation and prior to verbal articulations of manipulation strategies. Characteristic gaze patterns included consistent or recurring attention to screen locations that bore non-salient stimuli or no stimuli at all yet bore invariant geometric relations to dynamical salient features. Arguably, this research validates empirically hypothetical constructs from constructivism, particularly reflective abstraction

Sherlock Holmes: An expert’s view of expertise

In recent years, there has been an intense research effort to understand the cognitive processes and structures underlying expert behaviour. Work in different fields, including scientific domains, sports, games, and mnemonics, has shown that there are vast differences in perceptual abilities between experts and novices, and that these differences may underpin other cognitive differences in learning, memory, and problem solving. In this article, we evaluate the progress made in the last years through the eyes of an outstanding, albeit fictional, expert: Sherlock Holmes. We first use the Sherlock Holmes character to illustrate expert processes as described by current research and theories. In particular, the role of perception, as well as the nature and influence of expert knowledge, are all present in the description of Conan Doyle’s hero. In the second part of the article, we discuss a number of issues that current research on expertise has barely addressed. These gaps include, for example, several forms of reasoning, the influence of emotions on cognition, and the effect of age on experts’ knowledge and cognitive processes. Thus, although nearly 120 years old, Conan Doyle’s books show remarkable illustrations of expert behaviour, including the coverage of themes that have mostly been overlooked by current research

Specificity and coherence of body representations

Bodily illusions differently affect body representations underlying perception and action. We investigated whether this task dependence reflects two distinct dimensions of embodiment: the sense of agency and the sense of the body as a coherent whole. In experiment 1 the sense of agency was manipulated by comparing active versus passive movements during the induction phase in a video rubber hand illusion (vRHI) setup. After induction, proprioceptive biases were measured both by perceptual judgments of hand position, as well as by measuring end-point accuracy of subjects' active pointing movements to an external object with the affected hand. The results showed, first, that the vRHI is largely perceptual: passive perceptual localisation judgments were altered, but end-point accuracy of active pointing responses with the affected hand to an external object was unaffected. Second, within the perceptual judgments, there was a novel congruence effect, such that perceptual biases were larger following passive induction of vRHI than following active induction. There was a trend for the converse effect for pointing responses, with larger pointing bias following active induction. In experiment 2, we used the traditional RHI to investigate the coherence of body representation by synchronous stimulation of either matching or mismatching fingers on the rubber hand and the participant's own hand. Stimulation of matching fingers induced a local proprioceptive bias for only the stimulated finger, but did not affect the perceived shape of the hand as a whole. In contrast, stimulation of spatially mismatching fingers eliminated the RHI entirely. The present results show that (i) the sense of agency during illusion induction has specific effects, depending on whether we represent our body for perception or to guide action, and (ii) representations of specific body parts can be altered without affecting perception of the spatial configuration of the body as a whole

Medical students' cognitive load in volumetric image interpretation:Insights from human-computer interaction and eye movements

Medical image interpretation is moving from using 2D- to volumetric images, thereby changing the cognitive and perceptual processes involved. This is expected to affect medical students' experienced cognitive load, while learning image interpretation skills. With two studies this explorative research investigated whether measures inherent to image interpretation, i.e. human-computer interaction and eye tracking, relate to cognitive load. Subsequently, it investigated effects of volumetric image interpretation on second-year medical students' cognitive load. Study 1 measured human-computer interactions of participants during two volumetric image interpretation tasks. Using structural equation modelling, the latent variable 'volumetric image information' was identified from the data, which significantly predicted self-reported mental effort as a measure of cognitive load. Study 2 measured participants' eye movements during multiple 2D and volumetric image interpretation tasks. Multilevel analysis showed that time to locate a relevant structure in an image was significantly related to pupil dilation, as a proxy for cognitive load. It is discussed how combining human-computer interaction and eye tracking allows for comprehensive measurement of cognitive load. Combining such measures in a single model would allow for disentangling unique sources of cognitive load, leading to recommendations for implementation of volumetric image interpretation in the medical education curriculum