Pearls and Perils of Pupillometry Using a Webcam

Current methods to measure infants’ cognitive repertoire (i.e., collection of cognitive abilities) are limited. Previous testing paradigms required acquisition of non-age contextualized responses, and relied on measures that involved acquisition of other functions (e.g., language, motor). In addition to response limitations, cognitive functions may be difficult to observe in infants due to the difficulty in infant recruitment. Online testing has increased infant recruitment efforts and physiological responses have bypassed the motor, behavioural and linguistic limitations of infants. Recently, it has been shown that heart rate measures can be acquired through a webcam. Another feasible and reliable physiological measure is pupillometery, the measure of pupil diameter, whereby an increase in pupil diameter corresponds to an increase in cognitive load in response to meaningful stimuli in our environment. Through successive pilot studies over an online interface (i.e., Mturk), we optimized the participants imaging environment. We show that acquisition of pupil diameter is possible over Mturk using our in-house methods. Moreover, we validated our measurement methods as a reliable tool for measuring cognitive load in adults, and as a future means of characterizing cognitive activation in infants. To our knowledge, we are the first to acquire pupil diameter measures through an online interface. The methodologies developed herein can be used as a valid means for acquiring physiological responses in future studies investigating cognition, attention, and memory thereby overcoming current limitations in both acquisition of responses and participant recruitment of infants

Semantic and emotional content of imagined representations in human occipitotemporal cortex.

Mental imagery is a critical cognitive function, clinically important, but poorly understood. When visual objects are perceived, many of their sensory, semantic and emotional properties are represented in occipitotemporal cortex. Visual imagery has been found to activate some of the same brain regions, but it was not known what properties are re-created in these regions during imagery. We therefore examined the representation during imagery for two stimuli in depth, by comparing the pattern of fMRI response to the patterns evoked by the perception of 200 diverse objects chosen to de-correlate their properties. Real-time, adaptive stimulus selection allowed efficient sampling of this broad stimulus space. Our experiments show that occipitotemporal cortex, which encoded sensory, semantic and emotional properties during perception, can robustly represent semantic and emotional properties during imagery, but that these representations depend on the object being imagined and on individual differences in style and reported vividness of imagery

Flexible, capacity-limited activity of posterior parietal cortex in perceptual as well as visual short-term memory tasks.

It has recently been shown, using functional magnetic resonance imaging with a change detection paradigm, that activity in posterior parietal cortex (PPC) correlates with the limited number of objects held in visual short-term memory (VSTM). We replicate this finding and extend it to tasks that use similar stimuli, but without explicit memory requirements. As well as a perceptual task used previously (detecting an item at fixation), 2 additional tasks were designed to increase attentional demands across space (searching for a red item anywhere in the array) and across both space and time (detecting a staggered offset after prolonged viewing of the array). During the VSTM task, a capacity-limited set-size effect was seen in PPC as well as occipital and frontal regions. However, the PPC showed similar activity during 2 of the tasks not requiring VSTM. These findings cannot easily be explained by behavioral performance measures or memory demands alone, suggesting a role of the PPC in processing a limited number of discrete object representations, whether in the current perceptual scene or working memory. The differential influence of item load across perceptual tasks is consistent with task requirements affecting the form of these representations

The temporal evolution of electromagnetic markers sensitive to the capacity limits of visual short-term memory.

An electroencephalographic (EEG) marker of the limited contents of human visual short-term memory (VSTM) has previously been described. Termed contralateral delay activity, this consists of a sustained, posterior, negative potential that correlates with memory load and is greatest contralateral to the remembered hemifield. The current investigation replicates this finding and uses magnetoencephalography (MEG) to characterize its magnetic counterparts and their neural generators as they evolve throughout the memory delay. A parametric manipulation of memory load, within and beyond capacity limits, allows separation of signals that asymptote with behavioral VSTM performance from additional responses that contribute to a linear increase with set-size. Both EEG and MEG yielded bilateral signals that track the number of objects held in memory, and contralateral signals that are independent of memory load. In MEG, unlike EEG, the contralateral interaction between hemisphere and item load is much weaker, suggesting that bilateral and contralateral markers of memory load reflect distinct sources to which EEG and MEG are differentially sensitive. Nonetheless, source estimation allowed both the bilateral and the weaker contralateral capacity-limited responses to be localized, along with a load-independent contralateral signal. Sources of global and hemisphere-specific signals all localized to the posterior intraparietal sulcus during the early delay. However the bilateral load response peaked earlier and its generators shifted later in the delay. Therefore the hemifield-specific response may be more closely tied to memory maintenance while the global load response may be involved in initial processing of a limited number of attended objects, such as their individuation or consolidation into memory

Visual short-term memory through the lifespan: preserved benefits of context and metacognition

Visual short-term memory ability falls throughout the lifespan in healthy adults. Using a continuous report task, in a large, population-based sample, we first confirmed that this decline affects the quality and quantity of reported memories as well as knowledge of which item went where. Visual and sensorimotor precision also worsened with advancing age, but this did not account for the reduced memory performance. We then considered two strategies that older individuals might be able to adopt, to offset these memory declines: the use of contextual encoding, and metacognitive monitoring of performance. Context and metacognitive awareness were both associated with significantly better performance, however these effects did not interact with age in our sample. This suggests that older adults retain their capacity to boost memory performance through attention to external context and monitoring of their performance. Strategies that focus on taking advantage of these preserved abilities may therefore help to maintain short-term memory performance with advancing age. The paper reports on analysis of the Cambridge Centre for Ageing and Neuroscience (Cam-CAN) data

The neural basis of precise visual short-term memory for complex recognisable objects.

Recent evidence suggests that visual short-term memory (VSTM) capacity estimated using simple objects, such as colours and oriented bars, may not generalise well to more naturalistic stimuli. More visual detail can be stored in VSTM when complex, recognisable objects are maintained compared to simple objects. It is not yet known if it is recognisability that enhances memory precision, nor whether maintenance of recognisable objects is achieved with the same network of brain regions supporting maintenance of simple objects. We used a novel stimulus generation method to parametrically warp photographic images along a continuum, allowing separate estimation of the precision of memory representations and the number of items retained. The stimulus generation method was also designed to create unrecognisable, though perceptually matched, stimuli, to investigate the impact of recognisability on VSTM. We adapted the widely-used change detection and continuous report paradigms for use with complex, photographic images. Across three functional magnetic resonance imaging (fMRI) experiments, we demonstrated greater precision for recognisable objects in VSTM compared to unrecognisable objects. This clear behavioural advantage was not the result of recruitment of additional brain regions, or of stronger mean activity within the core network. Representational similarity analysis revealed greater variability across item repetitions in the representations of recognisable, compared to unrecognisable complex objects. We therefore propose that a richer range of neural representations support VSTM for complex recognisable objects

Adjusting for global effects in voxel-based morphometry: Gray matter decline in normal aging

AbstractResults from studies that have examined age-related changes in gray matter based on structural MRI scans have not always been consistent. Reasons for this variability likely include small or unevenly-distributed samples, different methods for tissue class segmentation and spatial normalization, and the use of different statistical models. Particularly relevant to the latter is the method of adjusting for global (total) gray matter when making inferences about regionally-specific changes. In the current study, we use voxel-based morphometry (VBM) to explore the impact of these methodological choices in assessing age-related changes in gray matter volume in a sample of 420 adults evenly distributed between the ages of 18–77years. At a broad level, we replicate previous findings, showing age-related gray matter decline in nearly all parts of the brain, with particularly rapid decline in inferior regions of frontal cortex (e.g., insula and left inferior frontal gyrus) and the central sulcus. Segmentation was improved by increasing the number of tissue classes and using less age-biased templates, and registration was improved by using a diffeomorphic flow-based algorithm (DARTEL) rather than a “constrained warp” approach. Importantly, different approaches to adjusting for global effects – not adjusting, Local Covariation, Global Scaling, and Local Scaling – significantly affected regionally-specific estimates of age-related decline, as demonstrated by ranking age effects across anatomical ROIs. Split-half cross-validation showed that, on average, Local Covariation explained a greater proportion of age-related variance across these ROIs than did Global Scaling. Nonetheless, the appropriate choice for global adjustment depends on one's assumptions and specific research questions. More generally, these results emphasize the importance of being explicit about the assumptions underlying key methodological choices made in VBM analyses and the inferences that follow

Disentangling Representations of Object and Grasp Properties in the Human Brain

Contains fulltext : 159037.pdf (publisher's version ) (Open Access)The properties of objects, such as shape, influence the way we grasp them. To quantify the role of different brain regions during grasping, it is necessary to disentangle the processing of visual dimensions related to object properties from the motor aspects related to the specific hand configuration. We orthogonally varied object properties (shape, size, and elongation) and task (passive viewing, precision grip with two or five digits, or coarse grip with five digits) and used representational similarity analysis of functional magnetic resonance imaging data to infer the representation of object properties and hand configuration in the human brain. We found that object elongation is the most strongly represented object feature during grasping and is coded preferentially in the primary visual cortex as well as the anterior and posterior superior-parieto-occipital cortex. By contrast, primary somatosensory, motor, and ventral premotor cortices coded preferentially the number of digits while ventral-stream and dorsal-stream regions coded a mix of visual and motor dimensions. The representation of object features varied with task modality, as object elongation was less relevant during passive viewing than grasping. To summarize, this study shows that elongation is a particularly relevant property of the object to grasp, which along with the number of digits used, is represented within both ventral-stream and parietal regions, suggesting that communication between the two streams about these specific visual and motor dimensions might be relevant to the execution of efficient grasping actions. SIGNIFICANCE STATEMENT: To grasp something, the visual properties of an object guide preshaping of the hand into the appropriate configuration. Different grips can be used, and different objects require different hand configurations. However, in natural actions, grip and object type are often confounded, and the few experiments that have attempted to separate them have produced conflicting results. As such, it is unclear how visual and motor properties are represented across brain regions during grasping. Here we orthogonally manipulated object properties and grip, and revealed the visual dimension (object elongation) and the motor dimension (number of digits) that are more strongly coded in ventral and dorsal streams. These results suggest that both streams play a role in the visuomotor coding essential for grasping.15 p

Animacy and real-world size shape object representations in the human medial temporal lobes

Identifying what an object is, and whether an object has been encountered before, is a crucial aspect of human behavior. Despite this importance, we do not yet have a complete understanding of the neural basis of these abilities. Investigations into the neural organization of human object representations have revealed category specific organization in the ventral visual stream in perceptual tasks. Interestingly, these categories fall within broader domains of organization, with reported distinctions between animate, inanimate large, and inanimate small objects. While there is some evidence for category specific effects in the medial temporal lobe (MTL), in particular in perirhinal and parahippocampal cortex, it is currently unclear whether domain level organization is also present across these structures. To this end, we used fMRI with a continuous recognition memory task. Stimuli were images of objects from several different categories, which were either animate or inanimate, or large or small within the inanimate domain. We employed representational similarity analysis (RSA) to test the hypothesis that object-evoked responses in MTL structures during recognition-memory judgments also show evidence for domain-level organization along both dimensions. Our data support this hypothesis. Specifically, object representations were shaped by either animacy, real-world size, or both, in perirhinal and parahippocampal cortex, and the hippocampus. While sensitivity to these dimensions differed across structures when probed individually, hinting at interesting links to functional differentiation, similarities in organization across MTL structures were more prominent overall. These results argue for continuity in the organization of object representations in the ventral visual stream and the MTL