Time course of information processing in visual and haptic object classification

Peer reviewedPublisher PD

Parametric study of EEG sensitivity to phase noise during face processing

<b>Background: </b> The present paper examines the visual processing speed of complex objects, here faces, by mapping the relationship between object physical properties and single-trial brain responses. Measuring visual processing speed is challenging because uncontrolled physical differences that co-vary with object categories might affect brain measurements, thus biasing our speed estimates. Recently, we demonstrated that early event-related potential (ERP) differences between faces and objects are preserved even when images differ only in phase information, and amplitude spectra are equated across image categories. Here, we use a parametric design to study how early ERP to faces are shaped by phase information. Subjects performed a two-alternative force choice discrimination between two faces (Experiment 1) or textures (two control experiments). All stimuli had the same amplitude spectrum and were presented at 11 phase noise levels, varying from 0% to 100% in 10% increments, using a linear phase interpolation technique. Single-trial ERP data from each subject were analysed using a multiple linear regression model. <b>Results: </b> Our results show that sensitivity to phase noise in faces emerges progressively in a short time window between the P1 and the N170 ERP visual components. The sensitivity to phase noise starts at about 120–130 ms after stimulus onset and continues for another 25–40 ms. This result was robust both within and across subjects. A control experiment using pink noise textures, which had the same second-order statistics as the faces used in Experiment 1, demonstrated that the sensitivity to phase noise observed for faces cannot be explained by the presence of global image structure alone. A second control experiment used wavelet textures that were matched to the face stimuli in terms of second- and higher-order image statistics. Results from this experiment suggest that higher-order statistics of faces are necessary but not sufficient to obtain the sensitivity to phase noise function observed in response to faces. <b>Conclusion: </b> Our results constitute the first quantitative assessment of the time course of phase information processing by the human visual brain. We interpret our results in a framework that focuses on image statistics and single-trial analyses

Picture this: researching child workers

Visual methods such as photography are under-used in the active process of sociological research. As rare as visual methods are, it is even rarer for the resultant images to be made by rather than of research participants. Primarily, the paper explores the challenges and contradictions of using photography within a multi-method approach. We consider processes for analysing visual data, different ways of utilising visual methods in sociological research, and the use of primary and secondary data, or, simple illustration versus active visual exploration of the social. The question of triangulation of visual data against text and testimony versus a stand-alone approach is explored in depth

Are the deficits in navigational abilities present in the Williams syndrome related to deficits in the backward inhibition?

Williams syndrome (WS) is associated with a distinct profile of relatively proficient skills within the verbal domain compared to the severe impairment of visuo-spatial processing. Abnormalities in executive functions and deficits in planning ability and spatial working memory have been described. However, to date little is known about the influence of executive function deficits on navigational abilities in WS. This study aimed at analyzing in WS individuals a specific executive function, the backward inhibition (BI) that allows individuals to flexibly adapt to continuously changing environments. A group of WS individuals and a mental age- and gender-matched group of typically developing children were subjected to three task-switching experiments requiring visuospatial or verbal material to be processed. Results showed that WS individuals exhibited clear BI deficits during visuospatial task-switching paradigms and normal BI effect during verbal task-switching paradigm. Overall, the present results suggest that the BI involvement in updating environment representations during navigation may influence WS navigational abilitie

Lectin ligands: New insights into their conformations and their dynamic behavior and the discovery of conformer selection by lectins

The mysteries of the functions of complex glycoconjugates have enthralled scientists over decades. Theoretical considerations have ascribed an enormous capacity to store information to oligosaccharides, In the interplay with lectins sugar-code words of complex carbohydrate structures can be deciphered. To capitalize on knowledge about this type of molecular recognition for rational marker/drug design, the intimate details of the recognition process must be delineated, To this aim the required approach is garnered from several fields, profiting from advances primarily in X-ray crystallography, nuclear magnetic resonance spectroscopy and computational calculations encompassing molecular mechanics, molecular dynamics and homology modeling. Collectively considered, the results force us to jettison the preconception of a rigid ligand structure. On the contrary, a carbohydrate ligand may move rather freely between two or even more low-energy positions, affording the basis for conformer selection by a lectin. By an exemplary illustration of the interdisciplinary approach including up-to-date refinements in carbohydrate modeling it is underscored why this combination is considered to show promise of fostering innovative strategies in rational marker/drug design

Bottom-Up and Top-Down Reasoning with Hierarchical Rectified Gaussians

Convolutional neural nets (CNNs) have demonstrated remarkable performance in recent history. Such approaches tend to work in a unidirectional bottom-up feed-forward fashion. However, practical experience and biological evidence tells us that feedback plays a crucial role, particularly for detailed spatial understanding tasks. This work explores bidirectional architectures that also reason with top-down feedback: neural units are influenced by both lower and higher-level units. We do so by treating units as rectified latent variables in a quadratic energy function, which can be seen as a hierarchical Rectified Gaussian model (RGs). We show that RGs can be optimized with a quadratic program (QP), that can in turn be optimized with a recurrent neural network (with rectified linear units). This allows RGs to be trained with GPU-optimized gradient descent. From a theoretical perspective, RGs help establish a connection between CNNs and hierarchical probabilistic models. From a practical perspective, RGs are well suited for detailed spatial tasks that can benefit from top-down reasoning. We illustrate them on the challenging task of keypoint localization under occlusions, where local bottom-up evidence may be misleading. We demonstrate state-of-the-art results on challenging benchmarks.Comment: To appear in CVPR 201

The perception of dynamic and static facial expressions of happiness and disgust investigated by ERPs and fMRI constrained source analysis

A recent functional magnetic resonance imaging (fMRI) study by our group demonstrated that dynamic emotional faces are more accurately recognized and evoked more widespread patterns of hemodynamic brain responses than static emotional faces. Based on this experimental design, the present study aimed at investigating the spatio-temporal processing of static and dynamic emotional facial expressions in 19 healthy women by means of multi-channel electroencephalography (EEG), event-related potentials (ERP) and fMRI-constrained regional source analyses. ERP analysis showed an increased amplitude of the LPP (late posterior positivity) over centro-parietal regions for static facial expressions of disgust compared to neutral faces. In addition, the LPP was more widespread and temporally prolonged for dynamic compared to static faces of disgust and happiness. fMRI constrained source analysis on static emotional face stimuli indicated the spatio-temporal modulation of predominantly posterior regional brain activation related to the visual processing stream for both emotional valences when compared to the neutral condition in the fusiform gyrus. The spatio-temporal processing of dynamic stimuli yielded enhanced source activity for emotional compared to neutral conditions in temporal (e.g., fusiform gyrus), and frontal regions (e.g., ventromedial prefrontal cortex, medial and inferior frontal cortex) in early and again in later time windows. The present data support the view that dynamic facial displays trigger more information reflected in complex neural networks, in particular because of their changing features potentially triggering sustained activation related to a continuing evaluation of those faces. A combined fMRI and EEG approach thus provides an advanced insight to the spatio-temporal characteristics of emotional face processing, by also revealing additional neural generators, not identifiable by the only use of an fMRI approach