Dynamic Perceptual Changes in Audiovisual Simultaneity

Background: The timing at which sensory input reaches the level of conscious perception is an intriguing question still awaiting an answer. It is often assumed that both visual and auditory percepts have a modality specific processing delay and their difference determines perceptual temporal offset. Methodology/Principal Findings: Here, we show that the perception of audiovisual simultaneity can change flexibly and fluctuates over a short period of time while subjects observe a constant stimulus. We investigated the mechanisms underlying the spontaneous alternations in this audiovisual illusion and found that attention plays a crucial role. When attention was distracted from the stimulus, the perceptual transitions disappeared. When attention was directed to a visual event, the perceived timing of an auditory event was attracted towards that event. Conclusions/Significance: This multistable display illustrates how flexible perceived timing can be, and at the same time offers a paradigm to dissociate perceptual from stimulus-driven factors in crossmodal feature binding. Our findings suggest that the perception of crossmodal synchrony depends on perceptual binding of audiovisual stimuli as a common event

Time dilation in dynamic visual display

How does the brain estimate time? This old question has led to many biological and psychological models of time perception (R. A. Block, 1989; P. Fraisse, 1963; J. Gibbon, 1977; D. L. I. Zakay, 1989). Because time cannot be directly measured at a given moment, it has been proposed that the brain estimates time based on the number of changes in an event (S. W. Brown, 1995; P. Fraisse, 1963; W. D. Poynter, 1989). Consistent with this idea, dynamic visual stimuli are known to lengthen perceived time (J. F. Brown, 1931; S. Goldstone & W. T. Lhamon, 1974; W. T. Lhamon & S. Goldstone, 1974, C. O. Z. Roelofs & W. P. C. Zeeman, 1951). However, the kind of information that constitutes the basis for time perception remains unresolved. Here, we show that the temporal frequency of a stimulus serves as the “clock” for perceived duration. Other aspects of changes, such as speed or coherence, were found to be inconsequential. Time dilation saturated at a temporal frequency of 4–8 Hz. These results suggest that the clock governing perceived time has its basis at early processing stages. The possible links between models of time perception and neurophysiological functions of early visual areas are discussed

Exploring the Anatomical Basis of Effective Connectivity Models with DTI-Based Fiber Tractography

Diffusion tensor imaging (DTI) is considered to be a promising tool for revealing the anatomical basis of functional networks. In this study, we investigate the potential of DTI to provide the anatomical basis of paths that are used in studies of effective connectivity, using structural equation modeling. We have taken regions of interest from eight previously published studies, and examined the connectivity as defined by DTI-based fiber tractography between these regions. The resulting fiber tracts were then compared with the paths proposed in the original studies. For a substantial number of connections, we found fiber tracts that corresponded to the proposed paths. More importantly, we have also identified a number of cases in which tractography suggested direct connections which were not included in the original analyses. We therefore conclude that DTI-based fiber tractography can be a valuable tool to study the anatomical basis of functional networks

The Scope and Limits of Top-Down Attention in Unconscious Visual Processing

Attentional selection plays a critical role in conscious perception. When attention is diverted, even salient stimuli fail to reach visual awareness [1,2]. Attention can be voluntarily directed to a spatial location [3,4,5,6,7,8,9] or a visual feature [9,10,11,12,13,14] for facilitating the processing of information relevant to current goals. In everyday situations, attention and awareness are tightly coupled. This has led some to suggest that attention and awareness might be based on a common neural foundation [15,16], whereas others argue that they are mediated by distinct mechanisms [17,18,19]. A body of evidence shows that visual stimuli can be processed at multiple stages of the visual-processing streams without evoking visual awareness [20,21,22]. To illuminate the relationship between visual attention and conscious perception, we investigated whether top-down attention can target and modulate the neural representations of unconsciously processed visual stimuli. Our experiments show that spatial attention can target only consciously perceived stimuli, whereas feature-based attention can modulate the processing of invisible stimuli. The attentional modulation of unconscious signals implies that attention and awareness can be dissociated, challenging a simplistic view of the boundary between conscious and unconscious visual processing

Saccadic selection and crowding in visual search:stronger lateral masking leads to shorter search times

We investigated the role of crowding in saccadic selection during visual search. To guide eye movements, often information from the visual periphery is used. Crowding is known to deteriorate the quality of peripheral information. In four search experiments, we studied the role of crowding, by accompanying individual search elements by flankers. Varying the difference between target and flankers allowed us to manipulate crowding strength throughout the stimulus. We found that eye movements are biased toward areas with little crowding for conditions where a target could be discriminated peripherally. Interestingly, for conditions in which the target could not be discriminated peripherally, this bias reversed to areas with strong crowding. This led to shorter search times for a target presented in areas with stronger crowding, compared to a target presented in areas with less crowding. These findings suggest a dual role for crowding in visual search. The presence of flankers similar to the target deteriorates the quality of the peripheral target signal but can also attract eye movements, as more potential targets are present over the area

What is Grouping during Binocular Rivalry?

During binocular rivalry, perception alternates between dissimilar images presented dichoptically. Although perception during rivalry is believed to originate from competition at a local level, different rivalry zones are not independent: rival targets that are spaced apart but have similar features tend to be dominant at the same time. We investigated grouping of spatially separated rival targets presented to the same or to different eyes and presented in the same or in different hemifields. We found eye-of-origin to be the strongest cue for grouping during binocular rivalry. Grouping was additionally affected by orientation: identical orientations were grouped longer than dissimilar orientations, even when presented to different eyes. Our results suggest that eye-based and orientation-based grouping is independent and additive in nature. Grouping effects were further modulated by the distribution of the targets across the visual field. That is, grouping within the same hemifield can be stronger or weaker than between hemifields, depending on the eye-of-origin of the grouped targets. We also quantified the contribution of the previous cues to grouping of two images during binocular rivalry. These quantifications can be successfully used to predict the dominance durations of different studies. Incorporating the relative contribution of different cues to grouping, and the dependency on hemifield, into future models of binocular rivalry will prove useful in our understanding of the functional and anatomical basis of the phenomenon of binocular rivalry

Perceptual alternation induced by visual transients

When our visual system is confronted with ambiguous stimuli, the perceptual interpretation spontaneously alternates between the competing incompatible interpretations. The timing of such perceptual alternations is highly stochastic and the underlying neural mechanisms are poorly understood. We show that perceptual alternations can be triggered by a transient stimulus presented nearby. The induction was tested for four types of bistable stimuli: structure-from-motion, binocular rivalry, Necker cube, and ambiguous apparent motion. While underlying mechanisms may vary among them, a transient flash induced time-locked perceptual alternations in all cases. The effect showed a dependence on the adaptation to the dominant percept prior to the presentation of a flash. These perceptual alternations show many similarities to perceptual disappearances induced by transient stimuli (Kanai and Kamitani, 2003 Journal of Cognitive Neuroscience 15 664 – 672; Moradi and Shimojo, 2004 Vision Research 44 449 – 460). Mechanisms linking these two transient-induced phenomena are discussed

time dilation effect in an active observer and virtual environment requires apparent motion no dilation for retinal or world motion alone

n/

The Spatial Origin of a Perceptual Transition in Binocular Rivalry

When the left and the right eye are simultaneously presented with incompatible images at overlapping retinal locations, an observer typically reports perceiving only one of the two images at a time. This phenomenon is called binocular rivalry. Perception during binocular rivalry is not stable; one of the images is perceptually dominant for a certain duration (typically in the order of a few seconds) after which perception switches towards the other image. This alternation between perceptual dominance and suppression will continue for as long the images are presented. A characteristic of binocular rivalry is that a perceptual transition from one image to the other generally occurs in a gradual manner: the image that was temporarily suppressed will regain perceptual dominance at isolated locations within the perceived image, after which its visibility spreads throughout the whole image. These gradual transitions from perceptual suppression to perceptual dominance have been labeled as traveling waves of perceptual dominance. In this study we investigate whether stimulus parameters affect the location at which a traveling wave starts. We varied the contrast, spatial frequency or motion speed in one of the rivaling images, while keeping the same parameter constant in the other image. We used a flash-suppression paradigm to force one of the rival images into perceptual suppression. Observers waited until the suppressed image became perceptually dominant again, and indicated the position at which this breakthrough from suppression occurred. Our results show that the starting point of a traveling wave during binocular rivalry is highly dependent on local stimulus parameters. More specifically, a traveling wave most likely started at the location where the contrast of the suppressed image was higher than that of the dominant one, the spatial frequency of the suppressed image was lower than that of the dominant one, and the motion speed of the suppressed image was higher than that of the dominant one. We suggest that a breakthrough from suppression to dominance occurs at the location where salience (the degree to which a stimulus element stands out relative to neighboring elements) of the suppressed image is higher than that of the dominant one. Our results further show that stimulus parameters affecting the temporal dynamics during continuous viewing of rival images described in other studies, also affect the spatial origin of traveling waves during binocular rivalry