Uncertainty Compensation in Human Attention: Evidence from Response Times and Fixation Durations

BACKGROUND: Uncertainty and predictability have remained at the center of the study of human attention. Yet, studies have only examined whether response times (RT) or fixations were longer or shorter under levels of stimulus uncertainty. To date, no study has examined patterns of stimuli and responses through a unifying framework of uncertainty. METHODOLOGY/PRINCIPAL FINDINGS: We asked 29 college students to generate repeated responses to a continuous series of visual stimuli presented on a computer monitor. Subjects produced these responses by pressing on a keypad as soon a target was detected (regardless of position) while the durations of their visual fixations were recorded. We manipulated the level of stimulus uncertainty in space and time by changing the number of potential stimulus locations and time intervals between stimulus presentations. To allow the analyses to be conducted using uncertainty as common description of stimulus and response we calculated the entropy of the RT and fixation durations. We tested the hypothesis of uncertainty compensation across space and time by fitting the RT and fixation duration entropy values to a quadratic surface. The quadratic surface accounted for 80% of the variance in the entropy values of both RT and fixation durations. RT entropy increased as a function of spatial and temporal uncertainty of the stimulus, alongside a symmetric, compensatory decrease in the entropy of fixation durations as the level of spatial and temporal uncertainty of the stimuli was increased. CONCLUSIONS/SIGNIFICANCE: Our results demonstrate that greater uncertainty in the stimulus leads to greater uncertainty in the response, and that the effects of spatial and temporal uncertainties are compensatory. We also observed compensatory relationship across the entropies of fixation duration and RT, suggesting that a more predictable visual search strategy leads to more uncertain response patterns and vice versa

LongITools: Dynamic longitudinal exposome trajectories in cardiovascular and metabolic noncommunicable diseases

The current epidemics of cardiovascular and metabolic noncommunicable diseases have emerged alongside dramatic modifications in lifestyle and living environments. These correspond to changes in our “modern” postwar societies globally characterized by rural-to-urban migration, modernization of agricultural practices, and transportation, climate change, and aging. Evidence suggests that these changes are related to each other, although the social and biological mechanisms as well as their interactions have yet to be uncovered. LongITools, as one of the 9 projects included in the European Human Exposome Network, will tackle this environmental health equation linking multidimensional environmental exposures to the occurrence of cardiovascular and metabolic noncommunicable diseases

Tradeoffs between attentional effects of spatial cues and abrupt onsets

We determined the relative effectiveness and tradeoffs among central, peripheral, and abrupt onset cues in directing attention to a potential target character. Central cues were arrows located at the fixation point, whereas peripheral cues were arrows occurring about 3º away from fixation, near the location of a potential target. These were contrasted with the abrupt onset of an ambiguous part of a character, which later was filled in to reveal a target or a distractor item. Each trial included an arrow cue and an abrupt onset cue, and both expected cue validities and cue–character SOAs were varied factorially. The results showed that, in general, abrupt onsets captured attention more effectively than either central or peripheral arrow cues. However, tradeoffs among separate cue effects indicated that the power of abrupt onsets to capture attention automatically could be overridden by a high-validity spatial cue presented in advance of the onset character. Tradeoffs between the effects of central and abrupt onset cues were additive, indicating that endogenous and exogenous cues have their main effects at different levels in the visual attention system. Peripheral cues and abrupt onsets showed mainly interactive effects, however, consistent with the idea that both types of cues have exogenous components that affect a common pool of attentional resources

Quantifying temporal ventriloquism in audiovisual synchrony perception

The integration of visual and auditory inputs in the human brain works properly only if the components are perceived in close temporal proximity. In the present study, we quantified cross-modal interactions in the human brain for audiovisual stimuli with temporal asynchronies, using a paradigm from rhythm perception. In this method, participants had to align the temporal position of a target in a rhythmic sequence of four markers. In the first experiment, target and markers consisted of a visual flash or an auditory noise burst, and all four combinations of target and marker modalities were tested. In the same-modality conditions, no temporal biases and a high precision of the adjusted temporal position of the target were observed. In the different-modality conditions, we found a systematic temporal bias of 25–30 ms. In the second part of the first and in a second experiment, we tested conditions in which audiovisual markers with different stimulus onset asynchronies (SOAs) between the two components and a visual target were used to quantify temporal ventriloquism. The adjusted target positions varied by up to about 50 ms and depended in a systematic way on the SOA and its proximity to the point of subjective synchrony. These data allowed testing different quantitative models. The most satisfying model, based on work by Maij, Brenner, and Smeets (Journal of Neurophysiology 102, 490–495, 2009), linked temporal ventriloquism and the percept of synchrony and was capable of adequately describing the results from the present study, as well as those of some earlier experiment

Effectiveness of stereoscopic displays in medicine : a review

In this paper we review empirical studies concerning the effectiveness of stereoscopic displays in medicine. The domains covered in this review are: diagnosis, pre-operative planning, minimally invasive surgery (MIS) and training/teaching. For diagnosis, stereoscopic viewing of medical data has been shown to improve the sensitivity of tumor detection in breast imaging, and to improve the visualization of internal structures in 3D ultrasound. For MRI and CT data, where images are frequently rendered in 3D perspective, the added value of binocular depth has not yet been convincingly demonstrated. For MIS, stereoscopic displays decrease surgery time and increase accuracy of surgical procedures when the resolution of the stereoscopic displays is comparable to that of 2D displays. Training and surgical planning already use computer simulations; more research however is needed to assess the potential benefits of stereoscopic displays in those applications. Overall, there is a clear need for more empirical evidence that quantifies the added value of stereoscopic displays in medical domains

How can a robot attract the attention of its human partner? : a comparative study over different modalities for attracting attention

One of the most common tasks of a robot companion in the home is communication. In order to initiate an information exchange with its human partner, the robot needs to attract the attention of the human. This paper presents results of a user study (N=12) with elderly people (62 - 70 years) to evaluate different modalities for attracting attention. Results show that actions which involve sound generate the fastest reaction times and are better perceived by participants. Surprisingly attempting to attract attention by establishing eye-contact resulted in worse participants’ perception. We interpret these results as that robot gazing behaviour is better suited for situations in which the user’s focus of visual attention is already on the robot

Audiovisual synchrony and temporal order judgments : effects of experimental method and stimulus type

When an audio-visual event is perceived in the natural environment, a physical delay will always occur between the arrival of the leading visual component and that of the trailing auditory component. This natural timing relationship suggests that the point of subjective simultaneity (PSS) should occur at an auditory delay greater than or equal to 0 msec. A review of the literature suggests that PSS estimates derived from a temporal order judgment (TOJ) task differ from those derived from a synchrony judgment (SJ) task, with (unnatural) auditory-leading PSS values reported mainly for the TOJ task. We report data from two stimulus types that differed in terms of complexity—namely, (1) a flash and a click and (2) a bouncing ball and an impact sound. The same participants judged the temporal order and synchrony of both stimulus types, using three experimental methods: (1) a TOJ task with two response categories ( audio first or video first ), (2) an SJ task with two response categories ( synchronous or asynchronous ; SJ2), and (3) an SJ task with three response categories ( audio first, synchronous, or video first ; SJ3). Both stimulus types produced correlated PSS estimates with the SJ tasks, but the estimates from the TOJ procedure were uncorrelated with those obtained from the SJ tasks. These results suggest that the SJ task should be preferred over the TOJ task when the primary interest is in perceived audio-visual synchrony