Dynamic, Task-Related and Demand-Driven Scene Representation

Humans selectively process and store details about the vicinity based on their knowledge about the scene, the world and their current task. In doing so, only those pieces of information are extracted from the visual scene that is required for solving a given task. In this paper, we present a flexible system architecture along with a control mechanism that allows for a task-dependent representation of a visual scene. Contrary to existing approaches, our system is able to acquire information selectively according to the demands of the given task and based on the system’s knowledge. The proposed control mechanism decides which properties need to be extracted and how the independent processing modules should be combined, based on the knowledge stored in the system’s long-term memory. Additionally, it ensures that algorithmic dependencies between processing modules are resolved automatically, utilizing procedural knowledge which is also stored in the long-term memory. By evaluating a proof-of-concept implementation on a real-world table scene, we show that, while solving the given task, the amount of data processed and stored by the system is considerably lower compared to processing regimes used in state-of-the-art systems. Furthermore, our system only acquires and stores the minimal set of information that is relevant for solving the given task

Facilitating Stable Representations: Serial Dependence in Vision

We tested whether the intervening time between multiple glances influences the independence of the resulting visual percepts. Observers estimated how many dots were present in brief displays that repeated one, two, three, four, or a random number of trials later. Estimates made farther apart in time were more independent, and thus carried more information about the stimulus when combined. In addition, estimates from different visual field locations were more independent than estimates from the same location. Our results reveal a retinotopic serial dependence in visual numerosity estimates, which may be a mechanism for maintaining the continuity of visual perception in a noisy environment

A habituation account of change detection in same/different judgments

We investigated the basis of change detection in a short-term priming task. In two experiments, participants were asked to indicate whether or not a target word was the same as a previously presented cue. Data from an experiment measuring magnetoencephalography failed to find different patterns for “same” and “different” responses, consistent with the claim that both arise from a common neural source, with response magnitude defining the difference between immediate novelty versus familiarity. In a behavioral experiment, we tested and confirmed the predictions of a habituation account of these judgments by comparing conditions in which the target, the cue, or neither was primed by its presentation in the previous trial. As predicted, cue-primed trials had faster response times, and target-primed trials had slower response times relative to the neither-primed baseline. These results were obtained irrespective of response repetition and stimulus–response contingencies. The behavioral and brain activity data support the view that detection of change drives performance in these tasks and that the underlying mechanism is neuronal habituation

Perception of Shadows in Children with Autism Spectrum Disorders

Background: Cast shadows in visual scenes can have profound effects on visual perception. Much as they are informative, they also constitute noise as they are salient features of the visual scene potentially interfering with the processing of other features. Here we asked i) whether individuals with autism can exploit the information conveyed by cast shadows; ii) whether they are especially sensitive to noise aspects of shadows. Methodology/Principal Findings: Twenty high-functioning children with autism and twenty typically developing children were asked to recognize familiar objects while the presence, position, and shape of the cast shadow were systematically manipulated. Analysis of vocal reaction time revealed that whereas typically developing children used information from cast shadows to improve object recognition, in autistic children the presence of cast shadows—either congruent or incongruent—interfered with object recognition. Critically, vocal reaction times were faster when the object was presented without a cast shadow. Conclusions/Significance: We conclude that shadow-processing mechanisms are abnormal in autism. As a result, processing shadows becomes costly and cast shadows interfere rather than help object recognition

What People Believe about How Memory Works: A Representative Survey of the U.S. Population

Incorrect beliefs about the properties of memory have broad implications: The media conflate normal forgetting and inadvertent memory distortion with intentional deceit, juries issue verdicts based on flawed intuitions about the accuracy and confidence of testimony, and students misunderstand the role of memory in learning. We conducted a large representative telephone survey of the U.S. population to assess common beliefs about the properties of memory. Substantial numbers of respondents agreed with propositions that conflict with expert consensus: Amnesia results in the inability to remember one's own identity (83% of respondents agreed), unexpected objects generally grab attention (78%), memory works like a video camera (63%), memory can be enhanced through hypnosis (55%), memory is permanent (48%), and the testimony of a single confident eyewitness should be enough to convict a criminal defendant (37%). This discrepancy between popular belief and scientific consensus has implications from the classroom to the courtroom

Conceptual and Visual Features Contribute to Visual Memory for Natural Images

We examined the role of conceptual and visual similarity in a memory task for natural images. The important novelty of our approach was that visual similarity was determined using an algorithm [1] instead of being judged subjectively. This similarity index takes colours and spatial frequencies into account. For each target, four distractors were selected that were (1) conceptually and visually similar, (2) only conceptually similar, (3) only visually similar, or (4) neither conceptually nor visually similar to the target image. Participants viewed 219 images with the instruction to memorize them. Memory for a subset of these images was tested subsequently. In Experiment 1, participants performed a two-alternative forced choice recognition task and in Experiment 2, a yes/no-recognition task. In Experiment 3, testing occurred after a delay of one week. We analyzed the distribution of errors depending on distractor type. Performance was lowest when the distractor image was conceptually and visually similar to the target image, indicating that both factors matter in such a memory task. After delayed testing, these differences disappeared. Overall performance was high, indicating a large-capacity, detailed visual long-term memory

Supporting dynamic change detection: using the right tool for the task

Detecting task-relevant changes in a visual scene is necessary for successfully monitoring and managing dynamic command and control situations. Change blindness—the failure to notice visual changes—is an important source of human error. Change History EXplicit (CHEX) is a tool developed to aid change detection and maintain situation awareness; and in the current study we test the generality of its ability to facilitate the detection of changes when this subtask is embedded within a broader dynamic decision-making task. A multitasking air-warfare simulation required participants to perform radar-based subtasks, for which change detection was a necessary aspect of the higher-order goal of protecting one’s own ship. In this task, however, CHEX rendered the operator even more vulnerable to attentional failures in change detection and increased perceived workload. Such support was only effective when participants performed a change detection task without concurrent subtasks. Results are interpreted in terms of the NSEEV model of attention behavior (Steelman, McCarley, & Wickens, Hum. Factors 53:142–153, 2011; J. Exp. Psychol. Appl. 19:403–419, 2013), and suggest that decision aids for use in multitasking contexts must be designed to fit within the available workload capacity of the user so that they may truly augment cognition

The Spatial and Temporal Construction of Confidence in the Visual Scene

Human subjects can report many items of a cluttered field a few hundred milliseconds after stimulus presentation. This memory decays rapidly and after a second only 3 or 4 items can be stored in working memory. Here we compared the dynamics of objective performance with a measure of subjective report and we observed that 1) Objective performance beyond explicit subjective reports (blindsight) was significantly more pronounced within a short temporal interval and within specific locations of the visual field which were robust across sessions 2) High confidence errors (false beliefs) were largely confined to a small spatial window neighboring the cue. The size of this window did not change in time 3) Subjective confidence showed a moderate but consistent decrease with time, independent of all other experimental factors. Our study allowed us to asses quantitatively the temporal and spatial access to an objective response and to subjective reports