Proceedings of the 2011 Joint Workshop of Fraunhofer IOSB and Institute for Anthropomatics, Vision and Fusion Laboratory

This book is a collection of 15 reviewed technical reports summarizing the presentations at the 2011 Joint Workshop of Fraunhofer IOSB and Institute for Anthropomatics, Vision and Fusion Laboratory. The covered topics include image processing, optical signal processing, visual inspection, pattern recognition and classification, human-machine interaction, world and situation modeling, autonomous system localization and mapping, information fusion, and trust propagation in sensor networks

The impact of reward value on early sensory processing and its interaction with selective attention

Reward value affects the earliest stages of sensory perception. Whereas a host of previous studies have investigated the underlying mechanisms of reward-driven modulation of visual perception, reward effects in other sensory modalities have remained underexplored. Specifically, it has remained unknown how reward signals should be coordinated and communicated across sensory modalities. The current PhD thesis aimed to gain insight into the underlying mechanisms of reward-driven modulation of perception and its interaction with attention across sensory modalities. To this end, three experiments were conducted to identify the behavioral and electrophysiological correlates of reward effects. In Study 1, we found that high reward, task-irrelevant visual cues (intra-modal) elicited an early suppression of visual event-related potentials (ERPs). High reward auditory cues (cross-modal), on the other hand, led to a later modulation of visual ERPs and facilitated behavioral performance. Study 2 tested the dependence of reward effects on the spatial and temporal arrangement of intra-modal and cross-modal cues relative to the target, and showed that each reward cue maximally exerts its effect under a specific size of attentional focus. Study 3 explicitly manipulated the spatial attention and tested how reward associations of an audiovisual stimulus influence the allocation of attention. We found that auditory rewards enhanced the attentional modulation of both visual and auditory ERPs. Interestingly, although visual rewards did not lead to a distinguishable ERP modulation, they led to strong modulations when they were combined with auditory rewards, suggesting that integration across modalities boosts the reward effects. Taken together, the current PhD thesis identified the behavioral and neural signatures of reward-driven modulation of perception under different modes of reward signaling and different degrees of attentional engagement. Our findings inspire a two-stage model of reward processing, with local, intra-modal reward effects occurring at an early stage and long-range, multimodal reward effects arising at a later stage. Cross-modal reward signals have important ramifications for clinical applications where the impaired function of one sense can be rehabilitated by motivational signals conveyed through another sensory modality.2021-11-2

Music-listening systems

Thesis (Ph.D.)--Massachusetts Institute of Technology, Dept. of Architecture, 2000.Includes bibliographical references (p. [235]-248).When human listeners are confronted with musical sounds, they rapidly and automatically orient themselves in the music. Even musically untrained listeners have an exceptional ability to make rapid judgments about music from very short examples, such as determining the music's style, performer, beat, complexity, and emotional impact. However, there are presently no theories of music perception that can explain this behavior, and it has proven very difficult to build computer music-analysis tools with similar capabilities. This dissertation examines the psychoacoustic origins of the early stages of music listening in humans, using both experimental and computer-modeling approaches. The results of this research enable the construction of automatic machine-listening systems that can make human-like judgments about short musical stimuli. New models are presented that explain the perception of musical tempo, the perceived segmentation of sound scenes into multiple auditory images, and the extraction of musical features from complex musical sounds. These models are implemented as signal-processing and pattern-recognition computer programs, using the principle of understanding without separation. Two experiments with human listeners study the rapid assignment of high-level judgments to musical stimuli, and it is demonstrated that many of the experimental results can be explained with a multiple-regression model on the extracted musical features. From a theoretical standpoint, the thesis shows how theories of music perception can be grounded in a principled way upon psychoacoustic models in a computational-auditory-scene-analysis framework. Further, the perceptual theory presented is more relevant to everyday listeners and situations than are previous cognitive-structuralist approaches to music perception and cognition. From a practical standpoint, the various models form a set of computer signal-processing and pattern-recognition tools that can mimic human perceptual abilities on a variety of musical tasks such as tapping along with the beat, parsing music into sections, making semantic judgments about musical examples, and estimating the similarity of two pieces of music.Eric D. Scheirer.Ph.D