Fast Modal Sounds with Scalable Frequency-Domain Synthesis

International audienceAudio rendering of impact sounds, such as those caused by falling objects or explosion debris, adds realism to interactive 3D audiovisual applications, and can be convincingly achieved using modal sound synthesis. Unfortunately, mode-based computations can become prohibitively expensive when many objects, each with many modes, are impacted simultaneously. We introduce a fast sound synthesis approach, based on short-time Fourier Tranforms, that exploits the inherent sparsity of modal sounds in the frequency domain. For our test scenes, this "fast mode summation" can give speedups of 5-8 times compared to a time-domain solution, with slight degradation in quality. We discuss different reconstruction windows, affecting the quality of impact sound "attacks". Our Fourier-domain processing method allows us to introduce a scalable, real-time, audio processing pipeline for both recorded and modal sounds, with auditory masking and sound source clustering. To avoid abrupt computation peaks, such as during the simultaneous impacts of an explosion, we use crossmodal perception results on audiovisual synchrony to effect temporal scheduling. We also conducted a pilot perceptual user evaluation of our method. Our implementation results show that we can treat complex audiovisual scenes in real time with high quality

Vestibular Perception following Acute Unilateral Vestibular Lesions.

Little is known about the vestibulo-perceptual (VP) system, particularly after a unilateral vestibular lesion. We investigated vestibulo-ocular (VO) and VP function in 25 patients with vestibular neuritis (VN) acutely (2 days after onset) and after compensation (recovery phase, 10 weeks). Since the effect of VN on reflex and perceptual function may differ at threshold and supra-threshold acceleration levels, we used two stimulus intensities, acceleration steps of 0.5°/s(2) and velocity steps of 90°/s (acceleration 180°/s(2)). We hypothesised that the vestibular lesion or the compensatory processes could dissociate VO and VP function, particularly if the acute vertiginous sensation interferes with the perceptual tasks. Both in acute and recovery phases, VO and VP thresholds increased, particularly during ipsilesional rotations. In signal detection theory this indicates that signals from the healthy and affected side are still fused, but result in asymmetric thresholds due to a lesion-induced bias. The normal pattern whereby VP thresholds are higher than VO thresholds was preserved, indicating that any 'perceptual noise' added by the vertigo does not disrupt the cognitive decision-making processes inherent to the perceptual task. Overall, the parallel findings in VO and VP thresholds imply little or no additional cortical processing and suggest that vestibular thresholds essentially reflect the sensitivity of the fused peripheral receptors. In contrast, a significant VO-VP dissociation for supra-threshold stimuli was found. Acutely, time constants and duration of the VO and VP responses were reduced - asymmetrically for VO, as expected, but surprisingly symmetrical for perception. At recovery, VP responses normalised but VO responses remained shortened and asymmetric. Thus, unlike threshold data, supra-threshold responses show considerable VO-VP dissociation indicative of additional, higher-order processing of vestibular signals. We provide evidence of perceptual processes (ultimately cortical) participating in vestibular compensation, suppressing asymmetry acutely in unilateral vestibular lesions

Gender and line size factors modulate the deviations of the subjective visual vertical induced by head tilt

<p>Abstract</p> <p>Background</p> <p>The subjective visual vertical (SVV, the visual estimation of gravitational direction) is commonly considered as an indicator of the sense of orientation. The present study examined the impact of two methodological factors (the angle size of the stimulus and the participant's gender) on deviations of the SVV caused by head tilt. Forty healthy participants (20 men and 20 women) were asked to make visual vertical adjustments of a light bar with their head held vertically or roll-tilted by 30° to the left or to the right. Line angle sizes of 0.95° and 18.92° were presented.</p> <p>Results</p> <p>The SVV tended to move in the direction of head tilt in women but away from the direction of head tilt in men. Moreover, the head-tilt effect was also modulated by the stimulus' angle size. The large angle size led to deviations in the direction of head-tilt, whereas the small angle size had the opposite effect.</p> <p>Conclusions</p> <p>Our results showed that gender and line angle size have an impact on the evaluation of the SVV. These findings must be taken into account in the growing body of research that uses the SVV paradigm in disease settings. Moreover, this methodological issue may explain (at least in part) the discrepancies found in the literature on the head-tilt effect.</p

Perceived Object Stability Depends on Multisensory Estimates of Gravity

BACKGROUND: How does the brain estimate object stability? Objects fall over when the gravity-projected centre-of-mass lies outside the point or area of support. To estimate an object's stability visually, the brain must integrate information across the shape and compare its orientation to gravity. When observers lie on their sides, gravity is perceived as tilted toward body orientation, consistent with a representation of gravity derived from multisensory information. We exploited this to test whether vestibular and kinesthetic information affect this visual task or whether the brain estimates object stability solely from visual information. METHODOLOGY/PRINCIPAL FINDINGS: In three body orientations, participants viewed images of objects close to a table edge. We measured the critical angle at which each object appeared equally likely to fall over or right itself. Perceived gravity was measured using the subjective visual vertical. The results show that the perceived critical angle was significantly biased in the same direction as the subjective visual vertical (i.e., towards the multisensory estimate of gravity). CONCLUSIONS/SIGNIFICANCE: Our results rule out a general explanation that the brain depends solely on visual heuristics and assumptions about object stability. Instead, they suggest that multisensory estimates of gravity govern the perceived stability of objects, resulting in objects appearing more stable than they are when the head is tilted in the same direction in which they fall

Relationship between spatial ability, visuospatial working memory and self-assessed spatial orientation ability: a study in older adults

This paper describes some novel spatial tasks and questionnaires designed to assess spatial and orientation abilities. The new tasks and questionnaires were administered to a sample of 90 older adults (41 males, age range 57–90), along with some other tests of spatial ability (Minnesota Paper Form Board, Mental Rotations Test, and Embedded Figures Test) and tests of visuospatial working memory (Corsi’s Block Test and Visual Pattern Test). The internal reliability of the new tasks and questionnaires was analyzed, as well as their relationship with the spatial and working memory tests. The results showed that the new spatial tasks are reliable, correlate with working memory and spatial ability tests and, compared with the latters, show stronger correlations with the self-report questionnaires referring to orientation abilities. A model was also tested (with reference to Allen et al. in Intelligence 22:327–355, 1996) in which the new tasks were assumed to relate to spatial ability and predict orientation abilities as assessed by the self-report measures

Microclimate and transpiration of greenhouse rose crops

International audienc

Evaluation of malathion, diazinon, a silica aerogel, and a diatomaceous earth as protectants on wheat against lesser grain borer attack in small bins

no.86