Reducing bias in auditory duration reproduction by integrating the reproduced signal

Duration estimation is known to be far from veridical and to differ for sensory estimates and motor reproduction. To investigate how these differential estimates are integrated for estimating or reproducing a duration and to examine sensorimotor biases in duration comparison and reproduction tasks, we compared estimation biases and variances among three different duration estimation tasks: perceptual comparison, motor reproduction, and auditory reproduction (i.e. a combined perceptual-motor task). We found consistent overestimation in both motor and perceptual-motor auditory reproduction tasks, and the least overestimation in the comparison task. More interestingly, compared to pure motor reproduction, the overestimation bias was reduced in the auditory reproduction task, due to the additional reproduced auditory signal. We further manipulated the signal-to-noise ratio (SNR) in the feedback/comparison tones to examine the changes in estimation biases and variances. Considering perceptual and motor biases as two independent components, we applied the reliability-based model, which successfully predicted the biases in auditory reproduction. Our findings thus provide behavioral evidence of how the brain combines motor and perceptual information together to reduce duration estimation biases and improve estimation reliability

Exploring relationships between touch perception and surface physical properties

This paper reports a study of materials for confectionery packaging. The aim was to explore the touch perceptions of textures and identify their relationships with the surfaces' physical properties. Thirty-seven tactile textures were tested including 22 cardboards, nine flexible materials and six laminate boards. Semantic differential questionnaires were administered to assess responses to touching the textures against six word pairs: warm-cold, slippery-sticky, smooth,-rough, hard-soft, bumpy-flat, and wet-dry. Four physical measurements were conducted to characterize the surfaces' roughness, compliance, friction, and the rate of cooling of an artificial finger when touching the surface. Correlation and regression analyses were carried out to identify the relationships between the people's responses and the physical measurements. Results show that touch perception is often associated with more than one physical property, and the strength and form of the combined contribution can be represented by a regression model. © 2009 Chen, Shao, Barnes, Childs, & Henson

Bodily awareness and novel multisensory features

According to the decomposition thesis, perceptual experiences resolve without remainder into their different modality-specific components. Contrary to this view, I argue that certain cases of multisensory integration give rise to experiences representing features of a novel type. Through the coordinated use of bodily awareness—understood here as encompassing both proprioception and kinaesthesis—and the exteroceptive sensory modalities, one becomes perceptually responsive to spatial features whose instances couldn’t be represented by any of the contributing modalities functioning in isolation. I develop an argument for this conclusion focusing on two cases: 3D shape perception in haptic touch and experiencing an object’s egocentric location in crossmodally accessible, environmental space

The effect of indentation force and displacement on visual perception of compliance

This paper investigates the effect of maximum indentation force and depth on people's ability to accurately discriminate compliance using indirect visual information only. Participants took part in two psychophysical experiments in which they were asked to choose the 'softest' sample out of a series of presented sample pairs. In the experiments, participants observed a computer-actuated tip indent the sample pairs to one of two conditions; maximum depth (10mm) or maximum force (4N). This indentation process simulates tool operated palpation in laparoscopic surgery. Results were used to plot psychometric functions as a measure of accuracy of compliance discriminability. A comparison indicated that participants performed best in the task where they judged samples being indented to a pre-set maximum force relying solely on visual cues, which demonstrates the effect of visual information on compliance discrimination. Results also show that indentation cues such as force and deformation depth have different effects on our ability to visually discriminate compliance. These findings will inform future work on designing a haptic feedback system capable of augmenting visual and haptic information independently for optimal compliance discrimination performance

Test bed experiments for various telerobotic system characteristics and configurations

Dexterous manipulation and grasping in telerobotic systems depends on the integration of high-performance sensors, displays, actuators and controls into systems in which careful consideration has been given to human perception and tolerance. Research underway at the Wisconsin Center for Space Automation and Robotics (WCSAR) has the objective of enhancing the performance of these systems and their components, and quantifying the effects of the many electrical, mechanical, control, and human factors that affect their performance. This will lead to a fundamental understanding of performance issues which will in turn allow designers to evaluate sensor, actuator, display, and control technologies with respect to generic measures of dexterous performance. As part of this effort, an experimental test bed was developed which has telerobotic components with exceptionally high fidelity in master/slave operation. A Telerobotic Performance Analysis System has also been developed which allows performance to be determined for various system configurations and electro-mechanical characteristics. Both this performance analysis system and test bed experiments are described

Spatial-Temporal Characteristics of Multisensory Integration

abstract: We experience spatial separation and temporal asynchrony between visual and haptic information in many virtual-reality, augmented-reality, or teleoperation systems. Three studies were conducted to examine the spatial and temporal characteristic of multisensory integration. Participants interacted with virtual springs using both visual and haptic senses, and their perception of stiffness and ability to differentiate stiffness were measured. The results revealed that a constant visual delay increased the perceived stiffness, while a variable visual delay made participants depend more on the haptic sensations in stiffness perception. We also found that participants judged stiffness stiffer when they interact with virtual springs at faster speeds, and interaction speed was positively correlated with stiffness overestimation. In addition, it has been found that participants could learn an association between visual and haptic inputs despite the fact that they were spatially separated, resulting in the improvement of typing performance. These results show the limitations of Maximum-Likelihood Estimation model, suggesting that a Bayesian inference model should be used.Dissertation/ThesisDoctoral Dissertation Human Systems Engineering 201

Wearable Vibrotactile Haptic Device for Stiffness Discrimination during Virtual Interactions

In this paper, we discuss the development of cost effective, wireless, and wearable vibrotactile haptic device for stiffness perception during an interaction with virtual objects. Our experimental setup consists of haptic device with five vibrotactile actuators, virtual reality environment tailored in Unity 3D integrating the Oculus Rift Head Mounted Display (HMD) and the Leap Motion controller. The virtual environment is able to capture touch inputs from users. Interaction forces are then rendered at 500 Hz and fed back to the wearable setup stimulating fingertips with ERM vibrotactile actuators. Amplitude and frequency of vibrations are modulated proportionally to the interaction force to simulate the stiffness of a virtual object. A quantitative and qualitative study is done to compare the discrimination of stiffness on virtual linear spring in three sensory modalities: visual only feedback, tactile only feedback, and their combination. A common psychophysics method called the Two Alternative Forced Choice (2AFC) approach is used for quantitative analysis using Just Noticeable Difference (JND) and Weber Fractions (WF). According to the psychometric experiment result, average Weber fraction values of 0.39 for visual only feedback was improved to 0.25 by adding the tactile feedback

Can Virtual Reality Trainers Improve the Compliance Discrimination Abilities of Trainee Surgeons?

The assessment of tissue compliance using a handheld tool is an important skill in medical areas such as laparoscopic and dental surgery. The increasing prevalence of virtual reality devices raises the question of whether we can exploit these systems to accelerate the training of compliance discrimination in trainee surgeons. We used a haptic feedback device and stylus to assess the abilities of naïve participants to detect compliance differences with and without knowledge of results (KR) (groups 1 and 2), as well as the abilities of participants who had undergone repetitive training over several days (group 3). Kinematic analyses were carried out to objectively measure the probing action. Untrained participants had poor detection thresholds (mean just noticeable difference, JND = 33%), and we found no effect of KR (provided after each trial) on performance (mean JND = 35%). Intensive training dramatically improved group performance (mean JND = 12%). Probing action (in particular, slower movement execution) was associated with better detection thresholds, but training did not lead to systematic changes in probing behaviour. These findings set a benchmark for training systems that act to increase perceptual sensitivity and guide the learner toward optimal movement strategies to improve discrimination

Diagnostic Palpation in Osteopathic Medicine: A Putative Neurocognitive Model of Expertise

This thesis examines the extent to which the development of expertise in diagnostic palpation in osteopathic medicine is associated with changes in cognitive processing. Chapter 2 and Chapter 3 review, respectively, the literature on the role of analytical and non-analytical processing in osteopathic and medical clinical decision making; and the relevant research on the use of vision and haptics and the development of expertise within the context of an osteopathic clinical examination. The two studies reported in Chapter 4 examined the mental representation of knowledge and the role of analogical reasoning in osteopathic clinical decision making. The results reported there demonstrate that the development of expertise in osteopathic medicine is associated with the processes of knowledge encapsulation and script formation. The four studies reported in Chapters 5 and 6 investigate the way in which expert osteopaths use their visual and haptic systems in the diagnosis of somatic dysfunction. The results suggest that ongoing clinical practice enables osteopaths to combine visual and haptic sensory signals in a more efficient manner. Such visuo-haptic sensory integration is likely to be facilitated by top-down processing associated with visual, tactile, and kinaesthetic mental imagery. Taken together, the results of the six studies reported in this thesis indicate that the development of expertise in diagnostic palpation in osteopathic medicine is associated with changes in cognitive processing. Whereas the experts’ diagnostic judgments are heavily influenced by top-down, non-analytical processing; students rely, primarily, on bottom-up sensory processing from vision and haptics. Ongoing training and clinical practice are likely to lead to changes in the clinician’s neurocognitive architecture. This thesis proposes an original model of expertise in diagnostic palpation which has implications for osteopathic education. Students and clinicians should be encouraged to appraise the reliability of different sensory cues in the context of clinical examination, combine sensory data from different channels, and consider using both analytical and nonanalytical reasoning in their decision making. Importantly, they should develop their skills of criticality and their ability to reflect on, and analyse their practice experiences in and on action