Tactile modulation of emotional speech samples

Copyright © 2012 Katri Salminen et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly citedTraditionally only speech communicates emotions via mobile phone. However, in daily communication the sense of touch mediates emotional information during conversation. The present aim was to study if tactile stimulation affects emotional ratings of speech when measured with scales of pleasantness, arousal, approachability, and dominance. In the Experiment 1 participants rated speech-only and speech-tactile stimuli. The tactile signal mimicked the amplitude changes of the speech. In the Experiment 2 the aim was to study whether the way the tactile signal was produced affected the ratings. The tactile signal either mimicked the amplitude changes of the speech sample in question, or the amplitude changes of another speech sample. Also, concurrent static vibration was included. The results showed that the speech-tactile stimuli were rated as more arousing and dominant than the speech-only stimuli. The speech-only stimuli were rated as more approachable than the speech-tactile stimuli, but only in the Experiment 1. Variations in tactile stimulation also affected the ratings. When the tactile stimulation was static vibration the speech-tactile stimuli were rated as more arousing than when the concurrent tactile stimulation was mimicking speech samples. The results suggest that tactile stimulation offers new ways of modulating and enriching the interpretation of speech.Peer reviewe

Multi-Moji: Combining Thermal, Vibrotactile and Visual Stimuli to Expand the Affective Range of Feedback

This paper explores the combination of multiple concurrent modalities for conveying emotional information in HCI: temperature, vibration and abstract visual displays. Each modality has been studied individually, but can only convey a limited range of emotions within two-dimensional valencearousal space. This paper is the first to systematically combine multiple modalities to expand the available affective range. Three studies were conducted: Study 1 measured the emotionality of vibrotactile feedback by itself; Study 2 measured the perceived emotional content of three bimodal combinations: vibrotactile + thermal, vibrotactile + visual and visual + thermal. Study 3 then combined all three modalities. Results show that combining modalities increases the available range of emotional states, particularly in the problematic top-right and bottom-left quadrants of the dimensional model. We also provide a novel lookup resource for designers to identify stimuli to convey a range of emotions

Use of the STAR PROCESS for Children with Sensory Processing Challenges

Background: This study examined the effectiveness of the STAR PROCESS, an intensive, short-term intervention that combines principles of sensory integration, relationship-based therapy, and parental-therapist collaboration for children with sensory processing challenges. Method: A nonconcurrent multiple baseline, repeated measures design was used. Four boys, aged 5 years 0 months to 7 years 9 months, participated in this study. The mean length of intervention was 22 sessions delivered 3 to 5 times per week. A behavioral coding system was used to measure change in four areas: play level, positive affect, joint attention, and novel use of equipment. The theory of change reflects the use of multisensory experiences in combination with parent participation to impact outcomes. Results: Improvement was noted in play level in all of the participants. Multisensory experiences and parent participation were associated with these changes in two participants. Discussion: The study results suggest a feasible methodology to study occupational therapy interventions. The behavioral coding system was sensitive to change. Play abilities changed in all four children. Preliminary support was provided for the theory of change combining multisensory experiences with parent participation. Conclusion: A targeted treatment approach that emphasizes parents as play partners in a multisensory environment shows promise in remediating these deficits

CHARACTERIZING SENSORY PROCESSING IN AUTISM SPECTRUM DISORDERS

Rationale: Autism is a neurodevelopmental disorder with onset prior to the age of three years characterized by qualitative impairments in social interaction and communication skill, along with a restricted repetitive and stereotyped pattern of behavior, interests, and activities. In addition to these core diagnostic features, aberrant sensory responding has also been widely reported in the literature describing children and adolescents with autism spectrum disorders (ASD). Aberrant sensory processing has, however, been infrequently studied compared to communication and cognition in autism and existing studies have had multiple methodological deficiencies, especially with sampling procedures. Purpose. The purpose of this study is to describe patterns of sensory processing found in children with an ASD to test the relationship(s) of these patterns to diagnostic and developmental variables. Method. Retrospective data collection was used to collect developmental and sensory processing variables of 400 children with an ASD. Sensory processing abilities were measured by the SSP. Results. The majority of the sample (80.5%) had a diagnosis of autism. The average age of the sample was 49.58 months. The adaptive, social, language, and motor developmental variables were consistent with diagnostic patterns in that the children with Asperger Disorder demonstrated higher developmental levels than the children with autism and PDD-NOS. Eighty-nine percent of the sample demonstrated some degree of sensory processing dysfunction on the SSP Total Score with the greatest difficulties reported on the Underresponsive/Seeks Sensation, Auditory Filtering, and Tactile Sensitivity sections. Exploratory factor analysis identified 6 parsimonious factors: Low Energy/Weak, Tactile and Movement Sensitivity, Taste/Smell Sensitivity, Auditory and Visual Sensitivity, Sensory Seeking/Distractibility, and Hypo-responsivity. These factor variables contributed to explaining the differences in five of six developmental variables of the sample that are associated with the diagnosis of autism. Receptive language, adaptive and expressive language performance were significantly correlated with sensory processing factor scores. Conclusions. Together, the sensory processing findings noted in this study describe a pattern of dysfunctional sensory modulation. These findings have significant implications for intervention programs involving individuals with an ASD, given the potential impact of these findings on a childs ability to maintain active engagement

Auditory Discrimination and Auditory Sensory Behaviours in Autism Spectrum Disorders

It has been hypothesised that auditory processing may be enhanced in autism spectrum disorders (ASD). We tested auditory discrimination ability in 72 adolescents with ASD (39 childhood autism; 33 other ASD) and 57 IQ and age-matched controls, assessing their capacity for successful discrimination of the frequency, intensity and duration differences in pairs of sounds.At the group level, auditory discrimination ability did not differ between the adolescents with and without ASD. However, we found a subgroup of 20% of individuals in the ASD group who showed ‘exceptional’ frequency discrimination skills (defined as 1.65 SDs above the control mean) and who were characterised by average intellectual ability and delayed language onset. Auditory sensory behaviours (i.e. behaviours in response to auditory sensory input) are common in ASD and we hypothesised that these would relate to auditory discrimination ability. For the ASD group, poor performers on the intensity discrimination task reported more auditory sensory behaviours associated with coping with loudness levels. Conversely, those who performed well on the duration discrimination task reported more auditory sensory behaviours across the full range measured. Frequency discrimination ability did not associate with auditory sensory behaviours. We therefore conclude that (i) enhanced frequency discrimination is present in around 1 in 5 individuals with ASD and may represent a specific phenotype; and (ii) individual differences in auditory discrimination ability in ASD may influence the expression of auditory sensory behaviours by modulating the degree to which sounds are detected or missed in the environment

Intranasal insulin to improve developmental delay in children with 22q13 deletion syndrome: an exploratory clinical trial

Background: The 22q13 deletion syndrome (Phelan– McDermid syndrome) is characterised by a global developmental delay, absent or delayed speech, generalised hypotonia, autistic behaviour and characteristic phenotypic features. Intranasal insulin has been shown to improve declarative memory in healthy adult subjects and in patients with Alzheimer disease. Aims: To assess if intranasal insulin is also able to improve the developmental delay in children with 22q13 deletion syndrome. Methods: We performed exploratory clinical trials in six children with 22q13 deletion syndrome who received intranasal insulin over a period of 1 year. Short-term (during the first 6 weeks) and long-term effects (after 12 months of treatment) on motor skills, cognitive functions, or autonomous functions, speech and communication, emotional state, social behaviour, behavioural disorders, independence in daily living and education were assessed. Results: The children showed marked short-term improvements in gross and fine motor activities, cognitive functions and educational level. Positive long-term effects were found for fine and gross motor activities, nonverbal communication, cognitive functions and autonomy. Possible side effects were found in one patient who displayed changes in balance, extreme sensitivity to touch and general loss of interest. One patient complained of intermittent nose bleeding. Conclusions: We conclude that long-term administration of intranasal insulin may benefit motor development, cognitive functions and spontaneous activity in children with 22q13 deletion syndrome

Somatosensory processing in neurodevelopmental disorders

The purpose of this article is to review the role of somatosensory perception in typical development, its aberration in a range of neurodevelopmental disorders, and the potential relations between tactile processing abnormalities and central features of each disorder such as motor, communication, and social development. Neurodevelopmental disorders that represent a range of symptoms and etiologies, and for which multiple peer-reviewed articles on somatosensory differences have been published, were chosen to include in the review. Relevant studies in animal models, as well as conditions of early sensory deprivation, are also included. Somatosensory processing plays an important, yet often overlooked, role in typical development and is aberrant in various neurodevelopmental disorders. This is demonstrated in studies of behavior, sensory thresholds, neuroanatomy, and neurophysiology in samples of children with Fragile X syndrome, autism spectrum disorders (ASD), attention deficit hyperactivity disorder (ADHD), and cerebral palsy (CP). Impaired somatosensory processing is found in a range of neurodevelopmental disorders and is associated with deficits in communication, motor ability, and social skills in these disorders. Given the central role of touch in early development, both experimental and clinical approaches should take into consideration the role of somatosensory processing in the etiology and treatment of neurodevelopmental disorders

A psychophysiological investigation of laterality in human emotion elicited by pleasant and unpleasant film clips

<p>Abstract</p> <p>Background</p> <p>Research on laterality in emotion suggests a dichotomy between the brain hemispheres. The present study aimed to investigate this further using a modulated startle reflex paradigm.</p> <p>Methods</p> <p>We examined the effects of left and the right ear stimulation on the modulated startle reflex (as indexed by eyeblink magnitude, measured from the right eye) employing short (2 min) film clips to elicit emotions in 16 right-handed healthy participants. The experiment consisted of two consecutive sessions on a single occasion. The acoustic startle probes were presented monaurally to one of the ears in each session, counterbalanced across order, during the viewing of film clips.</p> <p>Results</p> <p>The findings showed that eyeblink amplitude in relation to acoustic startle probes varied linearly, as expected, from pleasant through neutral to unpleasant film clips, but there was no interaction between monaural probe side and foreground valence.</p> <p>Conclusions</p> <p>Our data indicate the involvement of both hemispheres when affective states, and associated startle modulations, are produced, using materials with both audio and visual properties. From a methodological viewpoint, the robustness of film clip material including audio properties might compensate for the insufficient information reaching the ipsilateral hemisphere when using static pictures. From a theoretical viewpoint, a right ear advantage for verbal processing may account for the failure to detect the expected hemispheric difference. The verbal component of the clips would have activated the left hemisphere, possibly resulting in an increased role for the left hemisphere in both positive and negative affect generation.</p