Modality-specific Affective Responses and their Implications for Affective BCI

Reliable applications of multimodal affective brain-computer interfaces (aBCI) require a detailed understanding of the processes involved in emotions. To explore the modality-specific nature of affective responses, we studied neurophysiological responses of 24 subjects during visual, auditory, and audiovisual affect stimulation and obtained their subjective ratings. Coherent with literature, we found modality-specific responses in the EEG: parietal alpha power decreases during visual stimulation and increases during auditory stimulation, whereas more anterior alpha power decreases during auditory stimulation and increases during visual stimulation. We discuss the implications of these results for multimodal aBCI

Audio-tactile stimuli to improve health and well-being : a preliminary position paper

From literature and through common experience it is known that stimulation of the tactile (touch) sense or auditory (hearing) sense can be used to improve people's health and well-being. For example, to make people relax, feel better, sleep better or feel comforted. In this position paper we propose the concept of combined auditory-tactile stimulation and argue that it potentially has positive effects on human health and well-being through influencing a user's body and mental state. Such effects have, to date, not yet been fully explored in scientific research. The current relevant state of the art is briefly addressed and its limitations are indicated. Based on this, a vision is presented of how auditory-tactile stimulation could be used in healthcare and various other application domains. Three interesting research challenges in this field are identified: 1) identifying relevant mechanisms of human perception of combined auditory-tactile stimuli; 2) finding methods for automatic conversions between audio and tactile content; 3) using measurement and analysis of human bio-signals and behavior to adapt the stimulation in an optimal way to the user. Ideas and possible routes to address these challenges are presented

Mechanisms of synaptic depression at the hair cell ribbon synapse that support auditory nerve function

Inner hair cells (IHCs) in the cochlea are the mammalian phono-receptors, transducing sound energy into graded changes in membrane potentials, the so called “receptor potentials.” Ribbon synapses between IHCs and auditory nerve neurons are responsible for converting receptor potentials into spike rates. The characteristics of auditory nerve responses to sound have been described extensively. For instance, persistent acoustic stimulation produces sensory adaptation, which is revealed as a reduction in neuronal spike rate with time constants in the range of milliseconds to seconds. Since the amplitude of IHC receptor potentials is invariant during this period, the classic hypothesis pointed to vesicle depletion at the IHC as responsible for auditory adaptation. In this study, we observed that fast synaptic depression occurred in responses to stimuli of varying intensities. Nevertheless, release continued after this initial depression, via synaptic vesicles with slower exocytotic kinetics. Heterogeneity in kinetic elements, therefore, favored synaptic responses with an early peak and a sustained phase. The application of cyclothiazide (CTZ) revealed that desensitization of postsynaptic receptors contributed to synaptic depression, which was more pronounced during stronger stimulation. Thus, desensitization had a twofold effect: It abbreviated signaling between IHC and the auditory nerve and also balanced differences in decay kinetics between responses to different stimulation strengths. We therefore propose that both pre- and postsynaptic mechanisms at the IHC ribbon synapse contribute to synaptic depression at the IHC ribbon synapse and spike rate adaptation in the auditory nerve.Fil: Goutman, Juan Diego. Consejo Nacional de Investigaciones Científicas y Técnicas. Instituto de Investigaciones en Ingeniería Genética y Biología Molecular "Dr. Héctor N. Torres"; Argentin

Sensorimotor adaptation to auditory perturbation of speech is facilitated by noninvasive brain stimulation

Repeated exposure to disparity between the motor plan and auditory feedback during speech production results in a proportionate change in the motor system’s response called auditory-motor adaptation. Artificially raising F1 in auditory feedback results in a concomitant decrease in F1 during speech production. Transcranial direct current stimulation (tDCS) can be used to alter neuronal excitability in focal areas of the brain. The present experiment explored the effect of noninvasive brain stimulation applied to the speech premotor cortex on the timing and magnitude of adaptation responses to artificially raised F1 in auditory feedback. Participants (N = 18) completed a speaking task in which they read target words aloud. Participants' speech was processed to raise F1 by 30% and played back to them over headphones in real time. A within-subjects design compared acoustics of participants’ speech while receiving anodal (active) tDCS stimulation versus sham (control) stimulation. Participants' speech showed an increasing magnitude of adaptation of F1 over time during anodal stimulation compared to sham. These results indicate that tDCS can affect behavioral response during auditory-motor adaptation, which may have translational implications for sensorimotor training in speech disorders

Suppressing sensorimotor activity modulates the discrimination of auditory emotions but not speaker identity

Our ability to recognize the emotions of others is a crucial feature of human social cognition. Functional neuroimaging studies indicate that activity in sensorimotor cortices is evoked during the perception of emotion. In the visual domain, right somatosensory cortex activity has been shown to be critical for facial emotion recognition. However, the importance of sensorimotor representations in modalities outside of vision remains unknown. Here we use continuous theta-burst transcranial magnetic stimulation (cTBS) to investigate whether neural activity in the right postcentral gyrus (rPoG) and right lateral premotor cortex (rPM) is involved in nonverbal auditory emotion recognition. Three groups of participants completed same-different tasks on auditory stimuli, discriminating between the emotion expressed and the speakers' identities, before and following cTBS targeted at rPoG, rPM, or the vertex (control site). A task-selective deficit in auditory emotion discrimination was observed. Stimulation to rPoG and rPM resulted in a disruption of participants' abilities to discriminate emotion, but not identity, from vocal signals. These findings suggest that sensorimotor activity may be a modality-independent mechanism which aids emotion discrimination. Copyright © 2010 the authors

A point process framework for modeling electrical stimulation of the auditory nerve

Model-based studies of auditory nerve responses to electrical stimulation can provide insight into the functioning of cochlear implants. Ideally, these studies can identify limitations in sound processing strategies and lead to improved methods for providing sound information to cochlear implant users. To accomplish this, models must accurately describe auditory nerve spiking while avoiding excessive complexity that would preclude large-scale simulations of populations of auditory nerve fibers and obscure insight into the mechanisms that influence neural encoding of sound information. In this spirit, we develop a point process model of the auditory nerve that provides a compact and accurate description of neural responses to electric stimulation. Inspired by the framework of generalized linear models, the proposed model consists of a cascade of linear and nonlinear stages. We show how each of these stages can be associated with biophysical mechanisms and related to models of neuronal dynamics. Moreover, we derive a semi-analytical procedure that uniquely determines each parameter in the model on the basis of fundamental statistics from recordings of single fiber responses to electric stimulation, including threshold, relative spread, jitter, and chronaxie. The model also accounts for refractory and summation effects that influence the responses of auditory nerve fibers to high pulse rate stimulation. Throughout, we compare model predictions to published physiological data and explain differences in auditory nerve responses to high and low pulse rate stimulation. We close by performing an ideal observer analysis of simulated spike trains in response to sinusoidally amplitude modulated stimuli and find that carrier pulse rate does not affect modulation detection thresholds.Comment: 1 title page, 27 manuscript pages, 14 figures, 1 table, 1 appendi

Hearing through your eyes: neural basis of audiovisual cross-activation, revealed by transcranial alternating current stimulation

Some people experience auditory sensations when seeing visual flashes or movements. This prevalent synaesthesia-like ‘visual-evoked auditory response’ (vEAR) could result either from over-exuberant cross-activation between brain areas, and/or reduced inhibition of normally-occurring cross-activation. We have used transcranial alternating current stimulation (tACS) to test these theories. We applied tACS at 10Hz (alpha-band frequency) or 40Hz (gamma-band), bilaterally either to temporal or occipital sites, while measuring same/different discrimination of paired auditory (A) versus visual (V) 'Morse code' sequences. At debriefing, participants were classified as vEAR or non-vEAR depending on whether they reported 'hearing' the silent flashes. In non-vEAR participants, temporal 10Hz tACS caused impairment of A performance, which correlated with improved V; conversely under occipital tACS, poorer V performance correlated with improved A. This reciprocal pattern suggests that sensory cortices are normally mutually inhibitory, and that alpha-frequency tACS may bias the balance of competition between them. vEAR participants showed no tACS effects, consistent with reduced inhibition, or enhanced cooperation between modalities. In addition, temporal 40Hz tACS impaired V performance, specifically in individuals who showed a performance advantage for V (relative to A). Gamma-frequency tACS may therefore modulate the ability of these individuals to benefit from recoding flashes into the auditory modality, possibly by disrupting cross-activation of auditory areas by visual stimulation. Our results support both theories, suggesting that vEAR may depend on disinhibition of normally-occurring sensory cross-activation, which may be expressed more strongly in some individuals. Furthermore, endogenous alpha and gamma-frequency oscillations may function respectively to inhibit or promote this cross-activation

Human Sensation of Transcranial Electric Stimulation.

Noninvasive transcranial electric stimulation is increasingly being used as an advantageous therapy alternative that may activate deep tissues while avoiding drug side-effects. However, not only is there limited evidence for activation of deep tissues by transcranial electric stimulation, its evoked human sensation is understudied and often dismissed as a placebo or secondary effect. By systematically characterizing the human sensation evoked by transcranial alternating-current stimulation, we observed not only stimulus frequency and electrode position dependencies specific for auditory and visual sensation but also a broader presence of somatic sensation ranging from touch and vibration to pain and pressure. We found generally monotonic input-output functions at suprathreshold levels, and often multiple types of sensation occurring simultaneously in response to the same electric stimulation. We further used a recording circuit embedded in a cochlear implant to directly and objectively measure the amount of transcranial electric stimulation reaching the auditory nerve, a deep intercranial target located in the densest bone of the skull. We found an optimal configuration using an ear canal electrode and low-frequency (<300 Hz) sinusoids that delivered maximally ~1% of the transcranial current to the auditory nerve, which was sufficient to produce sound sensation even in deafened ears. Our results suggest that frequency resonance due to neuronal intrinsic electric properties need to be explored for targeted deep brain stimulation and novel brain-computer interfaces

Response of the primary auditory and non-auditory cortices to acoustic stimulation: A manganese-enhanced MRI study

Structural and functional features of various cerebral cortices have been extensively explored in neuroscience research. We used manganese-enhanced MRI, a non-invasive method for examining stimulus-dependent activity in the whole brain, to investigate the activity in the layers of primary cortices and sensory, such as auditory and olfactory, pathways under acoustic stimulation. Male Sprague-Dawley rats, either with or without exposure to auditory stimulation, were scanned before and 24-29 hour after systemic MnCl2 injection. Cortex linearization and layer-dependent signal extraction were subsequently performed for detecting layer-specific cortical activity. We found stimulus-dependent activity in the deep layers of the primary auditory cortex and the auditory pathways. The primary sensory and visual cortices also showed the enhanced activity, whereas the olfactory pathways did not. Further, we performed correlation analysis of the signal intensity ratios among different layers of each cortex, and compared the strength of correlations between with and without the auditory stimulation. In the primary auditory cortex, the correlation strength between left and right hemisphere showed a slight but not significant increase with the acoustic simulation, whereas, in the primary sensory and visual cortex, the correlation coefficients were significantly smaller. These results suggest the possibility that even though the primary auditory, sensory, and visual cortices showed enhanced activity to the auditory stimulation, these cortices had different associations for auditory processing in the brain network.open0