Semantic radical consistency and character transparency effects in Chinese: an ERP study

BACKGROUND: This event-related potential (ERP) study aims to investigate the representation and temporal dynamics of Chinese orthography-to-semantics mappings by simultaneously manipulating character transparency and semantic radical consistency. Character components, referred to as radicals, make up the building blocks used dur...postprin

Musical training modulates the early but not the late stage of rhythmic syntactic processing

Syntactic processing is essential for musical understanding. Although the processing of harmonic syntax has been well studied, very little is known about the neural mechanisms underlying rhythmic syntactic processing. The present study investigated the neural processing of rhythmic syntax and whether and to what extent long-term musical training impacts such processing. Fourteen musicians and 14 nonmusicians listened to syntactic-regular or -irregular rhythmic sequences and judged the completeness of these sequences. Musicians, as well as nonmusicians, showed a P600 effect to syntactic-irregular endings, indicating that musical exposure and perceptual learning of music are sufficient to enable nonmusicians to process rhythmic syntax at the late stage. However, musicians, but not nonmusicians, also exhibited an ERAN response to syntactic-irregular endings, which suggests that musical training only modulates the early but not the late stage of rhythmic syntactic processing. These findings revealed for the first time the neural mechanisms underlying the processing of rhythmic syntax in music, which has important implications for theories of hierarchically-organized music cognition and comparative studies of syntactic processing in music and language

The Relationship of Somatosensory Perception and Fine-Force Control in the Adult Human Orofacial System

The orofacial area stands apart from other body systems in that it possesses a unique performance anatomy whereby oral musculature inserts directly into the underlying cutaneous skin, allowing for the generation of complex three-dimensional deformations of the orofacial system. This anatomical substrate provides for the tight temporal synchrony between self-generated cutaneous somatosensation and oromotor control during functional behaviors in this region and provides the necessary feedback needed to learn and maintain skilled orofacial behaviors. The Directions into Velocity of Articulators (DIVA) model highlights the importance of the bidirectional relationship between sensation and production in the orofacial region in children learning speech. This relationship has not been as well-established in the adult orofacial system. The purpose of this observational study was to begin assessing the perception-action relationship in healthy adults and to describe how this relationship may be altered as a function of healthy aging. This study was designed to determine the correspondence between orofacial cutaneous perception using vibrotactile detection thresholds (VDT) and low-level static and dynamic force control tasks in three representative age cohorts. Correlational relationships among measures of somatosensory capacity and low-level skilled orofacial force control were determined for 60 adults (19-84 years). Significant correlational relationships were identified using non-parametric Spearman’s correlations with an alpha at 0.1 between the 5 Hz test probe and several 0.5 N low-level force control assessments in the static and slow ramp-and-hold condition. These findings indicate that as vibrotactile detection thresholds increase (labial sensation decreases), ability to maintain a low-level force endpoint decreases. Group data was analyzed using non-parametric Kruskal-Wallis tests and identified significant differences between the 5 Hz test frequency probe and various 0.5 N skilled force assessments for group variables such as age, pure tone hearing assessments, sex, speech usage and smoking history. Future studies will begin the processing of modeling this complex multivariate relationship in healthy individuals before moving to a disordered population

Mechanisms of Vocal Coordination in Zebra Finches

Social animals frequently emit communication calls. Although these calls are often innate in their acoustic structure, they can be used adaptably to coordinate behavior with other individuals. It is not known, however, what each animal needs to learn in order to achieve and maintain synchronized call patterns with others. To study this process, we have developed a vocal robot that can be programed to generate call patterns or to sense a bird\u27s contact (short) calls and respond with precisely timed call answers. By varying the robot\u27s vocal behavior, including call timing and rhythm, we tested how interacting zebra finches adapt to different call patterns produced by a partner robot bird. This approach allows us to assess engagement and the capacity to synchronize calls between females (vocal non-learners) and males (vocal learners) as well as birds with different levels of developmental social experience. We also tested if forebrain structures that are known to be involved in song learning are required for the coordination of calls. We discovered that zebra finches can learn to adjust the timing of their responses to a robot bird partner within minutes. Further, when challenged with complex rhythms containing jamming elements, birds dynamically adjusted the timing of their calls in anticipation of jamming. Blocking the song system cortical output dramatically reduced the precision of birds\u27 response timing and abolished their ability to avoid jamming. Surprisingly, we observed this effect in both males and females, indicating that the female song system is functional rather than vestigial. We then tested if social interactions during development are necessary for birds to acquire the capacity to synchronize and adapt their call timing to those of a partner bird robot. We found that socially isolated birds were extremely imprecise in the timing of their responses. Further, they were unable to avoid disruptive jamming. Interestingly, these results were very similar to those observed after blocking the forebrain song system in socialized birds. We conclude that social interactions during development are necessary for zebra finch males to develop the capacity to precisely adapt the timing of their calls. Further, the capacity to synchronize calls must be acquired independently from that of song learning. Finally, we investigated if, and to what extent, birds can take into account the behavior of a third party while interacting with a partner. Using miniaturized wireless audio transmitters, we found that when two birds are interacting simultaneously with the vocal robot and with each other, they can avoid jamming with each other and with robot by cooperatively changing the latencies of their answer calls. These qualitative results suggest that birds are capable of adjusting the timing of their calls with respect to more than a single partner bird. Together, our results uncover behavioral and physiological mechanisms that give rise to vocal coordination, bridging a functional gap between innate and learned vocalization abilities

How Do Adult Songbirds Learn New Sounds? Using Neuromodulators to Probe the Function of the Auditory Association Cortex

The ability to associate sounds and outcomes is vital in the life history of many species. Animals constantly assess the soundscape for cues associated with threats, competitors, allies, mates or prey, and experience is crucial for those associations. For vocal learning species such as humans and songbirds, learning sounds (i.e. perception and association learning) is also the first step in the process of vocal learning. Auditory learning is thought to depend on high-order cortical brain structures, where sounds and meaning are bound. In songbirds, the caudomedial nidopallium (NCM) is part of the auditory association cortex and is known to be involved in sound learning and perception. During songbird development, NCM plays a role in song learning, but in adulthood, NCM’s role is less clear and a matter of controversy in the literature. Furthermore, NCM is a site of action of neuromodulators including neuroestradiol (E2) and dopamine (DA). E2 is known to be produced by NCM neurons that contain the enzyme aromatase, which converts testosterone into E2. E2 production is also known to increase in the NCM during social interactions, and exogenous E2 modulates neuronal firing, but its effects on auditory behavior have not been pinpointed. Effects of E2 within the mammalian and avian hippocampus had been previously reported to support spatial learning. My main goal in this dissertation was to clarify the role of NCM in adult zebra finches (Taeniopygia guttata). Towards this end, I developed experiments in which I manipulated and thus documented the effects of two neuromodulatory systems, E2 and DA. I first examined the role of E2 in auditory-dependent behavior. For this, I developed a novel operant conditioning task with social reinforcement. Using this task, I showed that inhibiting E2 production within NCM during learning impairs acquisition of auditory associations. However, after the learning process was completed, I found that E2 production and even NCM activity were no longer required for maintaining high auditory performance, suggesting that NCM does not play a role in memory retrieval or auditory discrimination in adults. These findings led me to develop the hypothesis that E2 in NCM modulates online associative learning signals. In mammals, plasticity in virtually all learning-related brain regions is dependent on dopamine (DA) regulation and E2-DA interactions have been reported in several of these regions. Much is known about DA signaling in brain areas involved in decision-making and reinforcement learning. I here review the literature on motor and, especially, sensory cortical regions and provide a comprehensive review of the current knowledge of DA’s roles in cortical regions involved in sensory and motor learning, paying especial attention to non-mammalian vertebrates. I found that this literature is surprisingly limited in mammals, and often non-existent in non-mammalian vertebrates. Then, I hypothesized that E2 could be operating on dopaminergic (DAergic) signaling in NCM, in which D1 receptor (D1R) mRNA had been reported. Since there were no data on the anatomical and functional effects of these receptors, I investigated whether D1R protein could be detected and D1R-mediated signaling modulated synaptic plasticity in NCM. Specifically, I found that D1R protein is prevalent in NCM neurons, especially in aromatase-, GABA-, and parvalbumin-positive neurons. Activating D1R in vitro reduced the amplitude of spontaneous GABAergic and glutamatergic currents and increased the frequency of the latter. Similarly, activating D1R in vivo reduced firing of putative-inhibitory interneurons, but increased firing of putative-excitatory projection neurons. Finally, I showed that D1R activation disrupted stimulus-specific adaptation of NCM neurons, a phenomenon reflective of active auditory memory formation. In conclusion, this dissertation advances the literature by providing direct evidence that E2 production within the auditory cortex affects sensory learning, potentially by tapping into the DAergic system, which itself modulates plasticity mechanisms associated with learning and memory. I propose that these findings could apply to other vertebrates that contain aromatase and DA receptors in their auditory cortex, including humans

From sequences to cognitive structures : neurocomputational mechanisms

Ph. D. Thesis.Understanding how the brain forms representations of structured information distributed in time is a challenging neuroscientific endeavour, necessitating computationally and neurobiologically informed study. Human neuroimaging evidence demonstrates engagement of a fronto-temporal network, including ventrolateral prefrontal cortex (vlPFC), during language comprehension. Corresponding regions are engaged when processing dependencies between word-like items in Artificial Grammar (AG) paradigms. However, the neurocomputations supporting dependency processing and sequential structure-building are poorly understood. This work aimed to clarify these processes in humans, integrating behavioural, electrophysiological and computational evidence. I devised a novel auditory AG task to assess simultaneous learning of dependencies between adjacent and non-adjacent items, incorporating learning aids including prosody, feedback, delineated sequence boundaries, staged pre-exposure, and variable intervening items. Behavioural data obtained in 50 healthy adults revealed strongly bimodal performance despite these cues. Notably, however, reaction times revealed sensitivity to the grammar even in low performers. Behavioural and intracranial electrode data was subsequently obtained in 12 neurosurgical patients performing this task. Despite chance behavioural performance, time- and time-frequency domain electrophysiological analysis revealed selective responsiveness to sequence grammaticality in regions including vlPFC. I developed a novel neurocomputational model (VS-BIND: “Vector-symbolic Sequencing of Binding INstantiating Dependencies”), triangulating evidence to clarify putative mechanisms in the fronto-temporal language network. I then undertook multivariate analyses on the AG task neural data, revealing responses compatible with the presence of ordinal codes in vlPFC, consistent with VS-BIND. I also developed a novel method of causal analysis on multivariate patterns, representational Granger causality, capable of detecting flow of distinct representations within the brain. This alluded to top-down transmission of syntactic predictions during the AG task, from vlPFC to auditory cortex, largely in the opposite direction to stimulus encodings, consistent with predictive coding accounts. It finally suggested roles for the temporoparietal junction and frontal operculum during grammaticality processing, congruent with prior literature. This work provides novel insights into the neurocomputational basis of cognitive structure-building, generating hypotheses for future study, and potentially contributing to AI and translational efforts.Wellcome Trust, European Research Counci

The brain structure during language development: neural correlates of sentence comprehension in preschool children

Language skills increase as the brain matures and language specialization is linked to the left hemisphere. Among distinct language domains, sentence comprehension is particularly vital in language acquisition and, by comparison, requires a much longer time-span before full mastery in children. Although accumulating studies have revealed the neural mechanism underlying sentence comprehension acquisition, the development of the brain’s gray matter and its relation to sentence comprehension had not been fully understood. This thesis employs structural magnetic resonance imaging and diffusion-weighted imaging data to investigate the neural correlates of sentence comprehension in preschoolers both cross-sectionally and longitudinally. The first study examines how cortical thick- ness covariance is relevant for syntax in preschoolers and changes across development. Results suggest that the cortical thickness covariance of brain regions relevant for syntax increases from preschoolers to adults, whilst preschoolers with superior language abilities show a more adult-like covariance pattern. Reconstructing the white matter fiber tract connecting the left inferior frontal and superior temporal cortices using diffusion-weighted imaging data, the second study suggests that the reduced cortical thickness covariance in the left frontotemporal regions is likely due to immature white matter connectivity during preschool. The third study then investigated the cortical thickness asymmetry and its relation to sentence comprehension abilities. Results show that longitudinal cortical thick- ness asymmetry in the inferior frontal cortex was associated with improvements in sentence comprehension, further suggesting the crucial role of the inferior frontal cortex for sentence comprehension acquisition. Taken together, evidence from gray and white matter data provides new insights into the neuroscientific model of language acquisition and the emergence of syntactic processing during language development

Fractals in the Nervous System: conceptual Implications for Theoretical Neuroscience

This essay is presented with two principal objectives in mind: first, to document the prevalence of fractals at all levels of the nervous system, giving credence to the notion of their functional relevance; and second, to draw attention to the as yet still unresolved issues of the detailed relationships among power law scaling, self-similarity, and self-organized criticality. As regards criticality, I will document that it has become a pivotal reference point in Neurodynamics. Furthermore, I will emphasize the not yet fully appreciated significance of allometric control processes. For dynamic fractals, I will assemble reasons for attributing to them the capacity to adapt task execution to contextual changes across a range of scales. The final Section consists of general reflections on the implications of the reviewed data, and identifies what appear to be issues of fundamental importance for future research in the rapidly evolving topic of this review