Spatiotemporal Convergence of Semantic Processing in Reading and Speech Perception

Retrieval of word meaning from the semantic system and its integration with context are often assumed to be shared by spoken and written words. How is modality-independent semantic processing manifested in the brain, spatially and temporally? Time-sensitive neuroimaging allows tracking of neural activation sequences. Use of semantically related versus unrelated word pairs or sentences ending with a semantically highly or less plausible word, in separate studies of the auditory and visual modality, has associated lexical-semantic analysis with sustained activation at ∼200–800 ms. Magnetoencephalography (MEG) studies have further identified the superior temporal cortex as a main locus of the semantic effect. Nevertheless, a direct comparison of the spatiotemporal neural correlates of visual and auditory word comprehension in the same brain is lacking. We used MEG to compare lexical-semantic analysis in the visual and auditory domain in the same individuals, and contrasted it with phonological analysis that, according to models of language perception, should occur at a different time with respect to semantic analysis in reading and speech perception. The stimuli were lists of four words that were either semantically or phonologically related, or with the final word unrelated to the preceding context. Superior temporal activation reflecting semantic processing occurred similarly in the two modalities, left-lateralized at 300–450 ms and thereafter bilaterally, generated in close-by areas. Effect of phonology preceded the semantic effect in speech perception but not in reading. The present data indicate involvement of the middle superior temporal cortex in semantic processing from ∼300 ms onwards, regardless of input modality.Peer reviewe

Functional Magnetic Resonance Imaging Blood Oxygenation Level-Dependent Signal and Magnetoencephalography Evoked Responses Yield Different Neural Functionality in Reading

It is often implicitly assumed that the neural activation patterns revealed by hemodynamic methods, such as functional magnetic resonance imaging (fMRI), and electrophysiological methods, such as magnetoencephalography (MEG) and electroencephalography (EEG), are comparable. In early sensory processing that seems to be the case, but the assumption may not be correct in high-level cognitive tasks. For example, MEG and fMRI literature of single-word reading suggests differences in cortical activation, but direct comparisons are lacking. Here, while the same human participants performed the same reading task, analysis of MEG evoked responses and fMRI blood oxygenation level-dependent (BOLD) signals revealed marked functional and spatial differences in several cortical areas outside the visual cortex. Divergent patterns of activation were observed in the frontal and temporal cortex, in accordance with previous separate MEG and fMRI studies of reading. Furthermore, opposite stimulus effects in the MEG and fMRI measures were detected in the left occipitotemporal cortex: MEG evoked responses were stronger to letter than symbol strings, whereas the fMRI BOLD signal was stronger to symbol than letter strings. The EEG recorded simultaneously during MEG and fMRI did not indicate neurophysiological differences that could explain the observed functional discrepancies between the MEG and fMRI results. Acknowledgment of the complementary nature of hemodynamic and electrophysiological measures, as reported here in a cognitive task using evoked response analysis in MEG and BOLD signal analysis in fMRI, represents an essential step toward an informed use of multimodal imaging that reaches beyond mere combination of location and timing of neural activationPeer reviewe

Cortical activation during spoken-word segmentation in nonreading-impaired and dyslexic adults

We used magnetoencephalography to elucidate the cortical activation associated with the segmentation of spoken words in nonreading-impaired and dyslexic adults. The subjects listened to binaurally presented sentences where the sentence-ending words were either semantically appropriate or inappropriate to the preceding sentence context. Half of the inappropriate final words shared two or three initial phonemes with the highly expected semantically appropriate words. Two temporally and functionally distinct response patterns were detected in the superior temporal lobe. The first response peaked at ∼100 msec in the supratemporal plane and showed no sensitivity to the semantic appropriateness of the final word. This presemantic N100m response was abnormally strong in the left hemisphere of dyslexic individuals. After the N100m response, the semantically inappropriate sentence-ending words evoked stronger activation than the expected endings in the superior temporal cortex in the vicinity of the auditory cortex. This N400m response was delayed for words starting with the same two or three first few phonemes as the expected words but only until the first evidence of acoustic–phonetic dissimilarity emerged. This subtle delay supports the notion of initial lexical access being based on phonemes or acoustic features. In dyslexic participants, this qualitative aspect of word processing appeared to be normal. However, for all words alike, the ascending slope of the semantic activation in the left hemisphere was delayed by ∼50 msec as compared with control subjects. The delay in the auditory N400m response in dyslexic subjects is likely to result from presemantic–phonological deficits possibly reflected in the abnormal N100m response.Peer reviewe

Corticomuscular Coherence Is Tuned to the Spontaneous Rhythmicity of Speech at 2-3 Hz

Human speech features rhythmicity that frames distinctive, fine-grained speech patterns. Speech can thus be counted among rhythmic motor behaviors that generally manifest characteristic spontaneous rates. However, the critical neural evidence for tuning of articulatory control to a spontaneous rate of speech has not been uncovered. The present study examined the spontaneous rhythmicity in speech production and its relationship to cortex–muscle neurocommunication, which is essential for speech control. Our MEG results show that, during articulation, coherent oscillatory coupling between the mouth sensorimotor cortex and the mouth muscles is strongest at the frequency of spontaneous rhythmicity of speech at 2–3 Hz, which is also the typical rate of word production. Corticomuscular coherence, a measure of efficient cortex–muscle neurocommunication, thus reveals behaviorally relevant oscillatory tuning for spoken language.Peer reviewe

Genome-Wide Linkage Analysis of Human Auditory Cortical Activation Suggests Distinct Loci on Chromosomes 2, 3, and 8

Neural processes are explored through macroscopic neuroimaging and microscopic molecular measures, but the two levels remain primarily detached. The identification of direct links between the levels would facilitate use of imaging signals as probes of genetic function and, vice versa, access to molecular correlates of imaging measures. Neuroimaging patterns have been mapped for a few isolated genes, chosen based on their connection with a clinical disorder. Here we propose an approach that allows an unrestricted discovery of the genetic basis of a neuroimaging phenotype in the normal human brain. The essential components are a subject population that is composed of relatives and selection of a neuroimaging phenotype that is reproducible within an individual and similar between relatives but markedly variable across a population. Our present combined magnetoencephalography and genome-wide linkage study in 212 healthy siblings demonstrates that auditory cortical activation strength is highly heritable and, specifically in the right hemisphere, regulated oligogenically with linkages to chromosomes 2q37, 3p12, and 8q24. The identified regions delimit as candidate genes TRAPPC9, operating in neuronal differentiation, and ROBO1, regulating projections of thalamocortical axons. Identification of normal genetic variation underlying neurophysiological phenotypes offers a non-invasive platform for an in-depth, concerted capitalization of molecular and neuroimaging levels in exploring neural function.Peer reviewe

An MEG Study of Picture Naming

The purpose of this study was to relate a psycholinguistic processing model of picture naming to the dynamics of cortical activation during picture naming. The activation was recorded from eight Dutch subjects with a whole-head neuromagnetometer. The processing model, based on extensive naming latency studies, is a stage model. In preparing a picture's name, the speaker performs a chain of specific operations. They are, in this order, computing the visual percept, activating an appropriate lexical concept, selecting the target word from the mental lexicon, phonological encoding, phonetic encoding, and initiation of articulation. The time windows for each of these operations are reasonably well known and could be related to the peak activity of dipole sources in the individual magnetic response patterns. The analyses showed a clear progression over these time windows from early occipital activation, via parietal and temporal to frontal activation. The major specific findings were that (1) a region in the left posterior temporal lobe, agreeing with the location of Wernicke's area, showed prominent activation starting about 200 msec after picture onset and peaking at about 350 msec, (i.e., within the stage of phonological encoding), and (2) a consistent activation was found in the right parietal cortex, peaking at about 230 msec after picture onset, thus preceding and partly overlapping with the left temporal response. An interpretation in terms of the management of visual attention is proposed.Peer reviewe

Information properties of morphologically complex words modulate brain activity during word reading

Neuroimaging studies of the reading process point to functionally distinct stages in word recognition. Yet, current understanding of the operations linked to those various stages is mainly descriptive in nature. Approaches developed in the field of computational linguistics may offer a more quantitative approach for understanding brain dynamics. Our aim was to evaluate whether a statistical model of morphology, with well-defined computational principles, can capture the neural dynamics of reading, using the concept of surprisal from information theory as the common measure. The Morfessor model, created for unsupervised discovery of morphemes, is based on the minimum description length principle and attempts to find optimal units of representation for complex words. In a word recognition task, we correlated brain responses to word surprisal values derived from Morfessor and from other psycholinguistic variables that have been linked with various levels of linguistic abstraction. The magnetoencephalography data analysis focused on spatially, temporally and functionally distinct components of cortical activation observed in reading tasks. The early occipital and occipito-temporal responses were correlated with parameters relating to visual complexity and orthographic properties, whereas the later bilateral superior temporal activation was correlated with whole-word based and morphological models. The results show that the word processing costs estimated by the statistical Morfessor model are relevant for brain dynamics of reading during late processing stages.Peer reviewe

Long-term phonological learning begins at the level of word form

Incidental learning of phonological structures through repeated exposure is an important component of native and foreign-language vocabulary acquisition that is not well understood at the neurophysiological level. It is also not settled when this type of learning occurs at the level of word forms as opposed to phoneme sequences. Here, participants listened to and repeated back foreign phonological forms (Korean words) and new native-language word forms (Finnish pseudowords) on two days. Recognition performance was improved, repetition latency became shorter and repetition accuracy increased when phonological forms were encountered multiple times. Cortical magnetoencephalography responses occurred bilaterally but the experimental effects only in the left hemisphere. Superior temporal activity at 300–600 ms, probably reflecting acoustic-phonetic processing, lasted longer for foreign phonology than for native phonology. Formation of longer-term auditory-motor representations was evidenced by a decrease of a spatiotemporally separate left temporal response and correlated increase of left frontal activity at 600–1200 ms on both days. The results point to item-level learning of novel whole-word representations

The Dynamics of Sensorimotor Cortical Oscillations during the Observation of Hand Movements: An EEG Study

Background The observation of action done by others determines a desynchronization of the rhythms recorded from cortical central regions. Here, we examined whether the observation of different types of hand movements (target directed, non-target directed, cyclic and non-cyclic) elicits different EEG cortical temporal patterns. Methodology Video-clips of four types of hand movements were shown to right-handed healthy participants. Two were target directed (grasping and pointing) motor acts; two were non-target directed (supinating and clenching) movements. Grasping and supinating were performed once, while pointing and clenching twice (cyclic movements). High-density EEG was recorded and analyzed by means of wavelet transform, subdividing the time course in time bins of 200 ms. The observation of all presented movements produced a desynchronization of alpha and beta rhythms in central and parietal regions. The rhythms desynchronized as soon as the hand movement started, the nadir being reached around 700 ms after movement onset. At the end of the movement, a large power rebound occurred for all bands. Target and non-target directed movements produced an alpha band desynchronization in the central electrodes at the same time, but with a stronger desynchronization and a prolonged rebound for target directed motor acts. Most interestingly, there was a clear correlation between the velocity profile of the observed movements and beta band modulation. Significance Our data show that the observation of motor acts determines a modulation of cortical rhythm analogous to that occurring during motor act execution. In particular, the cortical motor system closely follows the velocity of the observed movements. This finding provides strong evidence for the presence in humans of a mechanism (mirror mechanism) mapping action observation on action execution motor programs

Source analysis of beta-synchronisation and cortico-muscular coherence after movement termination based on high resolution electroencephalography

We hypothesized that post-movement beta synchronization (PMBS) and cortico-muscular coherence (CMC) during movement termination relate to each other and have similar role in sensorimotor integration. We calculated the parameters and estimated the sources of these phenomena.We measured 64-channel EEG simultaneously with surface EMG of the right first dorsal interosseus muscle in 11 healthy volunteers. In Task1, subjects kept a medium-strength contraction continuously; in Task2, superimposed on this movement, they performed repetitive self-paced short contractions. In Task3 short contractions were executed alone. Time-frequency analysis of the EEG and CMC was performed with respect to the offset of brisk movements and averaged in each subject. Sources of PMBS and CMC were also calculated.High beta power in Task1, PMBS in Task2-3, and CMC in Task1-2 could be observed in the same individual frequency bands. While beta synchronization in Task1 and PMBS in Task2-3 appeared bilateral with contralateral predominance, CMC in Task1-2 was strictly a unilateral phenomenon; their main sources did not differ contralateral to the movement in the primary sensorimotor cortex in 7 of 11 subjects in Task1, and in 6 of 9 subjects in Task2. In Task2, CMC and PMBS had the same latency but their amplitudes did not correlate with each other. In Task2, weaker PMBS source was found bilaterally within the secondary sensory cortex, while the second source of CMC was detected in the premotor cortex, contralateral to the movement. In Task3, weaker sources of PMBS could be estimated in bilateral supplementary motor cortex and in the thalamus. PMBS and CMC appear simultaneously at the end of a phasic movement possibly suggesting similar antikinetic effects, but they may be separate processes with different active functions. Whereas PMBS seems to reset the supraspinal sensorimotor network, cortico-muscular coherence may represent the recalibration of cortico-motoneuronal and spinal systems