Behavioral and neuroimaging research of reading: A case of Japanese

Behavioral studies showed that AS, an English-Japanese bilingual was a skilled reader in Japanese but was a phonological dyslexic in English. This behavioral dissociation was accounted for by the Hypothesis of Transparency and Granularity postulated by Wydell & Butterworth. However, a neuroimaging study using MEG (magnetoencephalography) revealed that AS has the same functional deficit in the left superior temporal gyrus (STG). This paper therefore offers an answer to this intriguing discrepancy between the behavioral dissociation and the neural unity in AS by reviewing existing behavioral and neuroimaging studies in alphabetic languages such as English, Finnish, French, and Italian, and nonalphabetic languages such as Japanese and Chinese

Are phonological skills as crucial for literacy acquisition in Japanese as in English as well as in accounting for developmental dyslexia in English and in Japanese?

Part of a special Issue on dyslexia and cultureCopyright © The Author(s) 2023. Extensive research has shown that phonological awareness including phoneme awareness skills are vital when children acquire literacy skills in alphabetic languages especially in English. Furthermore, research on developmental dyslexia (DD) especially in English has been conducted with research-informed/well-established definitions of DD. This is because compared to other languages, the prevalence of DD in English is high, and thus children with DD form a large minority group. These dyslexia research encompasses cognitive-behavioural, neuroimaging, behavioural and molecular-genetic studies. There seems to be a consensus amongst these researchers that DD manifests itself as a phonological deficit, and thus the phonological deficit hypothesis (as well as naming disfluency) for DD has become prominent in the alphabetic languages, especially in English. This is because print-to-sound or sound-to-print mappings in English are not always one-to-one and thus opaque/inconsistent. Now important questions arise in discussing how children acquire reading skills in non-alphabetic languages especially in Japanese where logographic Kanji and 2-forms of syllabic Kana are used: (i) are phonological awareness skills vital when children learn to read in Japanese? (ii) can the phonological deficit hypothesis explain DD in Japanese? These questions will be addressed in this paper by comparing the behavioural and some neuroimaging studies in alphabetic languages and Japanese Kanji and Kana as well as Chinese, another non-alphabetic languag. It seems that phonological awareness may not be as important for non-alphabetic languages such as Chinese or Japanese at the start of literacy acquisition. Phonological awareness become important skills in Chinese and Japanese only when children are older. Instead of phonological awareness other metalinguistic awareness skills are important for acquisition of reading in Chinese and Japanese such as orthographic or morphological awareness (Chinese), vocabulary size (Japanese), visuo-spatial processing (Chinese and Japanese) and visual-motor integration (Chinese and Japanese) skills. Also available neuroimaging studies will be used to uncover the behavioural dissociation and the neural unity in an English-Japanese bilingual adolescent boy with monolingual dyslexia in English

Neural Correlates of Letter-String Length and Lexicality during Reading in a Regular Orthography

Behavioral studies have shown that short letter strings are read faster than long letter-strings and words are read faster than nonwords. Here, we describe the dynamics of letter-string length and lexicality effects at the cortical level, using magnetoencephalography, during a reading task in Finnish with long (eight-letter) and short (four-letter) word/nonword stimuli. Length effects were observed in two spatially and temporally distinct cortical activations: (1) in the occipital cortex at about 100 msec by the strength of activation, regardless of the lexical status of the stimuli, and (2) in the left superior temporal cortex between 200 and 600 msec by the duration of activation, with words showing a smaller effect than nonwords. A significant lexicality effect was also evident in this later activation, with stronger activation and longer duration for nonwords than words. There seem to be no distinct cortical areas for reading words and nonwords. The early length effect is likely to be due to the low-level visual analysis common to all stimulus letter-strings. The later lexicality and length effects apparently reflect converging lexico-semantic and phonological influences, and are discussed in terms of dual-route and single-route connectionist models of reading.Peer reviewe

Similar representations of emotions across faces and voices

Emotions are a vital component of social communication, carried across a range of modalities and via different perceptual signals such as specific muscle contractions in the face and in the upper respiratory system. Previous studies have found that emotion recognition impairments after brain damage depend on the modality of presentation: recognition from faces may be impaired whilst recognition from voices remains preserved, and vice versa. On the other hand, there is also evidence for shared neural activation during emotion processing in both modalities. In a behavioural study, we investigated whether there are shared representations in the recognition of emotions from faces and voices. We used a within-subjects design in which participants rated the intensity of facial expressions and non-verbal vocalisations for each of the six basic emotion labels. For each participant and each modality, we then computed a representation matrix with the intensity ratings of each emotion. These matrices allowed us to examine the patterns of confusions between emotions and to characterise the representations of emotions within each modality. We then compared the representations across modalities by computing the correlations of the representation matrices across faces and voices. We found highly correlated matrices across modalities, which suggest similar representations of emotions across faces and voices. We also showed that these results could not be explained by commonalities between low-level visual and acoustic properties of the stimuli. We thus propose that there are similar or shared coding mechanisms for emotions which may act independently of modality, despite their distinct perceptual inputs.This research was supported by an ESRC 1+3 PhD studentship to Lisa Kuhn (ES/I90042X/1)

A Reading Model from the Perspective of Japanese Orthography: Connectionist Approach to the Hypothesis of Granularity and Transparency

This study presents a computer simulation model of reading in Japanese syllabic Kana and morphographic Kanji. The model was based on the simulation model developed by Harm and Seidenberg (1999) for reading in English. The purpose of building the current model was to verify the validity of the Hypothesis of Granularity and Transparency (HGT) postulated by Wydell and Butterworth (1999), focusing on the granularity dimension. The HGT was developed in order to explain the behavioral dissociation between excellent reading skills in Japanese and poor reading skills in English of an English-Japanese bilingual individual as well as the relatively low incidence of developmental dyslexia in Japan. The current model was successful in simulating the granularity dimension of the HGT. The study also identified several limitations, which need to be addressed in future research.This work was supported by the JSPS-Kakenhi, Grant No. 19530672, where Mutsuo Ijuin was the PI, while Taeko N. Wydell was one of the CIs

Plasticity in second language (L2) learning : perception of L2 phonemes by native Greek speakers of English

Understanding the process of language acquisition is a challenge that many researchers spanning different disciplines (e.g. linguistics, psychology, neuroscience) have grappled with for centuries. One which has in recent years attracted a lot of attention has been in the area of non-native phoneme acquisition. Speech sounds that contain multiple phonetic cues are often difficult for foreign-language learners, especially if certain cues are weighted differently in the foreign and native languages. Greek adult and child speakers of English were studied to determine which cues (duration or spectral) they were using to make discrimination and identification judgments for an English vowel contrast pair. To this end, two forms of identification and discrimination tasks were used: natural (unedited) stimuli and another ‘modified’ vowel duration stimuli which were edited so that there were no duration differences between the vowels. Results show the Greek speakers were particularly impaired when they were unable to use the duration cue as compared to the native English speakers. Similar results were also obtained in control experiments where there was no orthographic representation or where the stimuli were cross-spliced to modify the phonetic neighborhood. Further experiments used high-variability training sessions to enhance vowel perception. Following training, performance improved for both Greek adult and child groups as revealed by post training tests. However the improvements were most pronounced for the child Greek speaker group. A further study examined the effect of different orthographic cues that might affect rhyme and homophony judgment. The results of that study showed that Greek speakers were in general more affected by orthography and regularity (particularly of the vowel) in making these judgments. This would suggest that Greek speakers were more sensitive to irrelevant orthographic cues, mirroring the results in the auditory modality where they focused on irrelevant acoustic cues. The results are discussed in terms of current theories of language acquisition, with particular reference to acquisition of non-native phonemes.EThOS - Electronic Theses Online ServiceSchool of Social Sciences, Brunel UniversityGBUnited Kingdo

Cognitive processes and neural correlates of reading in languages with graded levels of orthographic transparency : Spanish, English and Hebrew

This thesis examined the cognitive processes and neural correlates involved in reading Spanish (a transparent orthography), English (an intermediate orthography) and Hebrew (an opaque orthography) by bilinguals and trilinguals. The main objectives of the five experiments were to: (i) extend previous findings which demonstrated that orthographic transparency influences the degree of reliance on lexical and sublexical processing, and (ii) assess the effects of orthographic transparency and language proficiency on strategies employed for reading in a second and third language. Word/non-word naming tasks undertaken by Spanish-English bilinguals, Hebrew-English bilinguals and English monolinguals, where frequency, length and lexicality were manipulated, showed a predominant reliance on sublexical processing in Spanish, lexical processing in Hebrew, and a balanced interplay in English. Effects of language proficiency were also observed as slower naming and lower accuracy in English as a second language. Concurrently, while showing an efficient adaptation of reading strategy to the level of orthographic transparency of English, Hebrew bilinguals appeared to show stronger reliance on sublexical processing than Spanish bilinguals, suggesting a compensatory mechanism. fMRI experiments showed that reading in all languages was associated with a common network of predominantly left-lateralised cerebral regions. Reading in each language was associated with some preferential activation within regions implicated in lexical and sublexical processing, in keeping with their graded levels of orthographic transparency. Effects of language proficiency were demonstrated as increased activation within medial frontal regions implicated in attentional processes as well as right-lateralised homologous language-processing regions. Furthermore, the patterns of activation seen in Hebrew readers in English strengthened the notion of a compensatory mechanism. Finally, a trilingual experiment replicated findings observed in bilinguals, revealed the acute complexity of reading in Hebrew as an additional language and further strengthened the concept of a compensatory mechanism in English and Spanish. The present findings further contribute to current knowledge on teaching methods, diagnostic tools and therapeutic strategies for developmental and acquired reading disorders.EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Cognitive processes and neural correlates of reading in languages with graded levels of orthographic transparency : Spanish, English and Hebrew

This thesis examined the cognitive processes and neural correlates involved in reading Spanish (a transparent orthography), English (an intermediate orthography) and Hebrew (an opaque orthography) by bilinguals and trilinguals. The main objectives of the five experiments were to: (i) extend previous findings which demonstrated that orthographic transparency influences the degree of reliance on lexical and sublexical processing, and (ii) assess the effects of orthographic transparency and language proficiency on strategies employed for reading in a second and third language. Word/non-word naming tasks undertaken by Spanish-English bilinguals, Hebrew-English bilinguals and English monolinguals, where frequency, length and lexicality were manipulated, showed a predominant reliance on sublexical processing in Spanish, lexical processing in Hebrew, and a balanced interplay in English. Effects of language proficiency were also observed as slower naming and lower accuracy in English as a second language. Concurrently, while showing an efficient adaptation of reading strategy to the level of orthographic transparency of English, Hebrew bilinguals appeared to show stronger reliance on sublexical processing than Spanish bilinguals, suggesting a compensatory mechanism. fMRI experiments showed that reading in all languages was associated with a common network of predominantly left-lateralised cerebral regions. Reading in each language was associated with some preferential activation within regions implicated in lexical and sublexical processing, in keeping with their graded levels of orthographic transparency. Effects of language proficiency were demonstrated as increased activation within medial frontal regions implicated in attentional processes as well as right-lateralised homologous language-processing regions. Furthermore, the patterns of activation seen in Hebrew readers in English strengthened the notion of a compensatory mechanism. Finally, a trilingual experiment replicated findings observed in bilinguals, revealed the acute complexity of reading in Hebrew as an additional language and further strengthened the concept of a compensatory mechanism in English and Spanish. The present findings further contribute to current knowledge on teaching methods, diagnostic tools and therapeutic strategies for developmental and acquired reading disorders.EThOS - Electronic Theses Online ServiceGBUnited Kingdo