Paraphrasing in respeaking – comparing linguistic competence of interpreters, translators and bilinguals

Respeaking is a method of producing subtitling for live events and TV programmes. Respeakers repeat speakers’ utterances so that they may be changed by speech recognition software into subtitles for the deaf and hard of hearing. Respeakers need to paraphrase the text so that it conforms with temporal and spatial constraints of subtitling. Due to the similarities between respeaking, interpreting and translation, we tested interpreters, translators and bilingual controls on a paraphrasing task to see whether interpreters or translators would manifest any advantage thanks to experience. Following respeaking training, the participants were asked to paraphrase sentences with semantic redundancies, oral discourse markers and false starts in a simultaneous and delayed condition. Contrary to our predictions, we found that experience did not modulate paraphrasing quality or speed in general, but interpreters did outperform other groups when eliminating semantic redundancies, which were also the most difficult reformulations to tackle for all participants. The data suggest that while interpreters and translators are not better predisposed to become respeakers than regular bilinguals, at least as regards the paraphrasing performance, certain aspects of the interpreting experience (the need to express meaning concisely within time constraints) may offer a slight advantage in producing well-formed respoken subtitles

Cognitive load in intralingual and interlingual respeaking-a preliminary study

In this paper we present preliminary results of the study on the cognitive load in intralingual and interlingual respeaking. We tested 57 subjects from three groups: interpreters, translators and controls while respeaking 5-minute videos in two language combinations: Polish to Polish (intralingual) and English to Polish (interlingual). Using two measures of cognitive load: self-report and EEG (Emotiv), we found that in most cases cognitive load was higher in interlingual respeaking. Self-reported mental effort that the participants had to expend to complete the respeaking tasks was lower in the group of interpreters, suggesting some parallels between interpreting and respeaking competences. EEG measures showed significant differences between respeaking tasks and experimental groups in cognitive load over time

Are interpreters better respeakers?

In this study, we examined whether interpreters and interpreting trainees are better predisposed to respeaking than people with no interpreting skills. We tested 57 participants (22 interpreters, 23 translators and 12 controls) while respeaking 5-minute videos with two parameters: speech rate (fast/slow) and number of speakers (one/many). Having measured the quality of the respeaking performance using two independent methods: the NER model and rating, we found that interpreters consistently achieved higher scores than the other two groups. The findings are discussed in the context of transfer of skills, expert performance and respeaking training

Quality is in the eye of the stakeholders: what do professional subtitlers and viewers think about subtitling?

Quality is a rather slippery concept, and its assessment in subtitling can be a challenging task, as its appreciation can easily vary depending on the diferent stakeholders involved in the production and reception of subtitles. In this paper, we evaluate quality indicators in subtitling as perceived by professional subtitlers and viewers. After exploring the various subtitle parameters that can have an impact on the quality of the end product (such as line breaks, synchronisation, display rates), we present the results of two qualitative studies conducted with professional subtitlers and subtitle viewers with diferent audiovisual backgrounds. The results yield some similarities and discrepancies, particularly in the way in which the strategy of condensation is perceived by the two groups, and they also help delineate the subtitle parameters that should be taken into consideration in order to improve the creative process as well as the reception of subtitles

“I don't understand, but it makes me laugh.” Domestication in contemporary Polish dubbing

Despite being (in)famous for its use of voice-over in fiction films, Poland also has a long-standing dubbing tradition. Contemporary Polish dubbing is largely domesticated: culture-bound items from the original are often replaced with elements of Polish culture, which is supposed to increase viewers’ enjoyment of the film. In this study, we examined whether Polish viewers can identify references to Polish culture in the contemporary Polish dubbing of foreign animated films and whether they enjoy them. With this goal in mind, we conducted an online survey and tested 201 participants. Given that many references relate to items from the near or distant past, we predicted that viewers may not fully understand them. The results show that, paradoxically, although viewers do not fully recognise references to Polish culture in contemporary Polish dubbing, they welcome such allusions, declaring that they make films more accessible. The most difficult category of cultural references to identify in our study turned out to be allusions to the canon of Polish literature, whereas the best scores were achieved in the case of references to social campaigns and films. Younger participants had more difficulties in recognising cultural allusions dating from before the 1990s compared to older participants. The vast majority of participants declared they enjoy domestication in contemporary Polish dubbing

The effects of text editing and subtitle presentation rate on the comprehension and reading patterns of interlingual and intralingual subtitles among deaf, hard of hearing and hearing viewers

In this paper we examine the influence of text editing (edited vs. verbatim subtitles) and subtitle presentation rates (12 vs. 15 characters per second) on the comprehension and reading patterns of interlingual and intralingual subtitles among a group of 44 deaf, 33 hard of hearing and 60 hearing Polish adult subjects. The results of the eyetracking study show no benefit of editing down the text of subtitles, particularly in the case of intralingual subtitling and deaf viewers. Verbatim subtitles displayed with the higher presentation rate yielded slightly better comprehension results, were skipped less often, and resulted in more effective reading patterns. Deaf and hard of hearing participants had lower comprehension than hearing people; they also had a higher number of fixations per subtitle and were found to dwell on subtitles longer than the hearing

Ear–voice span and pauses in intra- and interlingual respeaking: An exploratory study into temporal aspects of the respeaking process

Respeaking involves producing subtitles in real time to make live television programs accessible to deaf and hard of hearing viewers. In this study we investigated how the type of material to be respoken affects temporal aspects of respeaking, such as ear–voice span and pauses. Given the similarities between respeaking and interpreting (time constraints) and between interlingual respeaking and translation (interlingual processing), we also tested whether previous interpreting and translation experience leads to a smaller delay or lesser cognitive load in respeaking, as manifested by a smaller number of pauses. We tested 22 interpreters, 23 translators, and a control group of 12 bilingual controls, who performed interlingual (English to Polish) and intralingual (Polish to Polish) respeaking of five video clips with different characteristics (speech rate, number of speakers, and scriptedness). Interlingual respeaking was found to be more challenging than the intralingual one. The temporal aspects of respeaking were affected by clip type (especially in interpreters). We found no clear interpreter or translator advantage over the bilingual controls across the respeaking tasks. However, interlingual respeaking turned out to be too difficult for many bilinguals to perform at all. To the best of our knowledge, this is the first study to examine temporal aspects of respeaking as modulated by the type of materials and previous interpreting/translation experience. The results develop our understanding of temporal aspects of respeaking and are directly applicable to respeaker training

Viewers can keep up with fast subtitles: Evidence from eye movements

People watch subtitled audiovisual materials more than ever before. With the proliferation of subtitled content, we are also witnessing an increase in subtitle speeds. However, there is an ongoing controversy about what optimum subtitle speeds should be. This study looks into whether viewers can keep up with increasingly fast subtitles and whether the way people cope with subtitled content depends on their familiarity with subtitling and on their knowledge of the language of the film soundtrack. We tested 74 English, Polish and Spanish viewers watching films subtitled at different speeds (12, 16 and 20 characters per second). The films were either in Hungarian, a language unknown to the participants (Experiment 1), or in English (Experiment 2). We measured viewers’ comprehension, self-reported cognitive load, scene and subtitle recognition, preferences and enjoyment. By analyzing people’s eye gaze, we were able to discover that most viewers could read the subtitles as well as follow the images, coping well even with fast subtitle speeds. Slow subtitles triggered more re-reading, particularly in English clips, causing more frustration and less enjoyment. Faster subtitles with unreduced text were preferred in the case of English videos, and slower subtitles with text edited down in Hungarian videos. The results provide empirical grounds for revisiting current subtitling practices to enable more efficient processing of subtitled videos for viewers

Respeaking crisis points. An exploratory study into critical moments in the respeaking process

In this paper we introduce respeaking crisis points (RCPs), understood as potentially problematic moments in the respeaking process, resulting from the difficulty of the source material and/or cognitive overload on the part of the respeakers. We present results of the respeaking study on Polish participants who respoke four videos intralingually (Polish to Polish) and one interlingually (from English to Polish). We measured the participants’ cognitive load with EEG (Emotiv) using two measures: concentration and frustration. By analysing peaks in both EEG measures, we show where respeaking crisis points occurred. Features that triggered RCPs include very slow and very fast speech rate, visual complexity of the material, overlapping speech, numbers and proper names, speaker changes, word play, syntactic complexity, and implied meaning. The results of this study are directly applicable to respeaker training and provide valuable insights into the respeaking process from the cognitive perspective

Functional and Biogenetical Heterogeneity of the Inner Membrane of Rat-Liver Mitochondria

Rat liver mitochondria were fragmented by a combined technique of swelling, shrinking, and sonication. Fragments of inner membrane were separated by density gradient centrifugation. They differed in several respects: electronmicroscopic appearance, phospholipid and cytochrome contents, electrophoretic behaviour of proteins and enzymatic activities. Three types of inner membrane fractions were isolated. The first type is characterized by a high activity of metal chelatase, low activities of succinate-cytochrome c reductase and of glycerolphosphate dehydrogenase, as well as by a high phospholipid content and low contents of cytochromes aa3 and b. The second type displays maximal activities of glycerolphosphate dehydrogenase and metal chelatase, but contains relatively little cytochromes and has low succinate-cytochrome c reductase activity. The third type exhibits highest succinate-cytochrome c reductase activity, a high metal chelatase activity and highest cytochrome contents. However, this fraction was low in both glycerolphosphate dehydrogenase activity and phospholipid content. This fraction was also richest in the following enzyme activities: cytochrome oxidase, oligomycin-sensitive ATPase, proline oxidase, 3-hydroxybutyrate dehydrogenase and rotenone-sensitive NADH-cytochrome c reductase. Amino acid incorporation in vitro and in vivo in the presence of cycloheximide occurs predominantly into inner membrane fractions from the second type. These data suggest that the inner membrane is composed of differently organized parts, and that polypeptides synthesized by mitochondrial ribosomes are integrated into specific parts of the inner membrane