What can co-speech gestures in aphasia tell us about the relationship between language and gesture?: A single case study of a participant with Conduction Aphasia

Cross-linguistic evidence suggests that language typology influences how people gesture when using ‘manner-of-motion’ verbs (Kita 2000; Kita & Özyürek 2003) and that this is due to ‘online’ lexical and syntactic choices made at the time of speaking (Kita, Özyürek, Allen, Brown, Furman & Ishizuka, 2007). This paper attempts to relate these findings to the co-speech iconic gesture used by an English speaker with conduction aphasia (LT) and five controls describing a Sylvester and Tweety1 cartoon. LT produced co-speech gesture which showed distinct patterns which we relate to different aspects of her language impairment, and the lexical and syntactic choices she made during her narrative

Gesture and speech integration: an exploratory study of a man with aphasia

Background: In order to fully comprehend a speaker’s intention in everyday communication, we integrate information from multiple sources including gesture and speech. There are no published studies that have explored the impact of aphasia on iconic co-speech gesture and speech integration. Aims: To explore the impact of aphasia on co-speech gesture and speech integration in one participant with aphasia (SR) and 20 age-matched control participants. Methods & Procedures: SR and 20 control participants watched video vignettes of people producing 21 verb phrases in 3 different conditions, verbal only (V), gesture only (G) and verbal gesture combined (VG). Participants were required to select a corresponding picture from one of four alternatives: integration target, a verbal only match, a gesture only match, and an unrelated foil. The probability of choosing the integration target in the VG that goes beyond what is expected from the probabilities of choosing the integration target in V and G was referred to as multi-modal gain(MMG). Outcomes & Results: SR obtained a significantly lower multi-modal gain score than the control participants (p<0.05). Error analysis indicated that in speech and gesture integration tasks, SR relied on gesture in order to decode the message, whereas the control participants relied on speech in order to decode the message. Further analysis of the speech only and gesture only tasks indicated SR had intact gesture comprehension but impaired spoken word comprehension. Conclusions & Implications: The results confirm findings by Records (1994) which reported that impaired verbal comprehension leads to a greater reliance on gesture to decode messages. Moreover, multi-modal integration of information from speech and iconic gesture can be impaired in aphasia. The findings highlight the need for further exploration of the impact of aphasia on gesture and speech integration

Iconic gesture and speech integration in younger and older adults

This study investigated the impact of age on iconic gesture and speech integration. The performance of a group of older adults (60–76 years) and a group of younger adults (22–30 years) were compared on a task which required the comprehension of information presented in 3 different conditions: verbal only, gesture only, and verbal and gesture combined. The older adults in the study did not benefit as much from multi-modal input as the younger adults and were more likely to ignore gesture when decoding the multi-modal information

“TOT” phenomena: Gesture production in younger and older adults

This study explored age-related changes in gesture in order to better understand the relationship between gesture and word retrieval from memory. The frequency of gestures during “Tip-of-the-Tongue” (TOT) states highlights this relationship. There is a lack of evidence describing the form and content of iconic gestures arising spontaneously in such TOT states, and a parallel gap addressing age-related variations. In this study, TOT states were induced in 45 participants from two age groups (older and younger adults) using a pseudoword paradigm. The type and frequency of gestures produced was recorded during two experimental conditions (single-word retrieval/ narrative task). We found that both groups experienced a high number of TOT states, during which they gestured. Iconic co-TOT gestures were more common than non-iconic gestures. Whilst there was no age-effect on the type of gestures produced, there was a significant, task-specific, age difference in the amount of gesturing. That is, younger adults gestured more in the narrative task, whereas older adults generated more gestures on the single-word retrieval task. Task-specific age differences suggest that there are age-related differences in terms of the cognitive operations involved in TOT gesture production

Accessibility of 3D Game Environments for People with Aphasia: An Exploratory Study

People with aphasia experience difficulties with all aspects of language and this can mean that their access to technology is substantially reduced. We report a study undertaken to investigate the issues that confront people with aphasia when interacting with technology, specifically 3D game environments. Five people with aphasia were observed and interviewed in twelve workshop sessions. We report the key themes that emerged from the study, such as the importance of direct mappings between users’ interactions and actions in a virtual environment. The results of the study provide some insight into the challenges, but also the opportunities, these mainstream technologies offer to people with aphasia. We discuss how these technologies could be more supportive and inclusive for people with language and communication difficulties

Integration of speech and gesture in aphasia

BACKGROUND: Information from speech and gesture is often integrated to comprehend a message. This integration process requires the appropriate allocation of cognitive resources to both the gesture and speech modalities. People with aphasia are likely to find integration of gesture and speech difficult. This is due to a reduction in cognitive resources, a difficulty with resource allocation or a combination of the two. Despite it being likely that people who have aphasia will have difficulty with integration, empirical evidence describing this difficulty is limited. Such a difficulty was found in a single case study by Cocks et al. in 2009, and is replicated here with a greater number of participants. AIMS: To determine whether individuals with aphasia have difficulties understanding messages in which they have to integrate speech and gesture. METHODS & PROCEDURES: Thirty-one participants with aphasia (PWA) and 30 control participants watched videos of an actor communicating a message in three different conditions: verbal only, gesture only, and verbal and gesture message combined. The message related to an action in which the name of the action (e.g., 'eat') was provided verbally and the manner of the action (e.g., hands in a position as though eating a burger) was provided gesturally. Participants then selected a picture that 'best matched' the message conveyed from a choice of four pictures which represented a gesture match only (G match), a verbal match only (V match), an integrated verbal-gesture match (Target) and an unrelated foil (UR). To determine the gain that participants obtained from integrating gesture and speech, a measure of multimodal gain (MMG) was calculated. OUTCOMES & RESULTS: The PWA were less able to integrate gesture and speech than the control participants and had significantly lower MMG scores. When the PWA had difficulty integrating, they more frequently selected the verbal match. CONCLUSIONS & IMPLICATIONS: The findings suggest that people with aphasia can have difficulty integrating speech and gesture in order to obtain meaning. Therefore, when encouraging communication partners to use gesture alongside language when communicating with people with aphasia, education regarding the types of gestures that would facilitate understanding is recommended

Simultaneous description of four positive and four negative parity bands

The extended coherent state model is further extended in order to describe two dipole bands of different parities. The formalism provides a consistent description of eight rotational bands. A unified description for spherical, transitional and deformed nuclei is possible. Projecting out the angular momentum and parity from a sole state, the $K^{\pi}=1^+$ band acquires a magnetic character, while the electric properties prevail for the other band. Signatures for a static octupole deformation in some states of the dipole bands are pointed out. Some properties which distinguish between the dipole band states and states of the same parity but belonging to other bands are mentioned. Interesting features concerning the decay properties of the two bands are found. Numerical applications are made for $^{158}$Gd, $^{172}$Yb, $^{228,232}$Th, $^{226}$Ra, $^{238}$U and $^{238}$Pu, and the results are compared with the available data.Comment: 36 pages, 13 figures, 12 table

The impact of impaired semantic knowledge on spontaneous iconic gesture production

Background: Previous research has found that people with aphasia produce more spontaneous iconic gesture than control participants, especially during word-finding difficulties. There is some evidence that impaired semantic knowledge impacts on the diversity of gestural handshapes, as well as the frequency of gesture production. However, no previous research has explored how impaired semantic knowledge impacts on the frequency and type of iconic gestures produced during fluent speech compared with those produced during word-finding difficulties. Aims: To explore the impact of impaired semantic knowledge on the frequency and type of iconic gestures produced during fluent speech and those produced during word-finding difficulties. Methods & Procedures: A group of 29 participants with aphasia and 29 control participants were video recorded describing a cartoon they had just watched. All iconic gestures were tagged and coded as either “manner”, “path only”, “shape outline” or “other”. These gestures were then separated into either those occurring during fluent speech or those occurring during a word-finding difficulty. The relationships between semantic knowledge and gesture frequency and form were then investigated in the two different conditions. Outcomes & Results: As expected, the participants with aphasia produced a higher frequency of iconic gestures than the control participants, but when the iconic gestures produced during word-finding difficulties were removed from the analysis, the frequency of iconic gesture was not significantly different between the groups. While there was not a significant relationship between the frequency of iconic gestures produced during fluent speech and semantic knowledge, there was a significant positive correlation between semantic knowledge and the proportion of word-finding difficulties that contained gesture. There was also a significant positive correlation between the speakers’ semantic knowledge and the proportion of gestures that were produced during fluent speech that were classified as “manner”. Finally while not significant, there was a positive trend between semantic knowledge of objects and the production of “shape outline” gestures during word-finding difficulties for objects. Conclusions: The results indicate that impaired semantic knowledge in aphasia impacts on both the iconic gestures produced during fluent speech and those produced during word-finding difficulties but in different ways. These results shed new light on the relationship between impaired language and iconic co-speech gesture production and also suggest that analysis of iconic gesture may be a useful addition to clinical assessment

"Beat" patterns for the odd-even staggering in octupole bands from a quadrupole-octupole Hamiltonian

We propose a collective Hamiltonian which incorporates the standard quadrupole terms, octupole terms classified according to the irreducible representations of the octahedron group, a quadrupole-octupole interaction, as well as a term for the bandhead energy linear in K (the projection of angular momentum on the body-fixed z-axis). The energy is subsequently minimized with respect to K for each given value of the angular momentum I, resulting in K values increasing with I within each band, even in the case in which K is restricted to a set of microscopically plausible values. We demonstrate that this Hamiltonian is able to reproduce a variety of ``beat'' patterns observed recently for the odd-even staggering in octupole bands of light actinides.Comment: LaTeX, 20 pages plus 12 figures given in separate .ps file