Culture and emotional language

Book synopsis: The Routledge Handbook of Language and Culture presents the first comprehensive survey of research on the relationship between language and culture. It provides readers with a clear and accessible introduction to both interdisciplinary and multidisciplinary studies of language and culture, and addresses key issues of language and culturally based linguistic research from a variety of perspectives and theoretical frameworks

Toward an affect-sensitive multimodal human-computer interaction

The ability to recognize affective states of a person... This paper argues that next-generation human-computer interaction (HCI) designs need to include the essence of emotional intelligence -- the ability to recognize a user's affective states -- in order to become more human-like, more effective, and more efficient. Affective arousal modulates all nonverbal communicative cues (facial expressions, body movements, and vocal and physiological reactions). In a face-to-face interaction, humans detect and interpret those interactive signals of their communicator with little or no effort. Yet design and development of an automated system that accomplishes these tasks is rather difficult. This paper surveys the past work in solving these problems by a computer and provides a set of recommendations for developing the first part of an intelligent multimodal HCI -- an automatic personalized analyzer of a user's nonverbal affective feedback

A special education composition curriculum: An interactive approach

Writing instruction that reflects the variety or represented pupil intelligences and learning styles in a special day classroom can significantly increase a child\u27s opportunity for success. Attending to these areas while simultaneously taking into account student strengths, interests, and desires can facilitate the academic process. Written language skills and achievement must be addressed in a supportive and encouraging climate motivating children and maximizing their willingness to undertake new concepts

Multi-Sensory Interaction for Blind and Visually Impaired People

This book conveyed the visual elements of artwork to the visually impaired through various sensory elements to open a new perspective for appreciating visual artwork. In addition, the technique of expressing a color code by integrating patterns, temperatures, scents, music, and vibrations was explored, and future research topics were presented. A holistic experience using multi-sensory interaction acquired by people with visual impairment was provided to convey the meaning and contents of the work through rich multi-sensory appreciation. A method that allows people with visual impairments to engage in artwork using a variety of senses, including touch, temperature, tactile pattern, and sound, helps them to appreciate artwork at a deeper level than can be achieved with hearing or touch alone. The development of such art appreciation aids for the visually impaired will ultimately improve their cultural enjoyment and strengthen their access to culture and the arts. The development of this new concept aids ultimately expands opportunities for the non-visually impaired as well as the visually impaired to enjoy works of art and breaks down the boundaries between the disabled and the non-disabled in the field of culture and arts through continuous efforts to enhance accessibility. In addition, the developed multi-sensory expression and delivery tool can be used as an educational tool to increase product and artwork accessibility and usability through multi-modal interaction. Training the multi-sensory experiences introduced in this book may lead to more vivid visual imageries or seeing with the mind’s eye

Ink: A Visual and Movement Exploration of Metaphor through Chinese and American Cultural Perspectives of the Colors Black and White

abstract: Metaphor as a way of thinking permeates daily life. It affects how people understand and experience everything. It also plays an important role in artistic creation. The idea of creating highly personal but commonly understood metaphors was central to the research and creation of Ink. I created this work to find out how I—as a Chinese artist with unique personal experiences, educational experiences, and cultural perspectives—can explore metaphors that would resonate with predominantly Western audiences. This research specifically addressed the metaphorical meanings of the colors black and white and drew from my visual artistry to compose dances, stage setting, and costume design.Dissertation/ThesisMasters Thesis Dance 201

Investigating spoken emotion : the interplay of language and facial expression

This thesis aims to investigate how spoken expressions of emotions are influenced by the characteristics of spoken language and the facial emotion expression. The first three chapters examined how production and perception of emotions differed between Cantonese (tone language) and English (non-tone language). The rationale for this contrast was that the acoustic property of Fundamental Frequency (F0) may be used differently in the production and perception of spoken expressions in tone languages as F0 may be preserved as a linguistic resource for the production of lexical tones. To test this idea, I first developed the Cantonese Audio-visual Emotional Speech (CAVES) database, which was then used as stimuli in all the studies presented in this thesis (Chapter 1). An emotion perception study was then conducted to examine how three groups of participants (Australian English, Malaysian Malay and Hong Kong Cantonese speakers) identified spoken expression of emotions that were produced in either English or Cantonese (Chapter 2). As one of the aims of this study was to disambiguate the effects of language from culture, these participants were selected on the basis that they either shared similarities in language type (non-tone language, Malay and English) or culture (collectivist culture, Cantonese and Malay). The results showed that a greater similarity in emotion perception was observed between those who spoke a similar type of language, as opposed to those who shared a similar culture. This suggests some intergroup differences in emotion perception may be attributable to cross-language differences. Following up on these findings, an acoustic analysis study (Chapter 3) showed that compared to English spoken expression of emotions, Cantonese expressions had less F0 related cues (median and flatter F0 contour) and also the use of F0 cues was different. Taken together, these results show that language characteristics (n F0 usage) interact with the production and perception of spoken expression of emotions. The expression of disgust was used to investigate how facial expressions of emotions affect speech articulation. The rationale for selecting disgust was that the facial expression of disgust involves changes to the mouth region such as closure and retraction of the lips, and these changes are likely to have an impact on speech articulation. To test this idea, an automatic lip segmentation and measurement algorithm was developed to quantify the configuration of the lips from images (Chapter 5). By comparing neutral to disgust expressive speech, the results showed that disgust expressive speech is produced with significantly smaller vertical mouth opening, greater horizontal mouth opening and lower first and second formant frequencies (F1 and F2). Overall, this thesis provides an insight into how aspects of expressive speech may be shaped by specific (language type) and universal (face emotion expression) factors

Judging the Intensity of Emotional Expression in Faces: the Effects of Colored Tints on Individuals With Autism Spectrum Disorder

Individuals with autism spectrum disorder (ASD) often show atypical processing of facial expressions, which may result from visual stress. In the current study, children with ASD and matched controls judged which member of a pair of faces displayed the more intense emotion. Both faces showed anger, disgust, fear, happiness, sadness or surprise but to different degrees. Faces were presented on a monitor that was tinted either gray or with a color previously selected by the participant individually as improving the clarity of text. Judgments of emotional intensity improved significantly with the addition of the preferred colored tint in the ASD group but not in controls, a result consistent with a link between visual stress and impairments in processing facial expressions in individuals with ASD. Autism Res 2016, 9: 450-459. © 2015 International Society for Autism Research, Wiley Periodicals, Inc