Toward an affect-sensitive multimodal human-computer interaction

The ability to recognize affective states of a person... This paper argues that next-generation human-computer interaction (HCI) designs need to include the essence of emotional intelligence -- the ability to recognize a user's affective states -- in order to become more human-like, more effective, and more efficient. Affective arousal modulates all nonverbal communicative cues (facial expressions, body movements, and vocal and physiological reactions). In a face-to-face interaction, humans detect and interpret those interactive signals of their communicator with little or no effort. Yet design and development of an automated system that accomplishes these tasks is rather difficult. This paper surveys the past work in solving these problems by a computer and provides a set of recommendations for developing the first part of an intelligent multimodal HCI -- an automatic personalized analyzer of a user's nonverbal affective feedback

Spectators’ aesthetic experiences of sound and movement in dance performance

In this paper we present a study of spectators’ aesthetic experiences of sound and movement in live dance performance. A multidisciplinary team comprising a choreographer, neuroscientists and qualitative researchers investigated the effects of different sound scores on dance spectators. What would be the impact of auditory stimulation on kinesthetic experience and/or aesthetic appreciation of the dance? What would be the effect of removing music altogether, so that spectators watched dance while hearing only the performers’ breathing and footfalls? We investigated audience experience through qualitative research, using post-performance focus groups, while a separately conducted functional brain imaging (fMRI) study measured the synchrony in brain activity across spectators when they watched dance with sound or breathing only. When audiences watched dance accompanied by music the fMRI data revealed evidence of greater intersubject synchronisation in a brain region consistent with complex auditory processing. The audience research found that some spectators derived pleasure from finding convergences between two complex stimuli (dance and music). The removal of music and the resulting audibility of the performers’ breathing had a significant impact on spectators’ aesthetic experience. The fMRI analysis showed increased synchronisation among observers, suggesting greater influence of the body when interpreting the dance stimuli. The audience research found evidence of similar corporeally focused experience. The paper discusses possible connections between the findings of our different approaches, and considers the implications of this study for interdisciplinary research collaborations between arts and sciences

Final Report to NSF of the Standards for Facial Animation Workshop

The human face is an important and complex communication channel. It is a very familiar and sensitive object of human perception. The facial animation field has increased greatly in the past few years as fast computer graphics workstations have made the modeling and real-time animation of hundreds of thousands of polygons affordable and almost commonplace. Many applications have been developed such as teleconferencing, surgery, information assistance systems, games, and entertainment. To solve these different problems, different approaches for both animation control and modeling have been developed

Proceedings of QG2010: The Third Workshop on Question Generation

These are the peer-reviewed proceedings of "QG2010, The Third Workshop on Question Generation". The workshop included a special track for "QGSTEC2010: The First Question Generation Shared Task and Evaluation Challenge". QG2010 was held as part of The Tenth International Conference on Intelligent Tutoring Systems (ITS2010)

Determining Intent: A Quantitative and Qualitative Linguistic Analysis of Holographic and Professional Wills

My dissertation focuses on the language of wills. More specifically, I am interested in how the language of holographic wills (i.e., handwritten wills) differs from the language of professional wills.My research question is Do linguistic differences between professional wills and holographic wills have the potential to affect the interpretation of the wills, subsequently influencing the outcome of the probate process? In order to address this question, I conduct a quantitative and qualitative contrastive corpus analysis of holographic and professionally-prepared wills. My hypothesis is that the discourse of holographic wills will tend to be more narrative-like, reflecting personal experiences and emotions. By contrast, the language of professional wills is more formal and rule-driven than the language of holographic wills. By using computational analysis tools such as the Gramulator, my dissertation identifies specific language differencesbetween these two text types that support my hypothesis. These differences are assessed through a variety of statistical methods. Additionally, I perform a qualitative assessment of three case studies on individual wills using discourse analysis approaches to provide insight into why and how the meaning of the text may be determined. Although both types of discourse have their differences, their main goal is the same: to convey the testator\u27s intent. The purpose of my dissertation is to facilitate this goal by demonstrating to the legal community how non-professionals write their wills so that when a controversy over a holographic will arises, the legal community can apply the methods and techniques presented here and determine the testator\u27s intent, since by law, this is what is required