121 research outputs found

    Paralinguistic vocal control of interactive media: how untapped elements of voice might enhance the role of non-speech voice input in the user's experience of multimedia.

    Get PDF
    Much interactive media development, especially commercial development, implies the dominance of the visual modality, with sound as a limited supporting channel. The development of multimedia technologies such as augmented reality and virtual reality has further revealed a distinct partiality to visual media. Sound, however, and particularly voice, have many aspects which have yet to be adequately investigated. Exploration of these aspects may show that sound can, in some respects, be superior to graphics in creating immersive and expressive interactive experiences. With this in mind, this thesis investigates the use of non-speech voice characteristics as a complementary input mechanism in controlling multimedia applications. It presents a number of projects that employ the paralinguistic elements of voice as input to interactive media including both screen-based and physical systems. These projects are used as a means of exploring the factors that seem likely to affect users’ preferences and interaction patterns during non-speech voice control. This exploration forms the basis for an examination of potential roles for paralinguistic voice input. The research includes the conceptual and practical development of the projects and a set of evaluative studies. The work submitted for Ph.D. comprises practical projects (50 percent) and a written dissertation (50 percent). The thesis aims to advance understanding of how voice can be used both on its own and in combination with other input mechanisms in controlling multimedia applications. It offers a step forward in the attempts to integrate the paralinguistic components of voice as a complementary input mode to speech input applications in order to create a synergistic combination that might let the strengths of each mode overcome the weaknesses of the other

    Manga Vision

    Get PDF
    Manga Vision examines cultural and communicative aspects of Japanese comics, drawing together scholars from Japan, Australia and Europe working in areas as diverse as cultural studies, linguistics, education, music, art, anthropology, and translation, to explore the influence of manga in Japan and worldwide via translation, OEL manga and fan engagement. This volume includes a mix of theoretical, methodological, empirical and professional practice-based chapters, examining manga from both academic and artistic perspectives. Manga Vision also provides the reader with a multimedia experience, featuring original artwork by Australian manga artist Queenie Chan, cosplay photographs, and an online supplement offering musical compositions inspired by manga, and downloadable manga-related teaching resources

    Manga Vision

    Get PDF
    Manga Vision examines cultural and communicative aspects of Japanese comics, drawing together scholars from Japan, Australia and Europe working in areas as diverse as cultural studies, linguistics, education, music, art, anthropology, and translation, to explore the influence of manga in Japan and worldwide via translation, OEL manga and fan engagement. This volume includes a mix of theoretical, methodological, empirical and professional practice-based chapters, examining manga from both academic and artistic perspectives. Manga Vision also provides the reader with a multimedia experience, featuring original artwork by Australian manga artist Queenie Chan, cosplay photographs, and an online supplement offering musical compositions inspired by manga, and downloadable manga-related teaching resources

    Paralinguistic vocal control of interactive media : how untapped elements of voice might enhance the role of non-speech voice input in the user's experience of multimedia

    Get PDF
    Much interactive media development, especially commercial development, implies the dominance of the visual modality, with sound as a limited supporting channel. The development of multimedia technologies such as augmented reality and virtual reality has further revealed a distinct partiality to visual media. Sound, however, and particularly voice, have many aspects which have yet to be adequately investigated. Exploration of these aspects may show that sound can, in some respects, be superior to graphics in creating immersive and expressive interactive experiences. With this in mind, this thesis investigates the use of non-speech voice characteristics as a complementary input mechanism in controlling multimedia applications. It presents a number of projects that employ the paralinguistic elements of voice as input to interactive media including both screen-based and physical systems. These projects are used as a means of exploring the factors that seem likely to affect users' preferences and interaction patterns during non-speech voice control. This exploration forms the basis for an examination of potential roles for paralinguistic voice input. The research includes the conceptual and practical development of the projects and a set of evaluative studies. The work submitted for Ph.D. comprises practical projects (50 percent) and a written dissertation (50 percent). The thesis aims to advance understanding of how voice can be used both on its own and in combination with other input mechanisms in controlling multimedia applications. It offers a step forward in the attempts to integrate the paralinguistic components of voice as a complementary input mode to speech input applications in order to create a synergistic combination that might let the strengths of each mode overcome the weaknesses of the other.EThOS - Electronic Theses Online ServiceGBUnited Kingdo

    Human Machine Interaction

    Get PDF
    In this book, the reader will find a set of papers divided into two sections. The first section presents different proposals focused on the human-machine interaction development process. The second section is devoted to different aspects of interaction, with a special emphasis on the physical interaction

    E-Drama: Facilitating Online Role-play using an AI Actor and Emotionally Expressive Characters.

    Get PDF
    This paper describes a multi-user role-playing environment, e-drama, which enables groups of people to converse online, in scenario driven virtual environments. The starting point of this research – edrama – is a 2D graphical environment in which users are represented by static cartoon figures. An application has been developed to enable integration of the existing edrama tool with several new components to support avatars with emotionally expressive behaviours, rendered in a 3D environment. The functionality includes the extraction of affect from open-ended improvisational text. The results of the affective analysis are then used to: (a) control an automated improvisational AI actor – EMMA (emotion, metaphor and affect) that operates a bit-part character in the improvisation; (b) drive the animations of avatars using the Demeanour framework in the user interface so that they react bodily in ways that are consistent with the affect that they are expressing. Finally, we describe user trials that demonstrate that the changes made improve the quality of social interaction and users’ sense of presence. Moreover, our system has the potential to evolve normal classroom education for young people with or without learning disabilities by providing 24/7 efficient personalised social skill, language and career training via role-play and offering automatic monitoring

    Facilitation Of Language Acquisition Viewed Through An Interpretative Lens: The Role Of Authenticity

    Get PDF
    A paradigm is the conceptual framework or lens one uses to view reality. The field of speech-language pathology is traditionally rooted in the empirical paradigm, which believes that language can be fragmented into isolated skills and taught in a hierarchal fashion. This belief has resulted in service delivery models that remove students from naturalistic contexts for decontextualized exercises. Progress in language acquisition is measured objectively. The empirical belief is exemplified by the accountability requirements in special education law (e.g., IEP). It is compounded by the realities of public school speech-language pathologists (SLPs), such as high caseload numbers, multiple buildings, and paperwork/meetings required. These realities, viewed through the empirical paradigm, frequently cause SLP\u27s to feel ineffective with students. The interpretative paradigm views language acquisition holistically. It takes into account contextual/personal factors involved in a child\u27s communication success. This belief encourages SLPs to facilitate language acquisition in authentic environments (e.g., classroom), using a collaborative service delivery model. In this paradigm, qualitative research methods are valued. This methodology views language as a dynamic phenomenon that cannot be separated from the context and culture of an individual. The purpose of this study was to rethink the role of context in the facilitation of language acquisition by SLPs. Writing conferences were held with three third grade students diagnosed with language learning impairments. Authentic inquiry, critical moment teaching, and scaffolding were used to facilitate language growth and measured qualitatively. The growth was described in relation to the student\u27s IEP goals/objectives. A rich description of the findings showed that authentic contexts and techniques do support language growth for students with language learning impairments. Fieldnotes, teacher/student/SLP interviews, and student artifacts were used to triangulate the data from transcribed conferences. A discussion on realistic ways that SLPs can use authentic contexts, goals, and techniques with students to best understand language ensues. Suggestions on ways to transfer qualitative data to the objective requirements of IEPs are given. The study encourages school-based SLP\u27s the view their position through an interpretative lens to facilitate systematic change in the child\u27s communicative context

    The evolution of language: Proceedings of the Joint Conference on Language Evolution (JCoLE)

    Get PDF
    corecore