Personalization of object-based audio for accessibility using narrative importance

An increasing incidence of hearing impairment and of re- ported problems with broadcast audio is leading to an in- creased demand for personalized audio services. Previous research has treated these issues as a ‘speech in noise’ prob- lem; sounds are viewed as speech (good) or as competing masker (bad). This binary approach to accessible audio dis- regards the important role of some non-speech sounds in facilitating understanding of broadcast programme narra- tive. This work, as part of the S3A project, has taken a more holistic approach to audio personalization using categories of narrative importance to provide complex manipulations of broadcast audio based on narrative comprehension, instead of simply intelligibility. A simple, intuitive user-interface allows the user to adjust the complexity of audio scenes based on their personal hearing needs, metadata is generated at pro- duction using plugins to generate appropriate metadata and audio previews of user-narrative importance settings. This paper outlines the concept of narrative importance, the pro- duction tools and the end-user interface designed to deliver it. Response to these tools from target users and production staff are discussed as well as ongoing work

Personalization in object-based audio for accessibility : a review of advancements for hearing impaired listeners

Hearing loss is widespread and significantly impacts an individual’s ability to engage with broadcast media. Access can be improved through new object-based audio personalization methods. Utilizing the literature on hearing loss and intelligibility this paper develops three dimensions which are evidenced to improve intelligibility: spatial separation, speech to noise ratio and redundancy. These can be personalized, individually or concurrently, using object based audio. A systematic review of all work in object-based audio personalization is then undertaken. These dimensions are utilized to evaluate each project’s approach to personalisation, identifying successful approaches, commercial challenges and the next steps required to ensure continuing improvements to broadcast audio for hard of hearing individuals

Personalized object-based audio for hearing impaired TV viewers

Age demographics have led to an increase in the proportion of the population suffering from some form of hearing loss. The introduction of object-based audio to television broadcast has the potential to improve the viewing experience for millions of hearing impaired people. Personalization of object-based audio can assist in overcoming difficulties in understanding speech and understanding the narrative of broadcast media. The research presented here documents a Multi-Dimensional Audio (MDA) implementation of object-based clean audio to present independent object streams based on object category elicitation. Evaluations were carried out with hearing impaired people and participants were able to personalize audio levels independently for four object-categories using an on-screen menu: speech, music, background effects and foreground effects related to on-screen events. Results show considerable preference variation across subjects but indicate that expanding object-category personalization beyond a binary speech/non-speech categorization can substantially improve the viewing experience for some hearing impaired people

Intelligibility vs. comprehension : understanding quality of accessible next-generation audio broadcast

For traditional broadcasting formats, imple-mentation of accessible audio strategies for hard of hear-ing people have used a binary, intelligibility-based ap-proach. In this approach sounds are categorized eitheras speech, contributing to comprehension of content,or non-speech, which can mask the speech and reduceintelligibility. Audio accessibility solutions have there-fore focused on speech enhancement type methods, forwhich several useful standard objective measures of qual-ity exist. Recent developments in next-generation broad-cast audio formats, in particular the roll out of object-based audio, facilitate more in-depth personalisationof the audio experience based on user preferences andneeds. Recent research has demonstrated that manynon-speech sounds do not strictly behave as maskersbut can be critical for comprehension of the narrativefor some viewers. This complex relationship betweenspeech, non-speech audio and the viewer necessitate amore holistic approach to understanding quality of ex-perience of accessible media. This paper reviews pre-vious work and outlines such an approach, discussingaccessibility strategies using next-generation audio for-mats and their implications for developing effective as-sessments of quality

Intelligent Mobile Learning Interaction System (IMLIS): A Personalized Learning System for People with Mental Disabilities

The domain of learning context for people with special needs is a big challenge for digi- tal media in education. This thesis describes the main ideas and the architecture of a system called Intelligent Mobile Learning Interaction System (IMLIS) that provides a mobile learning environment for people with mental disabilities. The design of IMLIS aims to enhance personalization aspects by using a decision engine, which makes deci- sions based on the user s abilities, learning history and reactions to processes. It allows for adaptation, adjustment and personalization of content, learning activities, and the user interface on different levels in a context where learners and teachers are targeting autonomous learning by personalized lessons and feedback. Due to IMLIS dynamic structure and flexible patterns, it is able to meet the specific needs of individuals and to engage them in learning activities with new learning motivations. In addition to support- ing learning material and educational aspects, mobile learning fosters learning across context and provides more social communication and collaboration for its users. The suggested methodology defines a comprehensive learning process for the mentally disabled to support them in formal and informal learning. We apply knowledge from the field of research and practice to people with mental disabilities, as well as discuss the pedagogical and didactical aspects of the design