Paper mechanisms for sonic interaction

ABSTRACT Introducing continuous sonic interaction in augmented popup books enhances the expressive and performative qualities of movables, making the whole narrative experience more engaging and personal. The SaMPL Spring School on Sounding Popables explored the specific topic of paper-driven sonic narratives. Working groups produced several sketches of sonic interactions with movables. The most significant sketches of sounding popables are presented and analyzed

A multi-sensory interactive reading experience for visually impaired children; a user evaluation

© 2018 Springer-Verlag London Ltd., part of Springer Nature The children’s experience of reading is enhanced by visual displays, and through picture book experiences, young children expose themselves to develop socially, personally, intellectually, and culturally. While a sighted person’s mental imagining is constructed mostly through visual experiences, a visually impaired person’s mental images are a product of haptic, taste, smell, and sounds. In this paper, we are introducing a picture book with multi-sensory interactions for the visually impaired children. The key novelty in our concept is the integration of multi-sensory interactions (touch, sound, and smell) to create a new reading experience for visually impaired. Also, this concept is highlighting the lack of appropriately designed sensory reading experiences for visually impaired children. We have conducted a user study with 10 educators, and 25 children from a special school for visually impaired in Malaysia, and our evaluation revealed that this book is engaging and a novel experience of multi-sensory interactions to both children and educators

Design and evaluation of a web-and mobile-based binaural audio platform for cultural heritage

PlugSonic is a suite of web- and mobile-based applications for the curation and experience of 3D interactive soundscapes and sonic narratives in the cultural heritage context. It was developed as part of the PLUGGY EU project (Pluggable Social Platform for Heritage Awareness and Participation) and consists of two main applications: PlugSonic Sample, to edit and apply audio effects, and PlugSonic Soundscape, to create and experience 3D soundscapes for headphones playback. The audio processing within PlugSonic is based on the Web Audio API and the 3D Tune-In Toolkit, while the mobile exploration of soundscapes in a physical space is obtained using Apple’s ARKit. The main goal of PlugSonic is technology democratisation; PlugSonic users-whether cultural institutions or citizens-are all given the instruments needed to create, process and experience 3D soundscapes and sonic narratives; without the need for specific devices, external tools (software and/or hardware), specialised knowledge or custom development. The aims of this paper are to present the design and development choices, the user involvement processes as well as a final evaluation conducted with inexperienced users on three tasks (creation, curation and experience), demonstrating how PlugSonic is indeed a simple, effective, yet powerful tool

Designing interactive newsprint

The possibility of linking paper to digital information is enhanced by recent developments in printed electronics. In this article we report the design and evaluation of a local newspaper augmented with capacitive touch regions and an embedded Bluetooth chip working with an adjunct device. These allowed the interactive playback of associated audio and the registration of manual voting actions on the web. Design conventions inherited from paper and the web were explored by showing four different versions of an interactive newspaper to 16 community residents. The diverse responses of residents are described, outlining the potential of the approach for local journalism and recommendations for the design of interactive newsprint

3D Information Technologies in Cultural Heritage Preservation and Popularisation

This Special Issue of the journal Applied Sciences presents recent advances and developments in the use of digital 3D technologies to protect and preserve cultural heritage. While most of the articles focus on aspects of 3D scanning, modeling, and presenting in VR of cultural heritage objects from buildings to small artifacts and clothing, part of the issue is devoted to 3D sound utilization in the cultural heritage field

Paper-based circuits for creative expression

Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2012.Cataloged from PDF version of thesis.Includes bibliographical references (p. 99-101).This thesis investigates the creative possibilities enabled by combining circuit building with paper craft to create paper electronics-a medium that adds the magical interactivity of electronics to the physical intuitiveness and expressive potential of paper. I designed this medium to take advantage of the skills and creative associations that most people already have with paper, in order to ease everyone into creating expressive electronics. This work outlines the basic set of tools, materials and techniques used for making electronics with paper-from drawing circuits with copper tape to actuating paper with shape memory alloys. I also share my own creative journey and development as a result of working with this new medium. Finally, I document the creative results and lessons learned from others' explorations through workshops. These workshop results show how paper electronics can inspire and enable diverse audiences to create personally expressive artworks with technology.by Jie Qi.S.M

Multi-Sensory Interaction for Blind and Visually Impaired People

This book conveyed the visual elements of artwork to the visually impaired through various sensory elements to open a new perspective for appreciating visual artwork. In addition, the technique of expressing a color code by integrating patterns, temperatures, scents, music, and vibrations was explored, and future research topics were presented. A holistic experience using multi-sensory interaction acquired by people with visual impairment was provided to convey the meaning and contents of the work through rich multi-sensory appreciation. A method that allows people with visual impairments to engage in artwork using a variety of senses, including touch, temperature, tactile pattern, and sound, helps them to appreciate artwork at a deeper level than can be achieved with hearing or touch alone. The development of such art appreciation aids for the visually impaired will ultimately improve their cultural enjoyment and strengthen their access to culture and the arts. The development of this new concept aids ultimately expands opportunities for the non-visually impaired as well as the visually impaired to enjoy works of art and breaks down the boundaries between the disabled and the non-disabled in the field of culture and arts through continuous efforts to enhance accessibility. In addition, the developed multi-sensory expression and delivery tool can be used as an educational tool to increase product and artwork accessibility and usability through multi-modal interaction. Training the multi-sensory experiences introduced in this book may lead to more vivid visual imageries or seeing with the mind’s eye

2014 Digital Rsearch in the Humanities and Arts (Full (DRHA): Full paper proceedings

This publication includes a selection of peer reviewed academic papers. The full paper/Proceedings publication for the DRHA2014 conference showcase up to-date discussions, dynamic debates and innovative keynotes and aims to open a discussion on defining digital communication futures, as a theme that connects interdisciplinary practices, focusing particularly on issues of communication and its impact on creative industries