Playful E-textile Sonic Interaction for Socially Engaged and Open-Ended Play Between Autistic Children

Research on the potential benefits of technology for autistic children is an emergent field in Human-Computer Interaction (HCI), especially within the Child-Computer Interaction Community. This thesis contributes a design approach grounded in theories of play, cognitive development, and autism to expand the discourse on methodological guidelines for performing empirical studies with non-verbal autistic children and to extend the design space to cater to the socio-emotional and sensory needs of this population. The thesis reveals how sonic e-textile Tangible User Interfaces (TUIs) can be used effectively to mediate children’s social participation in playful activities. This is demonstrated through developing three explorative field-studies conducted at a specialist school based in North-East London where two sonic e-textile playful TUIs, namely Mazi and Olly, have been created and tested with three groups of autistic children aged between 5-10. The three studies ran over the period of three years and were designed to investigate the potentials of TUIs as shareable toys during leisure and recreational activities to a) support social and playful interactions among peers and b) provide opportunities for self-regulation. The key contributions of this thesis are the designs of two tangible user interfaces, which offer a set of design approaches to guide researchers through creating shareable and playful tangibles for non-verbal autistic children; a framework for analysis and a thorough evaluation process that other researchers could use to assess the efficacy of playful TUI designs for nonverbal autistic children; and an in-depth discussion about the research process, which offers a new perspective about holistic designs and evaluation of technologies that aim to scaffold play in groups non-verbal autistic children

Sonic Interactions in Virtual Environments

This open access book tackles the design of 3D spatial interactions in an audio-centered and audio-first perspective, providing the fundamental notions related to the creation and evaluation of immersive sonic experiences. The key elements that enhance the sensation of place in a virtual environment (VE) are: Immersive audio: the computational aspects of the acoustical-space properties of Virutal Reality (VR) technologies Sonic interaction: the human-computer interplay through auditory feedback in VE VR systems: naturally support multimodal integration, impacting different application domains Sonic Interactions in Virtual Environments will feature state-of-the-art research on real-time auralization, sonic interaction design in VR, quality of the experience in multimodal scenarios, and applications. Contributors and editors include interdisciplinary experts from the fields of computer science, engineering, acoustics, psychology, design, humanities, and beyond. Their mission is to shape an emerging new field of study at the intersection of sonic interaction design and immersive media, embracing an archipelago of existing research spread in different audio communities and to increase among the VR communities, researchers, and practitioners, the awareness of the importance of sonic elements when designing immersive environments

Exploring Social Interaction With a Tangible Music Interface

This article presents a video-based field study of the Reactable, a tabletop tangible user interface (TUI) for music performance, in a hands-on science centre. The goal was to investigate visitors’ social interactions in a public setting. We describe liminality and cross-group interaction, both synchronous with fluid transitions and overlaps in use between groups and asynchronous. Our findings indicate the importance of: (i) facilitating smooth transitions and overlaps between groups and (ii) supporting not only synchronous but also asynchronous group interaction. We discuss the lessons learned on how best to enable liminal situations in the design of interactive tabletops and TUIs for social interaction and particularly collaborative tangible music in public museum settings. • Presentation of a video-based field study describing cross-group interaction. • Description of exemplar vignettes of video for illustrating liminal situations in social interaction. • Discussion of the nature of different levels of cross-group interaction and their relevance for social interaction and collaboration. • Lessons learned in how best to enable liminal situations in the design of collaborative tangible user interfaces for promoting social interaction and collaboration

Sonic Interactions in Virtual Environments

This open access book tackles the design of 3D spatial interactions in an audio-centered and audio-first perspective, providing the fundamental notions related to the creation and evaluation of immersive sonic experiences. The key elements that enhance the sensation of place in a virtual environment (VE) are: Immersive audio: the computational aspects of the acoustical-space properties of Virutal Reality (VR) technologies Sonic interaction: the human-computer interplay through auditory feedback in VE VR systems: naturally support multimodal integration, impacting different application domains Sonic Interactions in Virtual Environments will feature state-of-the-art research on real-time auralization, sonic interaction design in VR, quality of the experience in multimodal scenarios, and applications. Contributors and editors include interdisciplinary experts from the fields of computer science, engineering, acoustics, psychology, design, humanities, and beyond. Their mission is to shape an emerging new field of study at the intersection of sonic interaction design and immersive media, embracing an archipelago of existing research spread in different audio communities and to increase among the VR communities, researchers, and practitioners, the awareness of the importance of sonic elements when designing immersive environments