Affordance of vibrational excitation for music composition and performance

Mechanical vibrations have typically been used in the performance domain within feedback systems to inform musicians of system states or as communication channels between performers. In this paper, we propose the addi- tional taxonomic category of vibrational excitation of mu- sical instruments for sound generation. To explore the va- riety of possibilities associated with this extended taxon- omy, we present the Oktopus, a multi-purpose wireless sys- tem capable of motorised vibrational excitation. The sys- tem can receive up to eight inputs and generates vibrations as outputs through eight motors that can be positioned ac- cordingly to produce a wide range of sounds from an ex- cited instrument. We demonstrate the usefulness of the proposed system and extended taxonomy through the de- velopment and performance of Live Mechanics, a compo- sition for piano and interactive electronics

On the hunt for feedback: Vibrotactile feedback in interactive electronic music performances

The expressivity of musical performance is highly dependent on the feedback relationship between the performer and the instrument. Despite current advances in music technology, performers still struggle to retain the same expressive nuances of acoustic instruments. The capacity of performative musical expression in technologically-driven music is mitigated by the limitations of controllers and other sensor-based devices used in the performance of such music. Due to their physical properties, such devices and components are unable to provide mainly the haptic and vibrotactile experience between the instrument and the user, thus breaking the link with traditional musical performance. Such limitations are apparent to performers, suggesting often the existence of an unnatural barrier between the technology and the performer. The thesis proposes the use of vibrotactile feedback as means to enhance performer’s expressivity and creativity in technology mediated performances and situate vibrotactile feedback as part of the tradition of instrumental musical playing. Achieved through the use of small controllable electric motors, vibrotactile feedback can nourish communicative pathways between the performer and technology, a relationship that is otherwise limited or non-existing. The ability to experience an instrument's communicative response can significantly improve the performer-instrument relationship, and in turn the music performed. Through a series of case studies, compositions and performances, the dissertation suggests ways in which vibrotactile feedback may be applied to enhance the experience between the technology and the performer. As a result performers are able to develop expressive nuances and have better control of the technology during performance

Accessible interactive digital signage for visually impaired

In this workshop we discuss the potential of cross-modal haptic-auditory feedback for empowering visually impaired people to experience Interactive Digital Signage

Making Graphical Scores More Accessible: A Case Study

This paper explores new ways of making graphical scores more accessible for visually impaired users. Existing assistive technologies demonstrate a gap in providing accessible tools for composing and performing contemporary music with non-traditional western notation. The two case studies presented, Blocks Sound and Logothetis Sound examine the interactive relationships and affordances through tac- tile interaction and how this interaction can influence their experience and understanding of both graphic scores and interactive composition of users. We present the process and limitations and propose the use of haptic technology and tangible experience for making contemporary graphic scores more accessible and inclusive

3D mid-air audio-haptic navigation for digital signage

In this workshop we discuss the application of using mid-air haptics to provide directions for navigation to users in large indoor spaces. We propose a feed-forward approach from objects and locations that enable a physical way of thinking, communication and general accessibility

Accessible interactive digital signage for visually impaired

In this workshop we discuss the potential of cross-modal haptic-auditory feedback for empowering visually impaired people to experience Interactive Digital Signage

Harnessing ancillary microgestures in piano technique: implementing microgestural control in to an expressive keyboard-based hyper-instrument

The chapter describes through the implementation of microgestural sound control, how performers can gain wide control over digital sound processing through their existing technique. By using radar millimeter waves to capture micromotions and microgestures, performers achieve high level of expression without the need to modify their instrument nor dev additional technique. This research builds upon existing instrumental technique and removes the steep learning curve typically found when performing digital or augmented musical instruments. We present a case study that enables pianist to retain and focus on technical control and musical freedom resulting in a less disruptive experience

Enhance Engine Room Diagnostics Through Audio-Focused VR Simulation

A marine engineer’s task is to maintain all systems in an operational state, to diagnose and rectify problems arising, and to understand what maintenance will be required to keep the vessel appropriately operational and safe. This capability is built upon the training and experience of the engineering crew, the information that can be gained by reading and interpreting engine room instrumentation, and the familiarity with the vessel and an in-situ intuitive feel for normal operation. In this paper, we examine how audio can enhance remote interaction and feedback information. We gathered real-world data from an engine room that allow us to create a realistic virtual engine room for testing. We carried out usability test on simulated failure scenarios where we look at how VR technology might enable engineers to experience immersive information from a remote location and allow them to diagnose and give feedback on the system. Our findings suggest that sound plays a vital role in identifying failures and could potentially be used in the operation of unmanned and autonomous vessels

Improvising through the senses: a performance approach with the indirect use of technology

This article explores and proposes new ways of performing in a technology-mediated environment. We present a case study that examines feedback loop relationships between a dancer and a pianist. Rather than using data from sensor technologies to directly control and affect musical parameters, we captured data from a dancer's arm movements and mapped them onto a bespoke device that stimulates the pianist's tactile sense through vibrations. The pianist identifies and interprets the tactile sensory experience, with his improvised performance responding to the changes in haptic information received. Our system presents a new way of technology-mediated performer interaction through tactile feedback channels, enabling the user to establish new creative pathways. We present a classification of vibrotactile interaction as means of communication, and we conclude how users experience multi-point vibrotactile feedback as one holistic experience rather than a collection of discrete feedback points