Surface Electromyography for Direct Vocal Control

This paper introduces a new method for direct control using the voice via measurement of vocal muscular activation with surface electromyography (sEMG). Digital musical interfaces based on the voice have typically used indirect control, in which features extracted from audio signals control the parameters of sound generation, for example in audio to MIDI controllers. By contrast, focusing on the musculature of the singing voice allows direct muscular control, or alternatively, combined direct and indirect control in an augmented vocal instrument. In this way we aim to both preserve the intimate relationship a vocalist has with their instrument and key timbral and stylistic characteristics of the voice while expanding its sonic capabilities. This paper discusses other digital instruments which effectively utilise a combination of indirect and direct control as well as a history of controllers involving the voice. Subsequently, a new method of direct control from physiological aspects of singing through sEMG and its capabilities are discussed. Future developments of the system are further outlined along with usage in performance studies, interactive live vocal performance, and educational and practice tools

The Design & Verification of an Automatic Occlusion Speech Valve for Voice Rehabilitation

This work investigates the restoration of the lost functions of the upper airway in patients who have undergone total laryngectomy surgery. The primary airway functions were defined as ventilation and patency, heating and humidification of air, filtration of air, coughing, swallowing, speech, olfaction, gustation and chemo sensitisation and air resistance. Through a review of the literature, the performance of the airway functions was compared pre and post laryngectomy. It was found that all of the aforementioned functions were negatively affected by total laryngectomy which led to lower quality of life and increased risk of harm or disease compared to healthy individuals of the same age groups. There are medical devices described in the literature used for the restoration of upper airway function. For most identified functions there was a medical device and or therapeutic solution to restore them partially or fully. Research found no evidence that existing medical devices had the level of filtration they provided verified. Many devices in the literature restored one function, requiring patients to use a combination of devices, this has benefits and disbenefits, mostly relating to in use life. This work aimed to restore as many functions as possible within a singular device. A singular device was designed to restore the upper airway functions. The variability of the difference in resistance of the larynx to inhalation and exhalation identified in the literature was incorporated into the device, the phenomenon was approximately matched by employing fluid structure interaction within the device. The design featured a novel bistable diaphragm that the patient can close hands free when they want to redirect air through a speech device. This had the benefit of remaining closed during pauses in speech. Different functions of the candidate device were evaluated through a combination of tests, including tests following established methodologies and new tests and test apparatus developed as part of this work. Pneumatic test apparatus was built to produce outputs that matched laryngectomy patient spirometry data found in the literature. The first iteration of the design was tested in vitro. The design was translated into FEA, validated with the lab results and optimised. Heat and moisture exchange and filtration were fully restored. Cough, breathing resistance and speech were partially restored. It was concluded that a singular device can restore most of the upper airway functions to a level closely resembling prelaryngectomy. Additionally, it was concluded that a device must be used in conjunction with other restorative medical devices to effectively restore all lost functions to pre-laryngectomy upper airway performance

2014 Annual Research Symposium Abstract Book

2014 annual volume of abstracts for science research projects conducted by students at Trinity College

Imagining & Sensing: Understanding and Extending the Vocalist-Voice Relationship Through Biosignal Feedback

The voice is body and instrument. Third-person interpretation of the voice by listeners, vocal teachers, and digital agents is centred largely around audio feedback. For a vocalist, physical feedback from within the body provides an additional interaction. The vocalist’s understanding of their multi-sensory experiences is through tacit knowledge of the body. This knowledge is difficult to articulate, yet awareness and control of the body are innate. In the ever-increasing emergence of technology which quantifies or interprets physiological processes, we must remain conscious also of embodiment and human perception of these processes. Focusing on the vocalist-voice relationship, this thesis expands knowledge of human interaction and how technology influences our perception of our bodies. To unite these different perspectives in the vocal context, I draw on mixed methods from cog- nitive science, psychology, music information retrieval, and interactive system design. Objective methods such as vocal audio analysis provide a third-person observation. Subjective practices such as micro-phenomenology capture the experiential, first-person perspectives of the vocalists them- selves. Quantitative-qualitative blend provides details not only on novel interaction, but also an understanding of how technology influences existing understanding of the body. I worked with vocalists to understand how they use their voice through abstract representations, use mental imagery to adapt to altered auditory feedback, and teach fundamental practice to others. Vocalists use multi-modal imagery, for instance understanding physical sensations through auditory sensations. The understanding of the voice exists in a pre-linguistic representation which draws on embodied knowledge and lived experience from outside contexts. I developed a novel vocal interaction method which uses measurement of laryngeal muscular activations through surface electromyography. Biofeedback was presented to vocalists through soni- fication. Acting as an indicator of vocal activity for both conscious and unconscious gestures, this feedback allowed vocalists to explore their movement through sound. This formed new perceptions but also questioned existing understanding of the body. The thesis also uncovers ways in which vocalists are in control and controlled by, work with and against their bodies, and feel as a single entity at times and totally separate entities at others. I conclude this thesis by demonstrating a nuanced account of human interaction and perception of the body through vocal practice, as an example of how technological intervention enables exploration and influence over embodied understanding. This further highlights the need for understanding of the human experience in embodied interaction, rather than solely on digital interpretation, when introducing technology into these relationships

Proceedings of the 4th international conference on disability, virtual reality and associated technologies (ICDVRAT 2002)

The proceedings of the conferenc

Proceedings of the 5th international conference on disability, virtual reality and associated technologies (ICDVRAT 2004)

The proceedings of the conferenc