Extending physical instruments using sampled acoustics

Thesis (Ph. D.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2007.Includes bibliographical references (p. 133-138).This thesis presents a system architecture for creating hybrid digital-acoustic percussion instruments by combining extensions of existing signal processing techniques with specially-designed semi-acoustic physical controllers. This work aims to provide greater realism to digital percussion, gaining much of the richness and understandability of acoustic instruments while preserving the flexibility of digital systems. For this thesis, I have collaborated with percussionists to develop a range of instruments, to refine and extend the algorithmic and physical designs, and to determine successful models of interaction. Conventional percussion controllers measure and discretize the intensity of strikes into discrete trigger messages, but they also ignore the timbre of the hits and fail to track more ambiguous input. In this work, the continuous acoustic output of a struck physical object is processed to add the resonance of a sampled instrument. This is achieved by employing existing low-latency convolution algorithms which have been extended to give the player control over features such as damping, spectral flattening, nonlinear effects, and pitch.(cont.) One of the advantages of this approach is that light taps, scrapes, rubs, or stirring with brushes all take on a hybrid timbre of the real and sampled sound that is surprisingly realistic and controllable. Since part of its behavior is inherently acoustic, a player's intuition about interacting with physical objects can be applied to controlling it. The ability to transform the apparent acoustic properties of objects also suggests applications to HCI and product design contexts.by Roberto Mario Aimi.Ph.D

The integrated sound, space and movement environment : The uses of analogue and digital technologies to correlate topographical and gestural movement with sound

This thesis investigates correlations between auditory parameters and parameters associated with movement in a sensitised space. The research examines those aspects of sound that form correspondences with movement, force or position of a body or bodies in a space sensitised by devices for acquiring gestural or topographical data. A wide range of digital technologies are scrutinised to establish what the most effective technologies are in order to achieve detailed and accurate information about movement in a given space, and the methods and procedures for analysis, transposition and synthesis into sound. The thesis describes pertinent work in the field from the last 20 years, the issues that have been raised in those works and issues raised by my work in the area. The thesis draws conclusions that point to further development of an integrated model of a space that is sensitised to movement, and responds in sound in such a way that it can be appreciated by performers and audiences. The artistic and research practices that are cited, are principally from the areas of danceand- technology, sound installation and alternative gestural controllers for musical applications

The grain of the digital audio workstation

This thesis explores the material conditions and practices of the digital audio workstation (DAW), treating them as a subject of musical composition. The DAW is a software application currently ubiquitous in facilitating the creation of recorded and electronic music. Despite its prominence, few have articulated its unique possibilities for compositional practice, or historically contextualised the emergence of such practices. To clarify the locus of inquiry, a theoretical framework termed the grain of the DAW is developed. Derived primarily from Roland Barthes’ notion of the grain (1977), it is understood as the sonic effects in a recorded musical work that infer the unique material conditions and practices associated with a sonic medium. It is argued that compositional techniques can foreground or conceal this grain, the latter of which is more common in many musical traditions. Employing practice-led research strategies and methods derived from experimental electronic music, compositional techniques that foreground the grain of the DAW are investigated, culminating in an album entitled Thru, the creative component of this thesis. Composition in this mode involves negotiating between sound design, arrangement, mixing, critical listening, data organisation, and managing conceptual burden (Duignan, 2008). It also involves situating the DAW as a socially constructed technology (Sterne, 2012; Pinch & Bijker, 2012), promoting individualised musical practice and mobilising several metaphors that articulate this condition

Sensor-rich real-time adaptive gesture and affordance learning platform for electronic music control

Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2004.Includes bibliographical references (p. [151]-156).Acoustic musical instruments have traditionally featured static mappings from input gesture to output sound, their input affordances being tied to the physics of their sound-production mechanism. More recently, the advent of digital sound synthesizers and electronic music controllers has abolished the tight coupling between input gesture and resultant sound, making an exponentially large range of input-to-output mappings possible, as well as an infinite set of possible timbres. This revolutionary change in the way sound can be produced and controlled brings with it the burden of design: Compelling and natural mappings from gesture to sound now must be created in order to create a playable electronic music instrument. The goal of this thesis is to present a device that allows flexible assignment of input gesture to output sound, so acting as a laboratory to help further understanding about the connection from gesture to sound. An embodied multi-degree-of-freedom gestural input device was constructed. The device was built to support six-degree-of-freedom inertial sensing, five isometric buttons, two digital buttons, two-axis bend sensing, isometric rotation sensing, and isotonic electric field sensing of position. Software was written to handle the incoming serial data, and to implement a trainable interface by which a user can explore the sounds possible with the device, associate a custom inertial gesture with a sound for later playback, make custom input degree-of-freedom (DOF) to effect modulation mappings, and play with the resulting configuration. A user study with 25 subjects was run to evaluate the system in terms of its engaging-ness, enjoyability, ability to inspire interest in future play and performance,(cont.) ease of gesturing and novelty. In addition to these subjective measures, implicit data was collected about the types of gesture-to-sound and input-DOF-to-effect mappings that the subjects created. Favorable and interesting results were found in the data from the study, indicating that a flexible trainable musical instrument is not only a compelling performance tool, but is a useful laboratory for understanding the connection between human gesture and sound.by Jeffrey Merrill.S.M

Un voyage du son par les fils électroacoustiques : l'art et les nouvelles technologies en Amérique Latine

L'histoire de la musique électroacoustique latino-américaine est longue, intéressante et prolifique, mais peu connue, même régionalement. De nombreux compositeurs nés ou vivants en Amérique latine ont été très actifs à ce titre, dans certains pays depuis plus de 50 ans, mais la disponibilité de l'information et des enregistrements de musique électroacoustique à cet égard et dans cette région a posé de sérieux problèmes aux éducateurs, compositeurs, interprètes, chercheurs, étudiants et au public en général.\ud Compte tenu de cette situation, la question suivante s'est imposée comme point de départ de ma thèse: comment s'est développée la tradition de la création musicale avec les médias électroacoustiques en Amérique Latine. Pour y répondre, j'ai adopté une approche historique en utilisant une méthodologie ethnographique (caractérisée par une immersion à long terme dans le domaine, par des contacts personnels avec des compositeurs et par ma participation et mon souci en ce qui concerne l'évolution des arts faisant appel aux nouvelles technologies en Amérique Latine) dans toute ma recherche. Ayant commencé à travailler dans le domaine de la musique électroacoustique au milieu des années 1970 dans mon Argentine natale, il m'a été très difficile d'obtenir de l'information sur les activités reliées à ce domaine dans des pays voisins et même dans ma propre ville. Bien que difficile, il était néanmoins possible de trouver les enregistrements de compositeurs vivant en Europe ou en Amérique du Nord, mais plus ardu de trouver ceux réalisés par des compositeurs locaux ou régionaux. Dans divers pays d'Amérique latine, les universités, les organismes d'état et de grandes fondations privées avaient de temps en temps pris l'initiative de soutenir la recherche en art et le recours aux nouveaux médias, mais la plupart avaient cessé leurs activités avant même de développer les ressources pour documenter les processus et préserver les résuItats. J'ai obtenu chaque enregistrement et information que j'ai rassemblés, depuis le milieu des années 1970, en contactant directement chacun des compositeurs. Avec le temps, j'ai constitué des archives personnelles, modestes mais croissantes, comprenant des notes de programme de concerts, livres, bulletins, magazines et revues, partitions, lettres, courriels et des enregistrements sur bobines, cassettes analogiques et quelques vinyles 33 tours. J'ai décidé de partager mes trésors avec des collègues et étudiants et d'explorer des solutions pour les rendre accessibles au plus grand nombre possible. Il y a quelques années, l'UNESCO m'a demandé de rédiger des rapports sur la musique électroacoustique latino-américaine et les arts médiatiques. Les textes de cette recherche ont contribué à diffuser de l'information sur le travail de beaucoup d'artistes latino-américains. Afin de rendre également accessible au public les oeuvres musicales, et sauvegarder le matériel, j'ai cherché un endroit où la préservation des enregistrements était non seulement importante mais aussi possible. J'estimais que la fondation Daniel Langlois pour l'art, la science et la technologie à Montréal était le lieu idéal pour mon projet. Mes activités continues durant près de 28 mois comme chercheur en résidence à la fondation Daniel Langlois m'ont permis de numériser et convertir des enregistrements à partir de différents formats, faire du montage au besoin et verser dans la base de données de la Fondation tous les renseignements sur les pièces (titre, compositeur, année de composition, instrumentation, notes de programme, studio de production, version, durée, bio du compositeur, etc.). À ce jour, janvier 2006, il y a 2152 fichiers audio numériques qui sont archivés au Centre de recherche et de documentation (CR+D) de la fondation. En complément à cette thèse de doctorat, j'ai développé une collection d'enregistrements musicaux maintenant disponibles au public. Cette collection est constituée du résultat de mes recherches (textes, oeuvres musicales, quelques partitions et photographies historiques, entrevues) et diffusée sur le site Web de la fondation Daniel Langlois. Les archives comptent des pièces pour médias fixes ainsi que des oeuvres mixtes pour instruments acoustiques ou voix et médias fixes ou systèmes électroniques interactifs en direct (1722 compositions). Les archives comprennent aussi des enregistrements audio et audiovisuels d'entrevues avec des compositeurs et des novateurs techniques ainsi que des\ud photographies, des vidéos, et quelques très rares partitions.\ud Une grande partie de l'information textuelle contenue dans la base de données des fichiers de musique est accessible par le site Web de la fondation Daniel Langlois. L'information complète (ex. notes de programme) et tous les enregistrements sont accessibles au CR+D. Une courte sélection de pièces est aussi accessible pour écoute sur le site Web. La plupart des compositeurs représentés dans ces archives et dans cette dissertation sont nés dans des pays d'Amérique latine. Il y a aussi quelques compositeurs qui, bien que n'étant pas originaires de la région, ont poursuivi au moins une partie de leur carrière musicale en Amérique latine.\ud Cette thèse renferme de l'information sur des compositeurs liés à 18 pays d'Amérique latine: Argentine, Bolivie, Brésil, Chili, Colombie, Costa Rica, Cuba, République dominicaine, Équateur, El Salvador, Guatemala, Mexico, Panama, Paraguay, Pérou, Porto Rico, Uruguay et Venezuela. Les archives contiennent des enregistrements de compositeurs de tous les pays mentionnés. J'espère que ce texte incitera à explorer ce merveilleux univers musical plutôt inconnu, créé par des centaines de compositeurs latino-américains au cours des dernières décennies. ______________________________________________________________________________ MOTS-CLÉS DE L’AUTEUR : musique électroacoustique, Amérique latine, art et nouvelles technologies, éthique, mémoire, culture, contexte, pionniers, interdisciplinarité

Joining Forces in Technology: Three Analytical Case Studies of Early Corporate-Sponsored Electronic Music

The close of World War II and the advent of the Cold War had effects far beyond the oft-explored realms of global alliances and domestic policy; this dissertation traces a path exploring how these grand geopolitical factors, and accompanying patterns in knowledge production, filtered from the larger intellectual climate to more localized cultural and artistic trends. I seek to show how application-focused trends in postwar knowledge and technology production (termed “Mode 2” by Michael Gibbons, Camille Limoges, Helga Nowotny, et al. in their 1994 book, The New Production of Knowledge: The Dynamics of Science and Research in Contemporary Societies) found an avenue into avant-garde art through the bourgeoning field of electronic music. This represents a break with historical trends, since the arts have generally functioned within older, discipline-focused, patronage-based models.In addition to exploring how the historical context of the early Cold War informed the development of knowledge production generally, and electronic music specifically, I focus on three composers' activities at early electroacoustic studios in the years 1955-1965, as well as their accompanying sponsors: Milton Babbitt and the RCA Synthesizer at the Columbia-Princeton Electronic Music Studio; Mauricio Kagel at the Siemens Studio for Electronic Music in Munich; and Toru Takemitsu at Sony's Electronic Music Studios in Tokyo. I hope to show how the broader intellectual climate of the United States and its satellites in the early Cold War period helped to shape both how a number of electroacoustic music studios were established, and how music was conceived of and composed there. Ultimately, I also aim to understand how these pieces fit into their composers' larger output and individual artistic goals, while at the same time using these cases to develop a more nuanced understanding of the broader cultural significance of early electronic music

A methodology for investigation of bowed string performance through measurement of violin bowing technique

Thesis (Ph. D.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2007.Includes bibliographical references (leaves 181-186).Virtuosic bowed string performance in many ways exemplifies the incredible potential of human physical performance and expression. Today, a great deal is known about the physics of the violin family and those factors responsible for its sound capabilities. However, there remains much to be discovered about the intricacies of how players control these instruments in order to achieve their characteristic range and nuance of sound. Today, technology offers the ability to study this player control under realistic, unimpeded playing conditions to lead to greater understanding of these performance skills. Presented here is a new methodology for investigation of bowed string performance that uses a playable hardware measurement system to capture the gestures of right hand violin bowing technique. Building upon previous Hyperstring research, this measurement system was optimized to be small, lightweight, and portable and was installed on a carbon fiber violin bow and an electric violin to enable study of realistic, unencumbered violin performances. Included in the system are inertial and force sensors, and an electric field position sensor. In order to maximize the applicability of the gesture data provided by this system to related fields of interest, all of the sensors were calibrated in SI units.(cont.) The gesture data captured by these sensors are recorded together with the audio data from the violin as they are produced by violinists in typical playing scenarios. To explore the potential of the bowing measurement system created, a study of standard bowing techniques, such as detache, martele and spiccato, was conducted with expert violinist participants. Gesture data from these trials were evaluated and input to a classifier to examine physical distinctions between bowing techniques, as well as between players. Results from this analysis, and their implications on this methodology will be presented. In addition to this examination of bowing techniques, applications of the measurement system for study of bowed string acoustics and digital music instrument performance, with focus on virtual instruments created from physical models, will be discussed.by Diana Young.Ph.D