Analysis and resynthesis of polyphonic music

This thesis examines applications of Digital Signal Processing to the analysis, transformation, and resynthesis of musical audio. First I give an overview of the human perception of music. I then examine in detail the requirements for a system that can analyse, transcribe, process, and resynthesise monaural polyphonic music. I then describe and compare the possible hardware and software platforms. After this I describe a prototype hybrid system that attempts to carry out these tasks using a method based on additive synthesis. Next I present results from its application to a variety of musical examples, and critically assess its performance and limitations. I then address these issues in the design of a second system based on Gabor wavelets. I conclude by summarising the research and outlining suggestions for future developments

Design Strategies for Adaptive Social Composition: Collaborative Sound Environments

In order to develop successful collaborative music systems a variety of subtle interactions need to be identified and integrated. Gesture capture, motion tracking, real-time synthesis, environmental parameters and ubiquitous technologies can each be effectively used for developing innovative approaches to instrument design, sound installations, interactive music and generative systems. Current solutions tend to prioritise one or more of these approaches, refining a particular interface technology, software design or compositional approach developed for a specific composition, performer or installation environment. Within this diverse field a group of novel controllers, described as ‘Tangible Interfaces’ have been developed. These are intended for use by novices and in many cases follow a simple model of interaction controlling synthesis parameters through simple user actions. Other approaches offer sophisticated compositional frameworks, but many of these are idiosyncratic and highly personalised. As such they are difficult to engage with and ineffective for groups of novices. The objective of this research is to develop effective design strategies for implementing collaborative sound environments using key terms and vocabulary drawn from the available literature. This is articulated by combining an empathic design process with controlled sound perception and interaction experiments. The identified design strategies have been applied to the development of a new collaborative digital instrument. A range of technical and compositional approaches was considered to define this process, which can be described as Adaptive Social Composition. Dan Livingston

1990-1995 Brock Campus News

A compilation of the administration newspaper, Brock Campus News, for the years 1990 through 1995. It had previously been titled The Blue Badger

Un voyage du son par les fils électroacoustiques : l'art et les nouvelles technologies en Amérique Latine

L'histoire de la musique électroacoustique latino-américaine est longue, intéressante et prolifique, mais peu connue, même régionalement. De nombreux compositeurs nés ou vivants en Amérique latine ont été très actifs à ce titre, dans certains pays depuis plus de 50 ans, mais la disponibilité de l'information et des enregistrements de musique électroacoustique à cet égard et dans cette région a posé de sérieux problèmes aux éducateurs, compositeurs, interprètes, chercheurs, étudiants et au public en général.\ud Compte tenu de cette situation, la question suivante s'est imposée comme point de départ de ma thèse: comment s'est développée la tradition de la création musicale avec les médias électroacoustiques en Amérique Latine. Pour y répondre, j'ai adopté une approche historique en utilisant une méthodologie ethnographique (caractérisée par une immersion à long terme dans le domaine, par des contacts personnels avec des compositeurs et par ma participation et mon souci en ce qui concerne l'évolution des arts faisant appel aux nouvelles technologies en Amérique Latine) dans toute ma recherche. Ayant commencé à travailler dans le domaine de la musique électroacoustique au milieu des années 1970 dans mon Argentine natale, il m'a été très difficile d'obtenir de l'information sur les activités reliées à ce domaine dans des pays voisins et même dans ma propre ville. Bien que difficile, il était néanmoins possible de trouver les enregistrements de compositeurs vivant en Europe ou en Amérique du Nord, mais plus ardu de trouver ceux réalisés par des compositeurs locaux ou régionaux. Dans divers pays d'Amérique latine, les universités, les organismes d'état et de grandes fondations privées avaient de temps en temps pris l'initiative de soutenir la recherche en art et le recours aux nouveaux médias, mais la plupart avaient cessé leurs activités avant même de développer les ressources pour documenter les processus et préserver les résuItats. J'ai obtenu chaque enregistrement et information que j'ai rassemblés, depuis le milieu des années 1970, en contactant directement chacun des compositeurs. Avec le temps, j'ai constitué des archives personnelles, modestes mais croissantes, comprenant des notes de programme de concerts, livres, bulletins, magazines et revues, partitions, lettres, courriels et des enregistrements sur bobines, cassettes analogiques et quelques vinyles 33 tours. J'ai décidé de partager mes trésors avec des collègues et étudiants et d'explorer des solutions pour les rendre accessibles au plus grand nombre possible. Il y a quelques années, l'UNESCO m'a demandé de rédiger des rapports sur la musique électroacoustique latino-américaine et les arts médiatiques. Les textes de cette recherche ont contribué à diffuser de l'information sur le travail de beaucoup d'artistes latino-américains. Afin de rendre également accessible au public les oeuvres musicales, et sauvegarder le matériel, j'ai cherché un endroit où la préservation des enregistrements était non seulement importante mais aussi possible. J'estimais que la fondation Daniel Langlois pour l'art, la science et la technologie à Montréal était le lieu idéal pour mon projet. Mes activités continues durant près de 28 mois comme chercheur en résidence à la fondation Daniel Langlois m'ont permis de numériser et convertir des enregistrements à partir de différents formats, faire du montage au besoin et verser dans la base de données de la Fondation tous les renseignements sur les pièces (titre, compositeur, année de composition, instrumentation, notes de programme, studio de production, version, durée, bio du compositeur, etc.). À ce jour, janvier 2006, il y a 2152 fichiers audio numériques qui sont archivés au Centre de recherche et de documentation (CR+D) de la fondation. En complément à cette thèse de doctorat, j'ai développé une collection d'enregistrements musicaux maintenant disponibles au public. Cette collection est constituée du résultat de mes recherches (textes, oeuvres musicales, quelques partitions et photographies historiques, entrevues) et diffusée sur le site Web de la fondation Daniel Langlois. Les archives comptent des pièces pour médias fixes ainsi que des oeuvres mixtes pour instruments acoustiques ou voix et médias fixes ou systèmes électroniques interactifs en direct (1722 compositions). Les archives comprennent aussi des enregistrements audio et audiovisuels d'entrevues avec des compositeurs et des novateurs techniques ainsi que des\ud photographies, des vidéos, et quelques très rares partitions.\ud Une grande partie de l'information textuelle contenue dans la base de données des fichiers de musique est accessible par le site Web de la fondation Daniel Langlois. L'information complète (ex. notes de programme) et tous les enregistrements sont accessibles au CR+D. Une courte sélection de pièces est aussi accessible pour écoute sur le site Web. La plupart des compositeurs représentés dans ces archives et dans cette dissertation sont nés dans des pays d'Amérique latine. Il y a aussi quelques compositeurs qui, bien que n'étant pas originaires de la région, ont poursuivi au moins une partie de leur carrière musicale en Amérique latine.\ud Cette thèse renferme de l'information sur des compositeurs liés à 18 pays d'Amérique latine: Argentine, Bolivie, Brésil, Chili, Colombie, Costa Rica, Cuba, République dominicaine, Équateur, El Salvador, Guatemala, Mexico, Panama, Paraguay, Pérou, Porto Rico, Uruguay et Venezuela. Les archives contiennent des enregistrements de compositeurs de tous les pays mentionnés. J'espère que ce texte incitera à explorer ce merveilleux univers musical plutôt inconnu, créé par des centaines de compositeurs latino-américains au cours des dernières décennies. ______________________________________________________________________________ MOTS-CLÉS DE L’AUTEUR : musique électroacoustique, Amérique latine, art et nouvelles technologies, éthique, mémoire, culture, contexte, pionniers, interdisciplinarité

Ontology of music performance variation

Performance variation in rhythm determines the extent that humans perceive and feel the effect of rhythmic pulsation and music in general. In many cases, these rhythmic variations can be linked to percussive performance. Such percussive performance variations are often absent in current percussive rhythmic models. The purpose of this thesis is to present an interactive computer model, called the PD-103, that simulates the micro-variations in human percussive performance. This thesis makes three main contributions to existing knowledge: firstly, by formalising a new method for modelling percussive performance; secondly, by developing a new compositional software tool called the PD-103 that models human percussive performance, and finally, by creating a portfolio of different musical styles to demonstrate the capabilities of the software. A large database of recorded samples are classified into zones based upon the vibrational characteristics of the instruments, to model timbral variation in human percussive performance. The degree of timbral variation is governed by principles of biomechanics and human percussive performance. A fuzzy logic algorithm is applied to analyse current and first-order sample selection in order to formulate an ontological description of music performance variation. Asynchrony values were extracted from recorded performances of three different performance skill levels to create \timing fingerprints" which characterise unique features to each percussionist. The PD-103 uses real performance timing data to determine asynchrony values for each synthesised note. The spectral content of the sample database forms a three-dimensional loudness/timbre space, intersecting instrumental behaviour with music composition. The reparameterisation of the sample database, following the analysis of loudness, spectral flatness, and spectral centroid, provides an opportunity to explore the timbral variations inherent in percussion instruments, to creatively explore dimensions of timbre. The PD-103 was used to create a music portfolio exploring different rhythmic possibilities with a focus on meso-periodic rhythms common to parts of West Africa, jazz drumming, and electroacoustic music. The portfolio also includes new timbral percussive works based on spectral features and demonstrates the central aim of this thesis, which is the creation of a new compositional software tool that integrates human percussive performance and subsequently extends this model to different genres of music

Towards an interactive framework for robot dancing applications

Estágio realizado no INESC-Porto e orientado pelo Prof. Doutor Fabien GouyonTese de mestrado integrado. Engenharia Electrotécnica e de Computadores - Major Telecomunicações. Faculdade de Engenharia. Universidade do Porto. 200

Music and Digital Media

Anthropology has neglected the study of music. Music and Digital Media shows how and why this should be redressed. It does so by enabling music to expand the horizons of digital anthropology, demonstrating how the field can build interdisciplinary links to music and sound studies, digital/media studies, and science and technology studies. Music and Digital Media is the first comparative ethnographic study of the impact of digital media on music worldwide. It offers a radical and lucid new theoretical framework for understanding digital media through music, showing that music is today where the promises and problems of the digital assume clamouring audibility. The book contains ten chapters, eight of which present comprehensive original ethnographies; they are bookended by an authoritative introduction and a comparative postlude. Five chapters address popular, folk, art and crossover musics in the global South and North, including Kenya, Argentina, India, Canada and the UK. Three chapters bring the digital experimentally to the fore, presenting pioneering ethnographies of anextra-legal peer-to-peer site and the streaming platform Spotify, a series of prominent internet-mediated music genres, and the first ethnography of a global software package, the interactive music platform Max. The book is unique in bringing ethnographic research on popular, folk, art and crossover musics from the global North and South into a comparative framework on a large scale, and creates an innovative new paradigm for comparative anthropology. It shows how music enlarges anthropology while demanding to be understood with reference to classic themes of anthropological theory. Praise for Music and Digital Media ‘Music and Digital Media is a groundbreaking update to our understandings of sound, media, digitization, and music. Truly transdisciplinary and transnational in scope, it innovates methodologically through new models for collaboration, multi-sited ethnography, and comparative work. It also offers an important defense of—and advancement of—theories of mediation.’ Jonathan Sterne, Communication Studies and Art History, McGill University 'Music and Digital Media is a nuanced exploration of the burgeoning digital music scene across both the global North and the global South. Ethnographically rich and theoretically sophisticated, this collection will become the new standard for this field.' Anna Tsing, Anthropology, University of California at Santa Cruz 'The global drama of music's digitisation elicits extreme responses – from catastrophe to piratical opportunism – but between them lie more nuanced perspectives. This timely, absolutely necessary collection applies anthropological understanding to a deliriously immersive field, bringing welcome clarity to complex processes whose impact is felt far beyond what we call music.' David Toop, London College of Communication, musician and writer ‘Spanning continents and academic disciplines, the rich ethnographies contained in Music and Digital Media makes it obligatory reading for anyone wishing to understand the complex, contradictory, and momentous effects that digitization is having on musical cultures.’ Eric Drott, Music, University of Texas, Austin ‘This superb collection, with an authoritative overview as its introduction, represents the state of the art in studies of the digitalisation of music. It is also a testament to what anthropology at its reflexive best can offer the rest of the social sciences and humanities.’ David Hesmondhalgh, Media and Communication, University of Leeds ‘This exciting volume forges new ground in the study of local conditions, institutions, and sounds of digital music in the Global South and North. The book’s planetary scope and its commitment to the “messiness” of ethnographic sites and concepts amplifies emergent configurations and meanings of music, the digital, and the aesthetic.’ Marina Peterson, Anthropology, University of Texas, Austi

Music and Digital Media: A planetary anthropology

Anthropology has neglected the study of music. Music and Digital Media shows how and why this should be redressed. It does so by enabling music to expand the horizons of digital anthropology, demonstrating how the field can build interdisciplinary links to music and sound studies, digital/media studies, and science and technology studies. Music and Digital Media is the first comparative ethnographic study of the impact of digital media on music worldwide. It offers a radical and lucid new theoretical framework for understanding digital media through music, showing that music is today where the promises and problems of the digital assume clamouring audibility. The book contains ten chapters, eight of which present comprehensive original ethnographies; they are bookended by an authoritative introduction and a comparative postlude. Five chapters address popular, folk, art and crossover musics in the global South and North, including Kenya, Argentina, India, Canada and the UK. Three chapters bring the digital experimentally to the fore, presenting pioneering ethnographies of an extra-legal peer-to-peer site and the streaming platform Spotify, a series of prominent internet-mediated music genres, and the first ethnography of a global software package, the interactive music platform Max. The book is unique in bringing ethnographic research on popular, folk, art and crossover musics from the global North and South into a comparative framework on a large scale, and creates an innovative new paradigm for comparative anthropology. It shows how music enlarges anthropology while demanding to be understood with reference to classic themes of anthropological theory

A neurally-inspired musical instrument classification system based upon the sound onset

Physiological evidence suggests that sound onset detection in the auditory system may be performed by specialized neurons as early as the cochlear nucleus. Psychoacoustic evidence shows that the sound onset can be important for the recognition of musical sounds. Here the sound onset is used in isolation to form tone descriptors for a musical instrument classification task. The task involves 2085 isolated musical tones from the McGill dataset across five instrument categories. A neurally inspired tone descriptor is created using a model of the auditory system's response to sound onset. A gammatone filterbank and spiking onset detectors, built from dynamic synapses and leaky integrate-and-fire neurons, create parallel spike trains that emphasize the sound onset. These are coded as a descriptor called the onset fingerprint. Classification uses a time-domain neural network, the echo state network. Reference strategies, based upon mel-frequency cepstral coefficients, evaluated either over the whole tone or only during the sound onset, provide context to the method. Classification success rates for the neurally-inspired method are around 75%. The cepstral methods perform between 73% and 76%. Further testing with tones from the Iowa MIS collection shows that the neurally inspired method is considerably more robust when tested with data from an unrelated dataset