Composing with soundscapes : capturing and analysing urban audio for a Raw Musical interpretation

The sound environment is increasingly more relevant in contemporary culture. It is a ‘picture’ of a place, an X-ray of its character and activities, shapeless and amorphous, whilst full of meanings and subtleties. It is a transmission that is complementary to what a picture retains and transports. Therefore it is a unique, tangible impression of the place to which it belongs, and intrinsically, its history, and that of the people who inhabit it, and their relations. Murray Schafer termed this element as Soundscape. Although always a present element, it was only from the end of the Twentieth Century that it has been studied in a systematic way, initially in a more ecological and socio-cultural function approach, but slowly it has been seen as an artistic tool, both in direct use of the sounds as well as being an inspiration, and a starting point, for creation. The exploratory research project presented here aims to study the capture and analysis of the urban soundscape, with a special focus on its temporal evolution, and its application in the creative and artistic context. At the first stage, we try to understand how and, if possible, to capture and represent the most challenging part of this massive sound element, which is its constant changing on the time axis. Grasping its nuances on both small and large time scales. The second phase is to understand the pertinence of such information and its direct influence in the act of music and sonic creation. To achieve these goals a multidisciplinary approach based on two main pillars was necessary: Soundscape and Computer Music. These disciplines determine the scientific areas in which this research had to be focused. Due to the fact that this thesis has a relatively broad scope of interests, there is a survey of the state of the art relating to projects and approaches that relate to the interests of this investigation in different ways. In areas such as: Music Information Retrieval, Algorithmic Composition, Eco Composition, and Sound Maps. This survey confirms the contemporaneity, relevance and originality of the project, both scientifically and artistically. In order to evaluate the proposed approach to the soundscape, URB, an experimental system to capture, analyse and store the urban soundscape was developed and implemented. The system is based on current technology, but is affordable and robust. To ensure the sustainability of the project, development was based in open source technology, to ensure the possibility of the project expanding and shaping according to the interests and needs of specific places, populations, research centres and/or artistic interests. Three main goals have guided the development of this system: addressing the lack of temporal perspective of the sound representation of urban spaces; the design of a free and autonomous system that depends only on the users, which results in a public free access database; to facilitate and systematize the access to data on the sound characteristics of an urban soundscape for both ecological studies as well as for creative and artistic purposes. A server keeps a record of the collected data, which can either be read directly, through an application developed for this purpose, or through a visual interface with a time-line approach, but always allowing for the possibility of creating original access tools that best serve the user’s purposes. After implementing the system, through four listening points, and confirming its robustness, we advance to the system’s application in the development of artistic works. For this purpose a challenge was proposed to a number of artists with distinct aesthetic backgrounds and training. This challenge resulted in different works that were presented to the public in different formats and media, such as works for classical instrumental, electro-acoustic works, improvisational moments with real-time sonification of the soundscape, sonic installations and sculptures powered by the system presented. This practice leads to a fundamental reflection in this research. We describe the different approaches chosen by each creator and primarily assess the pertinence in the artistic result of using a continuous and discrete system of urban soundscape analysis, from a creator’s point of view as well as from a listener’s point of view. With this research we are able to present a functional approach to the lack of temporal perspective in the usual sound maps that focus on the geographic origin of the recordings. We conclude that soundscapes can provide useful data for artistic creation and we promote a direct connection between that kind of approach and the artists. Even before the works developed and the artist’s feedback, whilst not ignoring the different approaches and opinions, we can conclude that this approach seems to promote new and functional soundscape composition ideas, making URB a relevant resource to compose original soundscape based music. Also, through analysis of the pieces, we could point out patterns of the technical and artistic choices on how to deal with information from the soundscape data, both in deferred time and real-time.A paisagem sonora é cada vez mais relevante na cultura contemporânea. É uma ‘fotografia’ de um lugar. Uma radiografia ao seu carácter e atividades, simultaneamente disforme e amorfa como repleta de significados e subtilezas. Uma transmissão complementar ao que a imagem retém e transporta. É portanto uma impressão única , tangível do lugar a que pertence e, intrinsecamente , da sua história , das pessoas que o habitam, das suas relações. Murray Schafer batizou este elemento como Soundscape (Paisagem Sonora). E embora tenha sido sempre um elemento presente, só a partir do final do séc. XX é que tem vindo a ser estudado de uma forma sistematizada, inicialmente numa abordagem mais ecológica e das suas funções socioculturais, mas lentamente encarado como uma ferramenta artística tanto no uso direto dos sons, como sendo o ponto de partida de inspiração para a criação. O projeto de investigação de carácter exploratório que aqui apresentamos visa o estudo da recolha e análise da paisagem sonora urbana, com especial enfoque na sua evolução temporal e da sua aplicação no contexto criativo artística. Como tal, numa fase inicial, procurar entender como e, se possível, capturar e representar o elemento mais desafiante que é a permanente mutação sonora no eixo temporal, apreendendo as suas nuances tanto numa escala de tempo diminuta como em grandes escalas temporais. Numa segunda fase entender a pertinência desta informação e da sua influência direta no ato da criação musical e sonora. Para cumprir estes objectivos foi necessária uma abordagem multidisciplinar fundamentada em dois pilares principais: Paisagem-Sonora e Informática Musical. Estas disciplinas determinam as áreas científicas em que esta investigação se debruçou. Tendo esta tese um âmbito de interesses relativamente amplo, há um levantamento do estado da arte referente a projetos e abordagens de áreas distintas que ,de diferentes formas , se relaciona com os interesses da nossa investigação. Em áreas como: Musical Information Retrieval, Composição Algorítmica, Eco Composição, Mapas Sonoros. Este levantamento confirma a atualidade, a pertinência e a originalidade do projeto, tanto cientificamente como artisticamente. A fim de avaliar a abordagem proposta à paisagem sonora, foi desenvolvido e posto em prática um sistema experimental de captura, análise e armazenamento de ambiente sonoro urbano, de nome URB. Sistema esse baseado em tecnologia atual, mas acessível e robusta para garantir a sustentabilidade do projeto e apoiado em desenvolvimento código aberto para garantir a possibilidade do projeto se expandir e se moldar de acordo com os interesses e necessidades concretas de locais, populações, centros de investigação e interesses artísticos. Três objetivos principais guiaram o desenvolvimento deste sistema: colmatar a falta de perspectiva temporal em grande escala de uma representação sonora de um espaço urbano; o desenho de um sistema que livre e autónomo, que apenas dependa dos utilizadores, que resulte numa base de dados de acesso público e gratuito; facilitar e sistematizar o acesso à informação sobre as caraterísticas sonoras de um ambiente sonoro urbano tanto para estudos ecológicos como para função criativa e artística. É mantido num servidor o registo de toda a informação recolhida, que tanto pode ser consultado diretamente, através de uma aplicação desenvolvida para o efeito, através de um interface visual ao estilo de linha temporal, deixando sempre a possibilidade para a criação de ferramentas de acesso originais que sirvam melhor os propósitos do utilizador. Após a implementação do sistema, através de quatro pontos de escuta, e a confirmação da sua robustez, avançamos para a aplicação do sistema no desenvolvimento de obras artísticas. Para tal, foi lançado um desafio a um conjunto de artistas que partem de diferentes formações e identidades estéticos. Esse desafio resultou em diferentes obras que foram apresentadas ao público com diferentes formatos e suportes, como obras integralmente para formatos instrumentais clássicos, obras electroacústicas, momentos de improvisação em tempo real com a sonorização do ambiente sonoro, instalações e esculturas sonoras alimentadas pelo sistema apresentado. Desta prática resulta uma reflexão fundamental nesta investigação. Descrevemos as diferentes abordagens escolhidas por cada criador e acima de tudo avaliamos a pertinência no resultado artístico do uso de um sistema contínuo e discreto de análise de ambiente sonoro urbano, tanto do ponto de vista do criador como do ponto de vista do ouvinte. A partir desta investigação, apresentamos uma abordagem funcional para a falta de perspectiva temporal nos mapas sonoros clássico que incidem principalmente sobre as origens geográfica das gravações. Concluímos que as paisagens sonoras podem fornecer dados úteis para a criação artística e promovemos uma conexão direta entre essa abordagem e os artistas. Perante os trabalhos e análises desenvolvidos por diferentes criadores, concluímos que esta aproximação promove ideias novas e funcionais para a composição. Além disso, através da análise de peças, apontamos padrões nas escolhas técnicas e estéticas sobre como lidar com as informações a partir dos dados da paisagem sonora, tanto em tempo diferido como em tempo real

Acoustic Ecology and Sound Mapping the University of Central Florida Main Campus

Acoustic Ecology and Sound Mapping the University of Central Florida Main Campus explores the intersection of place and space, sound studies and acoustic ecology, visualization, and archives. The end result consists of a collection of soundwalk and stationary recordings conducted from 2016-2019 at the University of Central Florida (UCF) main campus in Orlando presented as an online Sound Map. This archive previously did not exist and provides a snapshot of the various sounds heard throughout the campus as well as a starting point and context for future research into this still-emerging field of acoustic ecology and sound studies. While the individual recordings help to provide a sense of place at the university, they also represent a benchmark from a public history standpoint to interpret sonic change over time

Developing the New Zealand Soundmap: An exploration of soundmap practice, site listening, locative media and the sound environment

This text is an exegesis written in accompaniment to the development of the New Zealand Soundmap. The origin and development of soundmap practice and the emergence and development of related environmental sound practices are detailed. The exegesis concludes with an exposition of the development of the New Zealand Soundmap itself. Soundmap practice emerged from the sonic explorations of the World Soundscape Project, who coming out of Simon Fraser University of Burnaby, British Columbia, Canada, pioneered the first soundmaps in the early 1970’s. From its origins soundmap practice has spread and developed into its current form as a new media practice. This thesis deals with the development of a regional web-based soundmap for New Zealand. Various discursive strains from media studies, sonic arts, and phenomenological philosophy are woven together to explain the impetus, and value of soundmap practice and related environmental sound practices such as soundwalks and site-listening. The thesis ends with a critical analysis of successes and failures of the project towards its stated goal: to facilitate awareness of an engagement with the local sound environment

Thoughts in the Field: 'Self-reflexive narrative' in field recording

This article considers the presence of ‘self-reflexive narrative’ in field recording. The authors interrogate a common presumption within sonic arts practice and sound studies discourse that field recordings represent authentic, impartial and neutral documents. Historically, field recording practice has not clearly represented narratives of how, when, why and by whom a field recording is made. In contrast, the social sciences have already experienced a narrative ‘turn’ since the 1970s, which highlighted the importance of recognising the presence and role of the researcher in the field, and also in representations of fieldwork. This provides an alternative framework for understanding field recording, in considering the importance of the recordist and their relationship with their recordings. Many sonic arts practitioners have already acknowledged that the subjective, personal qualities of field recording should be embraced, highlighted and even orated in their work. The authors’ own collaborative project Thoughts in the Field further explores these ideas, by vocalising ‘self-reflexive narratives’ in real time, within field recordings. The authors’ collaborative composition, Getting Lost (2015), demonstrates the compositional potentials this approach offers

16th Sound and Music Computing Conference SMC 2019 (28–31 May 2019, Malaga, Spain)

The 16th Sound and Music Computing Conference (SMC 2019) took place in Malaga, Spain, 28-31 May 2019 and it was organized by the Application of Information and Communication Technologies Research group (ATIC) of the University of Malaga (UMA). The SMC 2019 associated Summer School took place 25-28 May 2019. The First International Day of Women in Inclusive Engineering, Sound and Music Computing Research (WiSMC 2019) took place on 28 May 2019. The SMC 2019 TOPICS OF INTEREST included a wide selection of topics related to acoustics, psychoacoustics, music, technology for music, audio analysis, musicology, sonification, music games, machine learning, serious games, immersive audio, sound synthesis, etc

Acoustic Atlas - Auralisation in the Browser

The Acoustic Atlas project, funded by the European Commission, explores a new model for experiencing scientific acoustic heritage data in the form of room impulse responses (RIRs), as real-time auralisations. The browser-based Web Audio application functions on any smart mobile device or computer running a web browser. It utilises the built-in microphone and headphone output of the device to transport the user to a selected heritage site via headphones and a live microphone feed. Users are able to emit sounds to hear the reflections from a first-person point of hearing. Researchers in the field of heritage acoustics have advocated for the importance of acoustical studies and their historical, artistic and spiritual value. However, heritage sites still prioritise dissemination through visual means, such as maps, 3D models, photographs and videos. Where acoustic research is available, it is mostly published in text form through the analysis of objective acoustical parameters. When attempting to access auralisations, the search becomes difficult and fragmented. Acoustic Atlas provides real-time auralisations to wide audiences, beyond those already working in the field of heritage acoustics and, as a result, contributes to the awareness of the importance of listening and the preservation of sonic heritage. The present paper explores the web architecture of the project that utilises the Web Audio API and Tone.js which currently enables auralisations at acceptable latency. It also looks into achieving synchronisation between B-format RIRs and 360 head positioning in the browser, in real-time

An interactive sonic environment derived from commuters' memories of the soundscape: a case study of the London Underground

Through interrelating the Acoustic Communication concepts of soundscape with contemporary collective memory studies, this research project explores the relationship between commuters and the London Underground (LU) soundscape in order to create an interactive sonic environment on the Internet. The methodology combines fieldwork and artistic work, focusing on commuters’ perceptions of time and space, and on their sonic memories, as elements through which to interpret the space. The objective of the fieldwork is to investigate commuters’ aural memories of the LU soundscape, including the feelings and sensations that it stimulates. The artistic objective is to facilitate the interaction between the soundscape and its users through an interface that allows a creative combination of sounds to assemble aural memories into a sound-driven multimedia experience. Twenty-four commuters participated in the ethnographic study during the three phases of the research; they followed the researcher’s model, which combines the processes of listening and remembering. The researcher thus developed an interactive sonic environment where commuters can experience a non-linear virtual journey through the soundscape of LU, then apply this as a means of reflecting on the original commuting experience. The interactive nature of the process makes it possible for individual memories to be linked in a creative shared experience; it fosters the development of on-line sound-driven narratives.http://soundingunderground.or

Distributed Networks of Listening and Sounding: 20 Years of Telematic Musicking

This paper traces a twenty-year arc of my performance and compositional practice in the medium of telematic music, focusing on a distinct approach to fostering interdependence and emergence through the integration of listening strategies, electroacoustic improvisation, pre-composed structures, blended real/virtual acoustics, networked mutual-influence, shared signal transformations, gesture-concepts and machine agencies. Communities of collaboration and exchange over this time period are discussed, which span both pre- and post-pandemic approaches to the medium that range from metaphors of immersion and dispersion to diffraction

Digital Sound Studies

The digital turn has created new opportunities for scholars across disciplines to use sound in their scholarship. This volume’s contributors provide a blueprint for making sound central to research, teaching, and dissemination. They show how digital sound studies has the potential to transform silent, text-centric cultures of communication in the humanities into rich, multisensory experiences that are more inclusive of diverse knowledges and abilities. Drawing on multiple disciplines—including rhetoric and composition, performance studies, anthropology, history, and information science—the contributors to Digital Sound Studies bring digital humanities and sound studies into productive conversation while probing the assumptions behind the use of digital tools and technologies in academic life. In so doing, they explore how sonic experience might transform our scholarly networks, writing processes, research methodologies, pedagogies, and knowledges of the archive