Spectral tools for Dynamic Tonality and audio morphing

The analysis-resynthesis method used by the spectral toolbox allows the independent control of both frequency and amplitude for every partial in a given sound. The spectral toolbox begins by separating the 'signal' from the 'noise' which allows the peaks in the spectrum to be treated differently from the wide-band components. The spectral mapping technology is used to map the input to a fixed destination spectrum G like the SpT.Ntet routine maps all partials of the input sound to scale steps of the N-tone equal tempered scale that can be used to create sounds that are particularly appropriate for use in a given N-TET scale. Spectral morphing generates sound that moves smoothly between a source spectrum F and a destination spectrum G over a specified time t. A Dynamic Tonality synthesizer like Trans-FormSynth has a small number of parameters that enable many musically useful, and relatively, unexplored features like the continuous parameters α,β and γ move the tuning between a number of equal temperaments, non-equal temperaments and circulating temperaments

A psychoacoustic model of harmonic cadences: a preliminary report

This report presents a psychoacoustically derived computational model of the perceived distance between any two major or minor triads, the degree of activity created by any given pair of triads, and the cadential effectiveness of three-triad progressions. It also provides statistical analyses of the ratings given by thirty-five participants for the "similarity" and "fit" of triads in a pair, and the "cadential effectiveness" of three-triad progressions. Multiple regressions show that the model provides highly significant predictions of the experimentally obtained ratings. Finally, it is argued that because the model is based upon psychoacoustic axioms, it is likely the regression equations represent true causal models. As such, the computational model and its associated theory question the plausibility of theoretical approaches to tonality that use only long-term memory and statistical features, as well as those approaches based upon symmetrical geometrical structures like the torus. It is hoped that the psychoacoustic approach proposed here may herald not only the return of psychoacoustic approaches to tonal music theory, but also the exploration of the tonal possibilities offered by non-standard tunings and non-harmonic timbres

A MIDI sequencer that widens access to the compositional possibilities of novel tunings

We present a new Dynamic Tonality MIDI sequencer, Hex, that aims to make sequencing music in and across a large variety of novel tunings as straightforward as sequencing in twelve-tone equal temperament. It replaces the piano roll used in conventional MIDI sequencers with a two-dimensional lattice roll in order to enable the intuitive visualization and dynamic manipulation of tuning. In conventional piano roll sequencers, a piano keyboard is displayed on the left side of the window, and white and black note lanes extend horizontally to the right, into which a user can draw a sequence of notes. Similarly, in Hex, a button lattice is displayed in its own pane on the left side of the window, and horizontal lines are drawn from the center of each note to the right. These lines function as generalized note lanes, just like in piano roll sequencers, but with the added benefit that each note lane's height is always proportional to its pitch, even if the user changes the tuning. The presence of the button lattice on the left side of the window illustrates exactly which buttons a performer would play in order to replicate the sequence when playing a physical button lattice instrument

Composing with Sound-Objects: A Methodology

Technology presents us with the ability to record and manipulate the entire universe of sound in a musical composition. As a result, composers are faced with an overwhelming—often paralyzing—amount of available musical options. My methodology focuses on how a sound-object informs the organization, collection, manipulation, and culmination of a work of electronic music. I believe that breaking down the number of choices to manageable bite-sized portions helps minimize ambiguity, and imposing limits on musical parameters helps the composer focus on productive musical options. This is a methodology where the sound-object holds primacy over the work and serves as the motivic touchstone from which to make all compositional decisions.Part one of the dissertation provides a definition of a sound-object and an historical overview. Part two is my methodology, which is divided into three working stages: onset, continuant, and termination. The onset stage discusses a compositional approach to organizing a piece of music based on the sound-object as motivic touchstone; it introduces the organizational process according to functional considerations as well as conceptual approaches. The continuant stage is the composer’s playground where sound is transformed. It includes the technical and practical approaches used to assess the many parameters of a sound-object, as well as how the object itself informs the transformations. Additionally, the continuant stage represents an approach to composition and improvisation—informed by the sound-object—that uses acoustic instruments. Finally, the termination stage brings all these elements together in order to finish the piece. This stage explores how the sound-object can inform the structure of the piece at the subsequent levels of event, phrase, section, and overall form. I will demonstrate this methodology by explaining how I composed five original pieces with sound-objects—Acoustic Memories (2019), Modular Voices (2019), Interconnected (2019), Synthetic Objects (2019), and Gucci Concrète (2019). Through the framework presented in this methodology, composers of electronic music will better understand this flexible medium of composition, by moving beyond the traditional grid of discrete pitches and rhythms, in order to control the entire universe of sound for their palette of inspiration

The drum kit and the studio : a spectral and dynamic analysis of the relevant components

The research emerged from the need to understand how engineers perceive and record drum kits in modern popular music. We performed a preliminary, exploratory analysis of behavioural aspects in drum kit samples. We searched for similarities and differences, hoping to achieve further understanding of the sonic relationship the instrument shares with others, as well as its involvement in music making. Methodologically, this study adopts a pragmatic analysis of audio contents, extraction of values and comparison of results. We used two methods to analyse the data. The first, a generalised approach, was an individual analysis of each sample in the chosen eight classes (composed of common elements in modern drum kits). The second focused on a single sample that resulted from the down-mix of the previous classes’ sample pools. For the analysis, we handpicked several subjective and objective features as well as a series of low-level audio descriptors that hold information regarding the dynamic and frequency contents of the audio samples. We then conducted a series of processes, which included visual analysis of three-dimensional graphics and software-based information computing, to retrieve the analytical data. Results showed that there are some significant similarities among the classes’ audio features. This led to the assumption that the a priori experience of engineers could, in fact, be a collective and subconscious notion, instinctively achieved in a recording session. In fact, with more research concerning this subject, one may even find new a new way to deal with drum kits in a studio context, hastening time-consuming processes and strenuous tasks that are common when doing so.A investigação científica realizada no ramo do áudio e da música tornou-se abastada e prolífica, exibindo estudos com alto teor informativo para melhor compreensão das diferentes áreas de incidência. Muita da pesquisa desenvolvida foca-se em aspectos pragmáticos: reconhecimento de voz e de padrão, recuperação de informação musical, sistemas de mistura inteligente, entre outros. No entanto, embora estes sejam aspectos formais de elevada importância, tem-se notado uma latente falta de documentação relativa a aspectos mais idílicos e artísticos. O instrumento musical de estudo que escolhemos foi a bateria. Para além de uma vontade pessoal de entender a plenitude das suas características sónicas intrínsecas para aplicações prácticas com resultados tangíveis, é de notar a ausência de discurso e pesquisa científica que por este caminho se tenha aventurado. Não obstante, a bateria tem sido objecto de estudo profundo em contextos analíticos, motivo pelo qual foi também relevante originar a nossa abordagem seminal. Por um lado, as questões físicas de construção e manutenção de baterias, bem como aspectos de índole ambiental e de espaço (salas de gravação) são dos aspectos que mais efeitos produzem na diferença timbríca em múltiplos exemplos de gravações de baterias. No entanto, questões tonais (fundamentais para uma pluralidade de instrumentos) na bateria carecem de estudo e documentação num contexto mundial generalizado. São muitos os engenheiros de som e músicos que alimentam a ideia preconcebida da dificuldade inerente em relacionar este elemento percursivo com os restantes instrumentos numa música. Aliam-se a isto questões subjectivas de gosto e preferência, bem como outros métodos que facilitam a inserção de um instrumento rítmico e semi-harmónico (porque é possível escolher uma afinação para diferentes elementos de uma bateria) numa textura sonora que remete para diferentes conceitos musicais. Portanto, a questão nuclear que este estudo se foca é: “será possível atingir um som idílico nos diferentes elementos de uma bateria?”. Em si só, a ambiguidade desta resposta pode remeter para um conceito dogmático e inflexível, bem como para a ideia de que, até ao momento, nenhuma gravação ou som de bateria alcançou um patamar de extrema qualidade, sonoridade ou ubiquidade que a responda a esta premissa. Partimos, então, desta interrogação e procedemos a uma análise pragmática de amostras sonoras que fossem o mais assimiláveis possível a um contexto comercial. Reunimos amostras de oito classes pré-definidas: bombos, tarolas, pratos de choque, timbalões graves, médios e agudos, crashs e rides. As amostras derivaram de bibliotecas que foram reunidas posteriormente à realização de uma pesquisa em busca dos fabricantes mais conceituados, com maior adesão pública e com antecedentes comerciais tangíveis. Daqui recuperamos 481 amostras. Depois de reunidas, as amostras sofreram um processo de identificação e catalogação, passando também por alguns momentos de processamento de sinal (conversão para ficheiros monofónicos, igualização da duração e normalização do pico de sinal). Em seguida, através do software de computação matemática MATLAB, desenvolvemos linhas de código que foram instrumentais para fase da análise de características e descritores de ficheiros áudio. Finalmente, procedemos a uma reunião dos resultados obtidos e a iniciação de suposições que pudessem originar os valores extraídos. De entre os resultados obtidos, surgiram ideias que, com mais investigação, podem facilitar a compreensão do comportamento sonoro dos diferentes elementos, bem como a criação de métodos de conjugação harmónica entre eles. É importante referir que, neste estudo, partimos de um conceito qualitativo do som, e como tal, omitimos aspectos físicos que, na sua essência, influenciam substancialmente o som que é emitido. No entanto, este trabalho introdutório pretende retificar de forma preliminar esta falta de conceitos subjectivos com evidências palpáveis. Evidências essas que ainda necessitam de investigação adicional para a sua confirmação

Metrics for pitch collections

Models of the perceived distance between pairs of pitch collections are a core component of broader models of the perception of tonality as a whole. Numerous different distance measures have been proposed, including voice-leading, psychoacoustic, and pitch and interval class distances; but, so far, there has been no attempt to bind these different measures into a single mathematical framework, nor to incorporate the uncertain or probabilistic nature of pitch perception (whereby tones with similar frequencies may, or may not, be heard as having the same pitch). To achieve these aims, we embed pitch collections in novel multi-way expectation arrays, and show how metrics between such arrays can model the perceived dissimilarity of the pitch collections they embed. By modeling the uncertainties of human pitch perception, expectation arrays indicate the expected number of tones, ordered pairs of tones, ordered triples of tones and so forth, that are heard as having any given pitch, dyad of pitches, triad of pitches, and so forth. The pitches can be either absolute or relative (in which case the arrays are invariant with respect to transposition). We provide a number of examples that show how the metrics accord well with musical intuition, and suggest some ways in which this work may be developed

Notation Sequence Generation and Sound Synthesis in Interactive Spectral Music

Notation sequence generation and sound synthesis in interactive spectral music This thesis consists of a preliminary analysis of existing spectral music paradigms and proposes a methodology to address issues that arise in real-time spectral music composition and performance scenarios. This exploration involves an overview of meaning in spectral music with a particular focus on the ‘sonic object’ as a vehicle for expression. A framework for the production of ‘interactive spectral music’ was created. This framework takes form as a group of software based compositional tools called SpectraScore developed for the Max for Live platform. Primarily, these tools allow the user to analyse incoming audio and directly apply the collected data towards the generation of synthesised sound and notation sequences. Also presented is an extension of these tools, a novel system of correlation between emotional descriptors and spectrally derived harmonic morphemes. The final component is a portfolio of works created as examples of the techniques explored in scored and recorded form. As a companion to these works, an analysis component outlines the programmatic aspects of each piece and illustrates how they are executed within the music. Each scored piece corresponds with a recording of a live performance or performances of the work included in the attached DVD, which comprises individual realisations of the interactive works. Keywords: Spectralism, Music and Emotion, Electronic Music, Spectral Music, Algorithmic Music, Real-time Notatio

Notation Sequence Generation and Sound Synthesis in Interactive Spectral Music

Notation sequence generation and sound synthesis in interactive spectral music This thesis consists of a preliminary analysis of existing spectral music paradigms and proposes a methodology to address issues that arise in real-time spectral music composition and performance scenarios. This exploration involves an overview of meaning in spectral music with a particular focus on the ‘sonic object’ as a vehicle for expression. A framework for the production of ‘interactive spectral music’ was created. This framework takes form as a group of software based compositional tools called SpectraScore developed for the Max for Live platform. Primarily, these tools allow the user to analyse incoming audio and directly apply the collected data towards the generation of synthesised sound and notation sequences. Also presented is an extension of these tools, a novel system of correlation between emotional descriptors and spectrally derived harmonic morphemes. The final component is a portfolio of works created as examples of the techniques explored in scored and recorded form. As a companion to these works, an analysis component outlines the programmatic aspects of each piece and illustrates how they are executed within the music. Each scored piece corresponds with a recording of a live performance or performances of the work included in the attached DVD, which comprises individual realisations of the interactive works. Keywords: Spectralism, Music and Emotion, Electronic Music, Spectral Music, Algorithmic Music, Real-time Notatio

Perceptual synthesis engine : an audio-driven timbre generator

Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2001.Includes bibliographical references (leaves 68-75).A real-time synthesis engine which models and predicts the timbre of acoustic instruments based on perceptual features extracted from an audio stream is presented. The thesis describes the modeling sequence including the analysis of natural sounds, the inference step that finds the mapping between control and output parameters, the timbre prediction step, and the sound synthesis. The system enables applications such as cross-synthesis, pitch shifting or compression of acoustic instruments, and timbre morphing between instrument families. It is fully implemented in the Max/MSP environment. The Perceptual Synthesis Engine was developed for the Hyperviolin as a novel, generic and perceptually meaningful synthesis technique for non-discretely pitched instruments.by Tristan Jehan.S.M