50 research outputs found

    Modular Understanding: A Taxonomy and Toolkit for Designing Modularity in Audio Software and Hardware

    Get PDF
    Modular synthesis is a continually evolving practice. Currently, an eectivetaxonomy for analyzing modular synthesizer design does not exist, which isa signicant barrier for pedagogy and documentation. In this dissertation,I will dene new taxonomies for modular control, patching strategies, andpanel design. I will also analyze how these taxonomies can be used to in-uence the design of musical applications outside of hardware, such as mycompany Unltered Audio's software products. Finally, I will present EuroReakt, my collection of over 140 module designs for the Reaktor Blocks formatand walk through the design process of each

    On-the-fly synthesizer programming with rule learning

    Get PDF
    This manuscript explores automatic programming of sound synthesis algorithms within the context of the performative artistic practice known as live coding. Writing source code in an improvised way to create music or visuals became an instrument the moment affordable computers were able to perform real-time sound synthesis with languages that keep their interpreter running. Ever since, live coding has dealt with real time programming of synthesis algorithms. For that purpose, one possibility is an algorithm that automatically creates variations out of a few presets selected by the user. However, the need for real-time feedback and the small size of the data sets (which can even be collected mid-performance) are constraints that make existing automatic sound synthesizer programmers and learning algorithms unfeasible. Also, the design of such algorithms is not oriented to create variations of a sound but rather to find the synthesizer parameters that match a given one. Other approaches create representations of the space of possible sounds, allowing the user to explore it by means of interactive evolution. Even though these systems are exploratory-oriented, they require longer run-times. This thesis investigates inductive rule learning for on-the-fly synthesizer programming. This approach is conceptually different from those found in both synthesizer programming and live coding literature. Rule models offer interpretability and allow working with the parameter values of the synthesis algorithms (even with symbolic data), making preprocessing unnecessary. RuLer, the proposed learning algorithm, receives a dataset containing user labeled combinations of parameter values of a synthesis algorithm. Among those combinations sharing the same label, it analyses the patterns based on dissimilarity. These patterns are described as an IF-THEN rule model. The algorithm parameters provide control to define what is considered a pattern. As patterns are the base for inducting new parameter settings, the algorithm parameters control the degree of consistency of the inducted settings respect to the original input data. An algorithm (named FuzzyRuLer) able to extend IF-THEN rules to hyperrectangles, which in turn are used as the cores of membership functions, is presented. The resulting fuzzy rule model creates a map of the entire input feature space. For such a pursuit, the algorithm generalizes the logical rules solving the contradictions by following a maximum volume heuristics. Across the manuscript it is discussed how, when machine learning algorithms are used as creative tools, glitches, errors or inaccuracies produced by the resulting models are sometimes desirable as they might offer novel, unpredictable results. The evaluation of the algorithms follows two paths. The first focuses on user tests. The second responds to the fact that this work was carried out within the computer science department and is intended to provide a broader, nonspecific domain evaluation of the algorithms performance using extrinsic benchmarks (i.e not belonging to a synthesizer's domain) for cross validation and minority oversampling. In oversampling tasks, using imbalanced datasets, the algorithm yields state-of-the-art results. Moreover, the synthetic points produced are significantly different from those created by the other algorithms and perform (controlled) exploration of more distant regions. Finally, accompanying the research, various performances, concerts and an album were produced with the algorithms and examples of this thesis. The reviews received and collections where the album has been featured show a positive reception within the community. Together, these evaluations suggest that rule learning is both an effective method and a promising path for further research.Aquest manuscrit explora la programació automàtica d’algorismes de síntesi de so dins del context de la pràctica artística performativa coneguda com a live coding. L'escriptura improvisada de codi font per crear música o visuals es va convertir en un instrument en el moment en què els ordinadors van poder realitzar síntesis de so en temps real amb llenguatges que mantenien el seu intèrpret en funcionament. D'aleshores ençà, el live coding comporta la programació en temps real d’algorismes de síntesi de so. Per a aquest propòsit, una possibilitat és tenir un algorisme que creï automàticament variacions a partir d'alguns presets seleccionats. No obstant, la necessitat de retroalimentació en temps real i la petita mida dels conjunts de dades són restriccions que fan que els programadors automàtics de sintetitzadors de so i els algorismes d’aprenentatge no siguin factibles d’utilitzar. A més, el seu disseny no està orientat a crear variacions d'un so, sinó a trobar els paràmetres del sintetitzador que aplicats a l'algorisme de síntesi produeixen un so determinat (target). Altres enfocaments creen representacions de l'espai de sons possibles, per permetre a l'usuari explorar-lo mitjançant l'evolució interactiva, però requereixen temps més llargs. Aquesta tesi investiga l'aprenentatge inductiu de regles per a la programació on-the-fly de sintetitzadors. Aquest enfocament és conceptualment diferent dels que es troben a la literatura. Els models de regles ofereixen interpretabilitat i permeten treballar amb els valors dels paràmetres dels algorismes de síntesi, sense processament previ. RuLer, l'algorisme d'aprenentatge proposat, rep dades amb combinacions etiquetades per l'usuari dels valors dels paràmetres d'un algorisme de síntesi. A continuació, analitza els patrons, basats en la dissimilitud, entre les combinacions de cada etiqueta. Aquests patrons es descriuen com un model de regles IF-THEN. Els paràmetres de l'algorisme proporcionen control per definir el que es considera un patró. Llavors, controlen el grau de consistència dels nous paràmetres de síntesi induïts respecte a les dades d'entrada originals. A continuació, es presenta un algorisme (FuzzyRuLer) capaç d’estendre les regles IF-THEN a hiperrectangles, que al seu torn s’utilitzen com a nuclis de funcions de pertinença. El model de regles difuses resultant crea un mapa complet de l'espai de la funció d'entrada. Per això, l'algorisme generalitza les regles lògiques seguint una heurística de volum màxim. Al llarg del manuscrit es discuteix com, quan s’utilitzen algorismes d’aprenentatge automàtic com a eines creatives, de vegades són desitjables glitches, errors o imprecisions produïdes pels models resultants, ja que poden oferir nous resultats imprevisibles. L'avaluació dels algorismes segueix dos camins. El primer es centra en proves d'usuari. El segon, que respon al fet que aquest treball es va dur a terme dins del departament de ciències de la computació, pretén proporcionar una avaluació més àmplia, no específica d'un domini, del rendiment dels algorismes mitjançant benchmarks extrínsecs utilitzats per cross-validation i minority oversampling. En tasques d'oversampling, mitjançant imbalanced data sets, l'algorisme proporciona resultats equiparables als de l'estat de l'art. A més, els punts sintètics produïts són significativament diferents als creats pels altres algorismes i realitzen exploracions (controlades) de regions més llunyanesEste manuscrito explora la programación automática de algoritmos de síntesis de sonido dentro del contexto de la práctica artística performativa conocida como live coding. La escritura de código fuente de forma improvisada para crear música o imágenes, se convirtió en un instrumento en el momento en que las computadoras asequibles pudieron realizar síntesis de sonido en tiempo real con lenguajes que mantuvieron su interprete en funcionamiento. Desde entonces, el live coding ha implicado la programación en tiempo real de algoritmos de síntesis. Para ese propósito, una posibilidad es tener un algoritmo que cree automáticamente variaciones a partir de unos pocos presets seleccionados. Sin embargo, la necesidad de retroalimentación en tiempo real y el pequeño tamaño de los conjuntos de datos (que incluso pueden recopilarse durante la misma actuación), limitan el uso de los algoritmos existentes, tanto de programación automática de sintetizadores como de aprendizaje de máquina. Además, el diseño de dichos algoritmos no está orientado a crear variaciones de un sonido, sino a encontrar los parámetros del sintetizador que coincidan con un sonido dado. Otros enfoques crean representaciones del espacio de posibles sonidos, para permitir al usuario explorarlo mediante evolución interactiva. Aunque estos sistemas están orientados a la exploración, requieren tiempos más largos. Esta tesis investiga el aprendizaje inductivo de reglas para la programación de sintetizadores on-the-fly. Este enfoque es conceptualmente diferente de los que se encuentran en la literatura, tanto de programación de sintetizadores como de live coding. Los modelos de reglas ofrecen interpretabilidad y permiten trabajar con los valores de los parámetros de los algoritmos de síntesis (incluso con datos simbólicos), haciendo innecesario el preprocesamiento. RuLer, el algoritmo de aprendizaje propuesto, recibe un conjunto de datos que contiene combinaciones, etiquetadas por el usuario, de valores de parámetros de un algoritmo de síntesis. Luego, analiza los patrones, en función de la disimilitud, entre las combinaciones de cada etiqueta. Estos patrones se describen como un modelo de reglas lógicas IF-THEN. Los parámetros del algoritmo proporcionan el control para definir qué se considera un patrón. Como los patrones son la base para inducir nuevas configuraciones de parámetros, los parámetros del algoritmo controlan también el grado de consistencia de las configuraciones inducidas con respecto a los datos de entrada originales. Luego, se presenta un algoritmo (llamado FuzzyRuLer) capaz de extender las reglas lógicas tipo IF-THEN a hiperrectángulos, que a su vez se utilizan como núcleos de funciones de pertenencia. El modelo de reglas difusas resultante crea un mapa completo del espacio de las clases de entrada. Para tal fin, el algoritmo generaliza las reglas lógicas resolviendo las contradicciones utilizando una heurística de máximo volumen. A lo largo del manuscrito se analiza cómo, cuando los algoritmos de aprendizaje automático se utilizan como herramientas creativas, los glitches, errores o inexactitudes producidas por los modelos resultantes son a veces deseables, ya que pueden ofrecer resultados novedosos e impredecibles. La evaluación de los algoritmos sigue dos caminos. El primero se centra en pruebas de usuario. El segundo, responde al hecho de que este trabajo se llevó a cabo dentro del departamento de ciencias de la computación y está destinado a proporcionar una evaluación más amplia, no de dominio específica, del rendimiento de los algoritmos utilizando beanchmarks extrínsecos para cross-validation y oversampling. En estas últimas pruebas, utilizando conjuntos de datos no balanceados, el algoritmo produce resultados equiparables a los del estado del arte. Además, los puntos sintéticos producidos son significativamente diferentes de los creados por los otros algoritmos y realizan una exploración (controlada) de regiones más distantes. Finalmente, acompañando la investigación, realicé diversas presentaciones, conciertos y un ´álbum utilizando los algoritmos y ejemplos de esta tesis. Las críticas recibidas y las listas donde se ha presentado el álbum muestran una recepción positiva de la comunidad. En conjunto, estas evaluaciones sugieren que el aprendizaje de reglas es al mismo tiempo un método eficaz y un camino prometedor para futuras investigaciones.Postprint (published version

    Musical sound information : musical gestures and embedding synthesis

    Get PDF
    Thesis (Ph. D.)--Massachusetts Institute of Technology, Program in Media Arts & Sciences, 1997.Includes bibliographical references (p. 143-145).by Eric Métois.Ph.D

    Perceptual synthesis engine : an audio-driven timbre generator

    Get PDF
    Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2001.Includes bibliographical references (leaves 68-75).A real-time synthesis engine which models and predicts the timbre of acoustic instruments based on perceptual features extracted from an audio stream is presented. The thesis describes the modeling sequence including the analysis of natural sounds, the inference step that finds the mapping between control and output parameters, the timbre prediction step, and the sound synthesis. The system enables applications such as cross-synthesis, pitch shifting or compression of acoustic instruments, and timbre morphing between instrument families. It is fully implemented in the Max/MSP environment. The Perceptual Synthesis Engine was developed for the Hyperviolin as a novel, generic and perceptually meaningful synthesis technique for non-discretely pitched instruments.by Tristan Jehan.S.M

    Optimization of Ultrafast Strong-Field Phenomena

    Get PDF
    Elektronien liikkeen havainnointi ja ohjaaminen on attosekuntitieteen keskiössä. Attosekuntiluokan elektroniprosessit ovat esimerkiksi kemiallisten reaktioiden takana, selittävät aineen optiset ominaisuudet sekä ovat pohjana useille ultranopeille nanomittaluokan kuvantamismenetelmille. Useat mielenkiintoiset attosekuntiluokan ilmiöt aiheutuvat vahvasta ulkoisesta sähkömagneettisesta kentästä. Tällaisia kenttiä saadaan femtosekuntilasersykäyksillä, joiden kenttien vahvuus on samaa suuruusluokkaa kuin atomin elektroniinsa kohdistama sähkökenttä. Voimakas sähkömagneettinen vuorovaikutus aiheuttaa atomien, molekyylien ja kiinteän aineen epälineaarisia ilmiöitä kuten korkeaenergisten fotonien tuottoa (HHG), nopeiden elektronien emissiota sekä esimerkiksi atomielektronin virittymistä korkeille sidotuille tiloille. Edellämainitut ilmiöt ovat myös pohjana useille teknisille edistyksille: HHG:lla tuotetaan koherentteja röntgensykäyksiä, joiden kesto on vain muutamien attosekuntien suuruusluokkaa; nopeita fotoemittoituneita elektroniaaltopaketteja käytetään aineen kuvantamiseen; ja Rydberg-tiloille viritettyjä atomeita käytetään kvanttilaskennassa kubitteina. Attosekuntiluokan ilmiöitä voidaan ohjata haluttuun suuntaan käyttämällä femtosekuntilasersykäyksiä, joiden sähkökentän aikariippuvuutta voidaan säätää. Tämä väitöskirja on laskennallinen tutkimusretki, jolla pyritään löytämään menetelmiä ennustamaan sellaisten femtosekuntilasersykäysten aikaprofiileja, joilla aiemmin mainittuja ilmiöitä – HHG:ta, elektroniemissiota sekä Rydbergtilojen virityksiä – voidaan tehostaa, optimoida. Väitöskirjan alussa esitellään työn kannalta oleelliset vahvojen kenttien attosekuntiluokan ilmiöt keskittyen etenkin niiden teoreettisiin ja laskennallisiin malleihin. Tutkielmassa annetaan myös yleiskatsaus femtosekuntisykäysten käytöstä atomifysiikan ilmiöiden ohjaamisessa ja optimoinnissa avaten sekä alan kokeellista että laskennallista puolta. Tutkimuksessamme käytetyt laskennalliset mallit käydään yksityiskohtaisesti läpi, ja väitöskirjan oheismateriaali (saatavilla internetistä) sisältää oleellisimmat työssä käytetyt ohjelmistot ja analyysityökalut. Tutkimusten tuloksina on löydetty menetelmiä femtosekuntilasersykäysten suunnittelua varten. Näillä menetelmillä saadaan kasvatettua sekä HHG:n että korkeaenergisen elektroniemission hyötysuhdetta ja maksimienergiaa. Työssä tutkittiin myös femtosekuntilasersykäysten käyttöä alkalimetalliatomien virittämiseksi kvanttilaskentaa varten. Optimointimenetelmämme ja femtosekuntilasersykäysten käyttö vähentää viritykseen käytettävää aikaa huomattavasti perinteisiin tekniikoihin verrattuina, mutta nykyisessä muodossaan menetelmä ei ole tarpeeksi tarkka, jotta sillä voitaisiin miehittää vain yksi tietty tila. Väitöskirjassa kehitetään myös uusi elementtimenetelmään pohjautuva laskentaohjelmisto, joka on suunniteltu nanorakenteiden attosekunti-ilmiöiden mallinnukseen. Nanorakenteet muuttavat niihin kohdistetun femtosekuntilasersykäyksen paikkariippuvuutta, mitä useimmat aiemmat mallinnusohjelmistot eivät kykene huomioimaan. Kehittämämme ohjelmisto mallintaa näitä tilanteita tehokkaasti ja ottaa huomioon femtosekuntilasersykäysten epähomogeenisen paikkariippuvuuden. Väitöskirjan lopussa on yhteenveto löydöksistämme, joita käsitellään suhteessa muihin alan tuoreisiin tutkimuksiin. Pohdimme myös mahdollisia kehityskohteita sekä suuntaa tuleville tutkimuksille.Attosecond science deals with monitoring and control of electron dynamics in their native, attosecond time scale. Ultrafast electron dynamics is the driving force behind chemical reactions, it determines the optical response of matter, and it is the cornerstone of multiple ultrafast nanoscale imaging techniques. Attosecond phenomena are often driven by strong-field light-matter interaction. Femtosecond laser pulses with electric fields rivaling those of atomic binding forces drive complex nonlinear phenomena in atoms, molecules, and solid state. They include electron excitations, nonlinear frequency up-conversion known as high-order harmonic generation (HHG), and emission of ultra-energetic electrons via above-threshold ionization (ATI). These processes have important roles in ultrafast technologies. For example, HHG is used as a source for coherent X-ray pulses with durations down to attoseconds, ATI is used for building electron wave packets for self-interrogation spectroscopy of matter, and excited Rydberg-states of atoms are prime candidates for multi-qubit quantum computing. Control of strong-field attosecond phenomena can be achieved by shaping the temporal profile of the driving femtosecond pulse in modern light-field synthesizers. This dissertation is a computational expedition to shaping the driving laser pulses for optimizing strong-field light-matter interaction in HHG, ATI, and Rydberg-state preparation in atoms. We begin this dissertation with a brief reviewof relevant strong-field attosecond phenomena with an emphasis on their theoretical modeling. We continue with an overview of control and optimization of these phenomena both from an experimental and a computational point of view. Later, we describe in detail the computational models we have used. The corresponding software is provided in the online supplementary material. Our optimization studies deliver experimentally feasible optimization/control schemes for shaping the driving femtosecond laser pulses to increase the maximum energy and signal strength of HHG and ATI in atomic gases. We also demonstrate how the optimized processes behind the optimized HHG and ATI can be understood with a semiclassical three-step model. The excitation of alkali metals to their Rydberg states is shown to be feasible with multicolor femtosecond fields, decreasing the excitation time by several orders of magnitude compared to traditional methods. On the downside, in its current form the proposed scheme lacks the finesse to populate only a single final state. We also develop a new finite element simulation suite for studying attosecond phenomena in nanostructures. Nanostructures shape the spatial profile of the driving laser field, something existing simulation software cannot easily model. Our software suite is designed for simulating these systems efficiently, and it can incorporate the spatial inhomogeneity of the driving field with ease. We close this dissertation with a summary of our optimization studies and obtained results. They are discussed in the context of other recent work in the field, and we also reflect on possible improvements and directions for future work

    Optimization of Ultrafast Strong-Field Phenomena

    Get PDF
    Elektronien liikkeen havainnointi ja ohjaaminen on attosekuntitieteen keskiössä. Attosekuntiluokan elektroniprosessit ovat esimerkiksi kemiallisten reaktioiden takana, selittävät aineen optiset ominaisuudet sekä ovat pohjana useille ultranopeille nanomittaluokan kuvantamismenetelmille. Useat mielenkiintoiset attosekuntiluokan ilmiöt aiheutuvat vahvasta ulkoisesta sähkömagneettisesta kentästä. Tällaisia kenttiä saadaan femtosekuntilasersykäyksillä, joiden kenttien vahvuus on samaa suuruusluokkaa kuin atomin elektroniinsa kohdistama sähkökenttä. Voimakas sähkömagneettinen vuorovaikutus aiheuttaa atomien, molekyylien ja kiinteän aineen epälineaarisia ilmiöitä kuten korkeaenergisten fotonien tuottoa (HHG), nopeiden elektronien emissiota sekä esimerkiksi atomielektronin virittymistä korkeille sidotuille tiloille. Edellämainitut ilmiöt ovat myös pohjana useille teknisille edistyksille: HHG:lla tuotetaan koherentteja röntgensykäyksiä, joiden kesto on vain muutamien attosekuntien suuruusluokkaa; nopeita fotoemittoituneita elektroniaaltopaketteja käytetään aineen kuvantamiseen; ja Rydberg-tiloille viritettyjä atomeita käytetään kvanttilaskennassa kubitteina. Attosekuntiluokan ilmiöitä voidaan ohjata haluttuun suuntaan käyttämällä femtosekuntilasersykäyksiä, joiden sähkökentän aikariippuvuutta voidaan säätää. Tämä väitöskirja on laskennallinen tutkimusretki, jolla pyritään löytämään menetelmiä ennustamaan sellaisten femtosekuntilasersykäysten aikaprofiileja, joilla aiemmin mainittuja ilmiöitä – HHG:ta, elektroniemissiota sekä Rydbergtilojen virityksiä – voidaan tehostaa, optimoida. Väitöskirjan alussa esitellään työn kannalta oleelliset vahvojen kenttien attosekuntiluokan ilmiöt keskittyen etenkin niiden teoreettisiin ja laskennallisiin malleihin. Tutkielmassa annetaan myös yleiskatsaus femtosekuntisykäysten käytöstä atomifysiikan ilmiöiden ohjaamisessa ja optimoinnissa avaten sekä alan kokeellista että laskennallista puolta. Tutkimuksessamme käytetyt laskennalliset mallit käydään yksityiskohtaisesti läpi, ja väitöskirjan oheismateriaali (saatavilla internetistä) sisältää oleellisimmat työssä käytetyt ohjelmistot ja analyysityökalut. Tutkimusten tuloksina on löydetty menetelmiä femtosekuntilasersykäysten suunnittelua varten. Näillä menetelmillä saadaan kasvatettua sekä HHG:n että korkeaenergisen elektroniemission hyötysuhdetta ja maksimienergiaa. Työssä tutkittiin myös femtosekuntilasersykäysten käyttöä alkalimetalliatomien virittämiseksi kvanttilaskentaa varten. Optimointimenetelmämme ja femtosekuntilasersykäysten käyttö vähentää viritykseen käytettävää aikaa huomattavasti perinteisiin tekniikoihin verrattuina, mutta nykyisessä muodossaan menetelmä ei ole tarpeeksi tarkka, jotta sillä voitaisiin miehittää vain yksi tietty tila. Väitöskirjassa kehitetään myös uusi elementtimenetelmään pohjautuva laskentaohjelmisto, joka on suunniteltu nanorakenteiden attosekunti-ilmiöiden mallinnukseen. Nanorakenteet muuttavat niihin kohdistetun femtosekuntilasersykäyksen paikkariippuvuutta, mitä useimmat aiemmat mallinnusohjelmistot eivät kykene huomioimaan. Kehittämämme ohjelmisto mallintaa näitä tilanteita tehokkaasti ja ottaa huomioon femtosekuntilasersykäysten epähomogeenisen paikkariippuvuuden. Väitöskirjan lopussa on yhteenveto löydöksistämme, joita käsitellään suhteessa muihin alan tuoreisiin tutkimuksiin. Pohdimme myös mahdollisia kehityskohteita sekä suuntaa tuleville tutkimuksille.Attosecond science deals with monitoring and control of electron dynamics in their native, attosecond time scale. Ultrafast electron dynamics is the driving force behind chemical reactions, it determines the optical response of matter, and it is the cornerstone of multiple ultrafast nanoscale imaging techniques. Attosecond phenomena are often driven by strong-field light-matter interaction. Femtosecond laser pulses with electric fields rivaling those of atomic binding forces drive complex nonlinear phenomena in atoms, molecules, and solid state. They include electron excitations, nonlinear frequency up-conversion known as high-order harmonic generation (HHG), and emission of ultra-energetic electrons via above-threshold ionization (ATI). These processes have important roles in ultrafast technologies. For example, HHG is used as a source for coherent X-ray pulses with durations down to attoseconds, ATI is used for building electron wave packets for self-interrogation spectroscopy of matter, and excited Rydberg-states of atoms are prime candidates for multi-qubit quantum computing. Control of strong-field attosecond phenomena can be achieved by shaping the temporal profile of the driving femtosecond pulse in modern light-field synthesizers. This dissertation is a computational expedition to shaping the driving laser pulses for optimizing strong-field light-matter interaction in HHG, ATI, and Rydberg-state preparation in atoms. We begin this dissertation with a brief reviewof relevant strong-field attosecond phenomena with an emphasis on their theoretical modeling. We continue with an overview of control and optimization of these phenomena both from an experimental and a computational point of view. Later, we describe in detail the computational models we have used. The corresponding software is provided in the online supplementary material. Our optimization studies deliver experimentally feasible optimization/control schemes for shaping the driving femtosecond laser pulses to increase the maximum energy and signal strength of HHG and ATI in atomic gases. We also demonstrate how the optimized processes behind the optimized HHG and ATI can be understood with a semiclassical three-step model. The excitation of alkali metals to their Rydberg states is shown to be feasible with multicolor femtosecond fields, decreasing the excitation time by several orders of magnitude compared to traditional methods. On the downside, in its current form the proposed scheme lacks the finesse to populate only a single final state. We also develop a new finite element simulation suite for studying attosecond phenomena in nanostructures. Nanostructures shape the spatial profile of the driving laser field, something existing simulation software cannot easily model. Our software suite is designed for simulating these systems efficiently, and it can incorporate the spatial inhomogeneity of the driving field with ease. We close this dissertation with a summary of our optimization studies and obtained results. They are discussed in the context of other recent work in the field, and we also reflect on possible improvements and directions for future work

    Modelling the live-electronics in electroacoustic music using particle systems

    Get PDF
    Contemporary music is largely influenced by technology. Empowered by the current available tools and resources, composers have the possibility to not only compose with sounds, but also to compose the sounds themselves. Personal computers powered with intuitive and interactive audio applications and development tools allow the creation of a vast range of real-time manipulation of live instrumental input and also real-time generation of sound through synthesis techniques. Consequently, achieving a desired sonority and interaction between the electronic and acoustic sounds in real-time, deeply rely on the choice and technical implementation of the audio processes and logical structures that will perform the electronic part of the composition. Due to the artistic and technical complexity of the development and implementation of such a complex artistic work, a very common strategy historically adopted by composers is to develop the composition in collaboration with a technology expert, which in this context is known as a musical assistant. In this perspective, the work of the musical assistant can be considered as one of translating musical, artistic and aesthetic concepts into mathematical algorithms and audio processes. The work presented in this dissertation addresses the problem of choosing, combining and manipulating the audio processes and logical structures that take place on the liveelectronics (i.e the electronic part of a mixed music composition) of a contemporary electroacoustic music composition, by using particle systems to model and simulate the dynamic behaviors that reflect the conceptual and aesthetic principles envisaged by the composer for a determined musical piece. The presented research work initiates with a thorough identification and analysis of the agents, processes and structures that are present in the live-electronics system of a mixed music composition. From this analysis a logical formalization of a typical live-electronics system is proposed, and then adapted to integrate a particle-based modelling strategy. From the formalization, a theoretical and practical framework for developing and implementing live-electronics systems for mixed music compositions using particle systems is proposed. The framework is experimented and validated in the development of distinct mixed music compositions by distinct composers, in real professional context. From the analysis of the case studies and the logical formalization, and the feedback given by the composers, it is possible to conclude that the proposed particle systems modelling method proves to be effective in the task of assisting the conceptual translation of musical and aesthetic ideas into implementable audio processing software.A música contemporânea é amplamente influenciada pela tecnologia. Os recursos tecnológicos atualmente disponíveis permitem que os compositores criem com sons e ao mesmo tempo criem os sons em si próprios. Os atuais aplicativos e ferramentas de software focados no desenvolvimento, controle e manipulação de processamentos de áudio, permitem a elaboração de diversos tipos de tratamentos e sínteses de som com a capacidade de serem executados e manipulados em tempo real. Consequentemente, a escolha dos algoritmos de processamento de áudio e suas respectivas implementações técnicas em forma de software, são determinantes para que a sonoridade desejada seja atingida, e para que o resultado sonoro satisfaça os objetivos estéticos e conceituais da relação entre as fontes sonoras acústicas e os sons eletrônicos presentes em uma composição eletroacústica de caráter misto. Devido à complexidade artística e técnica do desenvolvimento e implementação do sistema de eletrônica em tempo real de uma composição eletroacústica mista, uma estratégia historicamente adotada por compositores é a de desenvolver a composição em colaboração com um especialista em tecnologia, que neste contexto é usualmente referido como assistente musical. Nesta perspectiva, o trabalho do assistente musical pode ser interpretado como o de traduzir conceitos musicais, artísticos e estéticos em algoritmos matemáticos e processamento de áudio. O trabalho apresentado nesta dissertação aborda a problemática da escolha, combinação e manipulação dos processamentos de áudio e estruturas lógicas presentes no sistema de eletrônica em tempo real de uma composição de música eletroacústica contemporânea, e propõem o uso de sistemas de partículas para modelar e simular os comportamentos dinâmicos e morfológicos que refletem os princípios conceituais e estéticos previstos pelo compositor para uma determinada composição. A parte inicial do trabalho apresentado consiste na identificação e análise detalhada dos agentes, estruturas e processos envolvidos na realização e execução do sistema de eletrônica em tempo real. A partir desta análise é proposta uma formalização lógica e genérica de um sistema de eletrônica em tempo real. Em seguida, esta formalização é modificada e adaptada para integrar uma estratégia de modelagem através de sistemas de partículas. Em sequencia da formalização lógica, um método teórico e prático para o desenvolvimento de sistemas de eletrônica em tempo real para composições de música mista é proposto. O teste e consequente validação do método se dá através de sua utilização na realização da eletrônica em tempo real para obras de diferentes compositores. A análise dos casos de estudo e da formalização lógica, e também o parecer e opinião dos compositores, permitem concluir que o método proposto é de fato eficaz na tarefa de auxiliar o processo de tradução dos conceitos musicais e estéticos propostos pelos compositores em forma de algoritmos e processamentos de som implementados em software
    corecore