Analyse de la performance musicale et synthèse sonore rapide

Cette thèse d’informatique musicale explore d’une part la performance instrumentale et propose d’autre part des algorithmes de synthèse additive rapide. Un état de l’art sur l’analyse du jeu instrumental est d’abord réalisé, explorant les différentes composantes de l’interprétation musicale. Une étude sur l’importance du doigté au piano est alors présentée. La performance pianistique est ainsi analysée pour mettre en évidence l’influence du doigté sur la performance. Le jeu académique au saxophone est aussi analysé, afin d’évaluer le niveau technique de saxophonistes en fonction de l’évolution de leurs paramètres sonores. Une méthode automatique de cette évaluation est alors proposée. Dans une deuxième partie, nous explorons des algorithmes de synthèse additive rapide. Nous étudions d’abord la possibilité d’avoir recours à des techniques non linéaires. Nous présentons ensuite PASS, une nouvelle méthode où des polynômes remplacent des fonctions sinusoïdales pour accélérer la synthèse sonore. Une application de la méthode PASS est finalement présentée, permettant la synthèse rapide et réaliste de surfaces océaniques.This document deals in a first part with musical performance and proposes in a second part some algorithms for fast sound synthesis. We begin by discussing the several parameters which could be extracted from a mu- sical performance. We expose then our work on the piano fingering. A lot of biomechanic studies have previously highlight the influence of the physiology of a pianist in his perfor- mance, particularly due to his hands. This knowledge lead us to propose a new method of automatic fingering which uses dynamic fingering. We propose also to evaluate the tech- nical level of a musical performer by analysing non expressive performances like scales. Our results are based on the analysis of alto saxophone performances, however the same approach can be used with other instruments. Our aim is to highlight the technical part in the performance by considering the evolution of the spectral parameters of the sound. The second part of the document propose to study the use of non linear methods of sound synthesis for the additive synthesis. Then, we propose a new fast sound synthesis method using polynomials. This is an additive method where polynomials are used to approximate sine functions. Practical implementations show that this method called Poly- nomial Additive Sound Synthesis (PASS) is particularly efficient for low-frequency signals. We propose finally to adapt fast sound synthesis methods to the simulation of ocean waves

Music-Theoretic Estimation of Chords and Keys from Audio

This paper proposes a new method for local key and chord estimation from audio signals. This method relies primarily on principles from music theory, and does not require any training on a corpus of labelled audio files. A harmonic content of the musical piece is first extracted by computing a set of chroma vectors. A set of chord/key pairs is selected for every frame by correlation with fixed chord and key templates. An acyclic harmonic graph is constructed with these pairs as vertices, using a musical distance to weigh its edges. Finally, the sequences of chords and keys are obtained by finding the best path in the graph using dynamic programming. The proposed method allows a mutual chord and key estimation. It is evaluated on a corpus composed of Beatles songs for both the local key estimation and chord recognition tasks, as well as a larger corpus composed of songs taken from the Billboard dataset

Sonification for 3D Printing Process Monitoring

In order to monitor a 3D printing industrial process in a context of sensory overload and potential inattentional deafness, we designed a sonification of the information sent in by the printer. This sonification focuses not only on proper communication of the system's state, but also on lowering the amount of stress usually induced by prolonged listening. To this end, we made use of a combination of synthetic and natural sounds whose perceptual properties were modulated according to the data influx using parameter mapping. Then an experiment was conducted on the recognition of various normal and abnormal behaviours, also allowing the participants to assess the amount of stress they experienced upon listening. The results are quite promising, but also highlight a confusing overlap in the natural sounds used, which will need to be fixed in future iterations. For now, tester opinion is mostly positive on the stressful aspect. However, listening times may need to be longer in further experimentation to better assess how stressful this sonification is

Analyse automatique du doigté au piano

National audienceLe choix d'un doigté a une influence certaine sur le jeu au piano. S'il est généralement un compromis entre des contraintes physiques et interprétatives, la composante physique a la priorité quand il s'agit de passages musicaux très rapides et techniques. Cet article présente une méthode originale pour trouver automatiquement le doigté optimal d'une mélodie dans ce contexte. En se fondant sur des travaux de biomécanique, nous jetons également les bases d'une méthode d'analyse de la performance pour retrouver le doigté utilisé par l'interprète. Elle utilise la programmation dynamique et intègre des contraintes physiques liées aux enchaînements des doigts

Extending alignment algorithm for polyphonic comparison

Presented at the 15th International Conference on Auditory Display (ICAD2009), Copenhagen, Denmark, May 18-22, 2009Existing symbolic music comparison systems generally consider monophonic music or monophonic reduction of polyphonic music. Adaptation of alignment algorithms to the music leads to accurate systems, but extensions to polyphonic music arise new problems. Indeed, a chord may match several notes, or the difference be- tween two similar motifs may be a few swapped notes. Moreover, it is difficult to set up the substitution scores between chords. In this paper, we propose a general framework for polyphonic mu- sic which permits to directly apply the substitution score scheme set for monophonic music, and which allows new operations by extending the operations proposed by Mongeau and Sankoff [1]. From a practical point of view, the limitations of the size of chords and the number of notes that can be merged lead to a complexity that remains quadratic

Evaluation of the Technical Level of Saxophone Performers by Considering the Evolution of Spectral Parameters of the Sound

International audienc

Query by Tapping System Based on Alignment Algorithm

International audienc