Piano Genie

We present Piano Genie, an intelligent controller which allows non-musicians to improvise on the piano. With Piano Genie, a user performs on a simple interface with eight buttons, and their performance is decoded into the space of plausible piano music in real time. To learn a suitable mapping procedure for this problem, we train recurrent neural network autoencoders with discrete bottlenecks: an encoder learns an appropriate sequence of buttons corresponding to a piano piece, and a decoder learns to map this sequence back to the original piece. During performance, we substitute a user's input for the encoder output, and play the decoder's prediction each time the user presses a button. To improve the intuitiveness of Piano Genie's performance behavior, we impose musically meaningful constraints over the encoder's outputs.Comment: Published as a conference paper at ACM IUI 201

Recognition of variations using automatic Schenkerian reduction.

Experiments on techniques to automatically recognise whether or not an extract of music is a variation of a given theme are reported, using a test corpus derived from ten of Mozart's sets of variations for piano. Methods which examine the notes of the 'surface' are compared with methods which make use of an automatically derived quasi-Schenkerian reduction of the theme and the extract in question. The maximum average F-measure achieved was 0.87. Unexpectedly, this was for a method of matching based on the surface alone, and in general the results for matches based on the surface were marginally better than those based on reduction, though the small number of possible test queries means that this result cannot be regarded as conclusive. Other inferences on which factors seem to be important in recognising variations are discussed. Possibilities for improved recognition of matching using reduction are outlined

Analysis of analysis: importance of different musical parameters for Schenkerian analysis

While criteria for Schenkerian analysis have been much discussed, such discussions have generally not been informed by data. Kirlin [Kirlin, Phillip B., 2014 “A Probabilistic Model of Hierarchical Music Analysis.” Ph.D. thesis, University of Massachusetts Amherst] has begun to fill this vacuum with a corpus of textbook Schenkerian analyses encoded using data structures suggested byYust [Yust, Jason, 2006 “Formal Models of Prolongation.” Ph.D. thesis, University of Washington] and a machine learning algorithm based on this dataset that can produce analyses with a reasonable degree of accuracy. In this work, we examine what musical features (scale degree, harmony, metrical weight) are most significant in the performance of Kirlin's algorithm.Accepted manuscrip

The Use of Rhyme, Rhythm, and Melody as a Form of Repetition Priming to Aid in Encoding, Storage, and Retrieval of Semantic Memories in Alzheimer’s Patients

Millions are diagnosed with Alzheimer’s disease annually which can have debilitating effects on patient memory. Thus, finding new ways to help facilitate memory in these patients, especially through non-pharmaceutical means, has become increasingly important. I examined the use of melody, rhyme, and rhythm as encoding mechanisms to aid in the retrieval of long term semantic information by juxtaposing scholarly articles detailing experiments, each of which examined the effects of various facets of memory facilitation; this helped produce an idea of which devices are most effective. Additionally, I surveyed studies highlighting limitations of song implementation to craft an effective plan to aid Alzheimer’s patients. Melody, rhyme, and rhythm provide an organizational structure to facilitate the encoding of information. Specifically, chunking, the grouping of smaller units into larger ‘chunks’, helps facilitate long term encoding in patients, and is the byproduct of the organizational structure of a text. A major drawback of using these devices is the loss in the depth of encoding semantic information; however, it is important to recognize music still assists general content memory. Therefore, Alzheimer’s patients would benefit from the use of melody as it would provide a moral support, helping familiarity with their surroundings, although they would not benefit from instructional song. Future experiments may study the combination of discussed factors in various settings to examine the unique benefits of music on memory in Alzheimer’s patients

Generation of folk song melodies using Bayes transforms

The paper introduces the `Bayes transform', a mathematical procedure for putting data into a hierarchical representation. Applicable to any type of data, the procedure yields interesting results when applied to sequences. In this case, the representation obtained implicitly models the repetition hierarchy of the source. There are then natural applications to music. Derivation of Bayes transforms can be the means of determining the repetition hierarchy of note sequences (melodies) in an empirical and domain-general way. The paper investigates application of this approach to Folk Song, examining the results that can be obtained by treating such transforms as generative models

Integrating Segmentation and Similarity in Melodic Analysis

The recognition of melodic structure depends on both the segmentation into structural units, the melodic motifs, and relations of motifs which are mainly determined by similarity. Existing models and studies of segmentation and motivic similarity cover only certain aspects and do not provide a comprehensive or coherent theory. In this paper an Integrated Segmentation and Similarity Model (ISSM) for melodic analysis is introduced. The ISSM yields an interpretation similar to a paradigmatic analysis for a given melody. An interpretation comprises a segmentation, assignments of related motifs and notes, and detailed information on the differences of assigned motifs and notes. The ISSM is based on generating and rating interpretations to find the most adequate one. For this rating a neuro-fuzzy-system is used, which combines knowledge with learning from data. The ISSM is an extension of a system for rhythm analysis. This paper covers the model structure and the features relevant for melodic and motivic analysis. Melodic segmentation and similarity ratings are described and results of a small experiment which show that the ISSM can learn structural interpretations from data and that integrating similarity improves segmentation performance of the model