Multimodal music information processing and retrieval: survey and future challenges

Towards improving the performance in various music information processing tasks, recent studies exploit different modalities able to capture diverse aspects of music. Such modalities include audio recordings, symbolic music scores, mid-level representations, motion, and gestural data, video recordings, editorial or cultural tags, lyrics and album cover arts. This paper critically reviews the various approaches adopted in Music Information Processing and Retrieval and highlights how multimodal algorithms can help Music Computing applications. First, we categorize the related literature based on the application they address. Subsequently, we analyze existing information fusion approaches, and we conclude with the set of challenges that Music Information Retrieval and Sound and Music Computing research communities should focus in the next years

AudioPairBank: Towards A Large-Scale Tag-Pair-Based Audio Content Analysis

Recently, sound recognition has been used to identify sounds, such as car and river. However, sounds have nuances that may be better described by adjective-noun pairs such as slow car, and verb-noun pairs such as flying insects, which are under explored. Therefore, in this work we investigate the relation between audio content and both adjective-noun pairs and verb-noun pairs. Due to the lack of datasets with these kinds of annotations, we collected and processed the AudioPairBank corpus consisting of a combined total of 1,123 pairs and over 33,000 audio files. One contribution is the previously unavailable documentation of the challenges and implications of collecting audio recordings with these type of labels. A second contribution is to show the degree of correlation between the audio content and the labels through sound recognition experiments, which yielded results of 70% accuracy, hence also providing a performance benchmark. The results and study in this paper encourage further exploration of the nuances in audio and are meant to complement similar research performed on images and text in multimedia analysis.Comment: This paper is a revised version of "AudioSentibank: Large-scale Semantic Ontology of Acoustic Concepts for Audio Content Analysis

Music for Integration Research Briefing (Poster)

Music as an inclusion tool for children has been proven useful because music is a non-discriminatory way of engaging people with little command of the local language. This A0 poster offers policy and education professionals at all levels tools to integrate newly-arrived children, including a theoretical framework, practical examples and strategies to develop new activities

Historical sources of ethnomusicology in contemporary debate

This anthology concerns traditional music and archives, and discusses their relationship as seen from historical and epistemological perspectives. Music recordings on wax cylinders, 78 records or magnetic tape, made in the first half of the 20th century, are regarded today as valuable sources for understanding musical processes in their social dimension and as unique cultural heritage. Most of these historical sound recordings are preserved in sound archives, now increasingly accessible in digital formats. Written by renowned experts, the articles here focus on archives, individual and collective memory, and heritage as today’s recreation of the past. Contributors discuss the role of historical sources of traditional music in contemporary research based on examples from music cultures in West Africa, Scandinavia, Turkey, and Portugal, among others. The book will appeal to musicologists and cultural anthropologists, as well as historians and sociologists, and will be of interest to anyone concerned with sound archives, libraries, universities and cultural institutions dedicated to traditional music