Using fuzzy logic to handle the semantic descriptions of music in a content-based retrieval system

This paper explores the potential use of fuzzy logic for semantic music recommendation. We show that a set of affective/emotive, structural and kinaesthetic descriptors can be used to formulate a query which allows the retrieval of intended music. A semantic music recommendation system was built, based on an elaborate study of potential users and an analysis of the semantic descriptors that best characterize the user’s understanding of music. Significant relationships between expressive and structural semantic descriptions of music were found. Fuzzy logic was then applied to handle the quality ratings associated with the semantic descriptions. A working semantic music recommendation system was tested and evaluated. Real-world testing revealed high user satisfaction

The Use of Rhyme, Rhythm, and Melody as a Form of Repetition Priming to Aid in Encoding, Storage, and Retrieval of Semantic Memories in Alzheimer’s Patients

Millions are diagnosed with Alzheimer’s disease annually which can have debilitating effects on patient memory. Thus, finding new ways to help facilitate memory in these patients, especially through non-pharmaceutical means, has become increasingly important. I examined the use of melody, rhyme, and rhythm as encoding mechanisms to aid in the retrieval of long term semantic information by juxtaposing scholarly articles detailing experiments, each of which examined the effects of various facets of memory facilitation; this helped produce an idea of which devices are most effective. Additionally, I surveyed studies highlighting limitations of song implementation to craft an effective plan to aid Alzheimer’s patients. Melody, rhyme, and rhythm provide an organizational structure to facilitate the encoding of information. Specifically, chunking, the grouping of smaller units into larger ‘chunks’, helps facilitate long term encoding in patients, and is the byproduct of the organizational structure of a text. A major drawback of using these devices is the loss in the depth of encoding semantic information; however, it is important to recognize music still assists general content memory. Therefore, Alzheimer’s patients would benefit from the use of melody as it would provide a moral support, helping familiarity with their surroundings, although they would not benefit from instructional song. Future experiments may study the combination of discussed factors in various settings to examine the unique benefits of music on memory in Alzheimer’s patients

Methodological considerations concerning manual annotation of musical audio in function of algorithm development

In research on musical audio-mining, annotated music databases are needed which allow the development of computational tools that extract from the musical audiostream the kind of high-level content that users can deal with in Music Information Retrieval (MIR) contexts. The notion of musical content, and therefore the notion of annotation, is ill-defined, however, both in the syntactic and semantic sense. As a consequence, annotation has been approached from a variety of perspectives (but mainly linguistic-symbolic oriented), and a general methodology is lacking. This paper is a step towards the definition of a general framework for manual annotation of musical audio in function of a computational approach to musical audio-mining that is based on algorithms that learn from annotated data. 1

Using fuzzy logic to handle the users' semantic descriptions in a music retrieval system

This paper provides an investigation of the potential application of fuzzy logic to semantic music recommendation. We show that a set of affective/emotive, structural and kinaesthetic descriptors can be used to formulate a query which allows the retrieval of intended music. A semantic music recommendation system was built, based on an elaborate study of potential users of music information retrieval systems. In this study analysis was made of the descriptors that best characterize the user's understanding of music. Significant relationships between expressive and structural descriptions of music were found. A straightforward fuzzy logic methodology was then applied to handle the quality ratings associated with the descriptions. Rigorous real-world testing of the semantic music recommendation system revealed high user satisfaction

The Segment Ontology: Bridging Music-generic and Domain-specific

Existing semantic representations of music analysis encapsulate narrow sub-domain concepts and are frequently scoped by the context of a particular MIR task. Segmentation is a crucial abstraction in the investigation of phenomena which unfold over time; we present a Segment Ontology as the backbone of an approach that models properties from the musicological domain independently from MIR implementations and their signal processing foundations, whilst maintaining an accurate and complete description of the relationships that link them. This framework provides two principal advantages which are explored through several examples: a layered separation of concerns that aligns the model with the needs of the users and systems that consume and produce the data; and the ability to link multiple analyses of differing types through transforms to and from the Segment axis

Transcribing Content from Structural Images with Spotlight Mechanism

Transcribing content from structural images, e.g., writing notes from music scores, is a challenging task as not only the content objects should be recognized, but the internal structure should also be preserved. Existing image recognition methods mainly work on images with simple content (e.g., text lines with characters), but are not capable to identify ones with more complex content (e.g., structured symbols), which often follow a fine-grained grammar. To this end, in this paper, we propose a hierarchical Spotlight Transcribing Network (STN) framework followed by a two-stage "where-to-what" solution. Specifically, we first decide "where-to-look" through a novel spotlight mechanism to focus on different areas of the original image following its structure. Then, we decide "what-to-write" by developing a GRU based network with the spotlight areas for transcribing the content accordingly. Moreover, we propose two implementations on the basis of STN, i.e., STNM and STNR, where the spotlight movement follows the Markov property and Recurrent modeling, respectively. We also design a reinforcement method to refine the framework by self-improving the spotlight mechanism. We conduct extensive experiments on many structural image datasets, where the results clearly demonstrate the effectiveness of STN framework.Comment: Accepted by KDD2018 Research Track. In proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'18