Deep Cross-Modal Correlation Learning for Audio and Lyrics in Music Retrieval

Deep cross-modal learning has successfully demonstrated excellent performance in cross-modal multimedia retrieval, with the aim of learning joint representations between different data modalities. Unfortunately, little research focuses on cross-modal correlation learning where temporal structures of different data modalities such as audio and lyrics should be taken into account. Stemming from the characteristic of temporal structures of music in nature, we are motivated to learn the deep sequential correlation between audio and lyrics. In this work, we propose a deep cross-modal correlation learning architecture involving two-branch deep neural networks for audio modality and text modality (lyrics). Data in different modalities are converted to the same canonical space where inter modal canonical correlation analysis is utilized as an objective function to calculate the similarity of temporal structures. This is the first study that uses deep architectures for learning the temporal correlation between audio and lyrics. A pre-trained Doc2Vec model followed by fully-connected layers is used to represent lyrics. Two significant contributions are made in the audio branch, as follows: i) We propose an end-to-end network to learn cross-modal correlation between audio and lyrics, where feature extraction and correlation learning are simultaneously performed and joint representation is learned by considering temporal structures. ii) As for feature extraction, we further represent an audio signal by a short sequence of local summaries (VGG16 features) and apply a recurrent neural network to compute a compact feature that better learns temporal structures of music audio. Experimental results, using audio to retrieve lyrics or using lyrics to retrieve audio, verify the effectiveness of the proposed deep correlation learning architectures in cross-modal music retrieval

ALEA III: Composers' Workshop, March 13, 2006

This is the concert program of the ALEA III: Composers' Workshop performance on Monday, March 13, 2006 at 8:00 p.m., at the Tsai Performance Center, 685 Commonwealth Avenue. Works performed were "trouble and Desire" by Missy Mazzoli, "Mass Pike" by Liza Jane White, "Waves of Oaxaca: Reflections on Luis Pagan" by A. Green, "Reflections" by Özkan Manav, "Tra" by Davide Ianni, "Nine Eleven" by Sarah Macarah, "Dance Profane" by Brett Keüper Abigaña, and "Illustration" by Manos Panayiotakis. Digitization for Boston University Concert Programs was supported by the Boston University Center for the Humanities Library Endowed Fund

Software agents in music and sound art research/creative work: Current state and a possible direction

Composers, musicians and computer scientists have begun to use software-based agents to create music and sound art in both linear and non-linear (non-predetermined form and/or content) idioms, with some robust approaches now drawing on various disciplines. This paper surveys recent work: agent technology is first introduced, a theoretical framework for its use in creating music/sound art works put forward, and an overview of common approaches then given. Identifying areas of neglect in recent research, a possible direction for further work is then briefly explored. Finally, a vision for a new hybrid model that integrates non-linear, generative, conversational and affective perspectives on interactivity is proposed

A performer\u27s guide to multimedia compositions for clarinet and visuals: a tutorial focusing on works by Joel Chabade, Merrill Ellis, William O. Smith, and Reynold Weidenaar.

The clarinetist of today is challenged by advancements in contemporary music and technology. In addition to the difficulties with contemporary clarinet techniques and with the onset of electronic music, multimedia compositions from the last forty years have presented an additional obstacle: the visual element. This written document provides a concise historical perspective of multimedia compositions utilizing clarinet and a tutorial focusing on the preparation of four multimedia works. A catalog of multimedia compositions for clarinet with visuals is included to provide information about literature and availability. This document contains an historical essay, summarizing developments in technology and changes in music composition from the late 1950s to the present, focusing on multimedia clarinet music. It also chronicles the development of multimedia music for the clarinet as both a solo and a chamber instrument. Four multimedia works are presented for study in this document. The pieces were selected according to several criteria such as date of composition, composer\u27s influence, availability, type of visual used, and success in performance or competition. Each piece is representative of one decade: 1960s, 1970s, 1980s, and 1990s. These include Joel Chadabe\u27s Street Scene (1967), Merrill Ellis\u27s A Dream Fantasy (1974), William O. Smith\u27s Slow Motion (1987), and Reynold Weidenaar\u27s Swing Bridge (1997), respectively. A chapter is provided for each of the composers represented by compositions in the recital to provide a biography of the composer, and a description of the piece used for performance in the lecture recital. A tutorial section for each piece offers a preparation and rehearsal guide as well as suggestions for set-up and performance. Clarinetists may be unaware of multimedia literature due to the absence of a catalog. This document includes a catalog of multimedia compositions to aid clarinetists in their search for performance literature. The goal of this recital and written document is to create an awareness and interest in this art form as well as to provide useful strategies for its preparation and performance

Grand Valley Forum, volume 024, number 16, November 15, 1999

Grand Valley Forum is Grand Valley State\u27s faculty and staff newsletter, published from 1976 to the present

Faculty recital series: Ketty Nez, piano, Katie Wolfe, violin, January 22, 2008

This is the concert program of the Faculty recital series: Ketty Nez, piano, Katie Wolfe, violin performance on Tuesday, January 22, 2008 at 8:00 p.m., at the Concert Hall, 855 Commonwealth Avenue. Works performed were Sonata for Violin and Piano by Ruth Crawford, "Tête à tête" by Elaine Aberdam "before" by Ketty Nez, "Insolence" by Amelia S. Kaplan, and Sonata in A minor for Violin and Piano, opus 34 by Amy Beach. Digitization for Boston University Concert Programs was supported by the Boston University Center for the Humanities Library Endowed Fund