General Soundtrack Analysis

An overview of work on broadcast soundtrack monitoring by the the Laboratory for Recognition and Organization of Speech and Audio, Department of Electrical Engineering, Columbia University

An investigation of the role of background music in IVWs for learning

Empirical evidence is needed to corroborate the intuitions of gamers and game developers in understanding the benefits of Immersive Virtual Worlds (IVWs) as a learning environment and the role that music plays within these environments. We report an investigation to determine if background music of the genre typically found in computer‐based role‐playing games has an effect on learning in a computer‐animated history lesson about the Macquarie Lighthouse within an IVW. In Experiment 1, music stimuli were created from four different computer game soundtracks. Seventy‐two undergraduate students watched the presentation and completed a survey including biographical details, questions on the historical material presented and questions relating to their perceived level of immersion. While the tempo and pitch of the music was unrelated to learning, music conditions resulted in a higher number of accurately remembered facts than the no music condition. One soundtrack showed a statistically significant improvement in memorisation of facts over other music conditions. Also an interaction between the levels of perceived immersion and ability to accurately remember facts was observed. Experiment 2, involving 48 undergraduate students, further investigated the effect of music, sense of immersion and how different display systems affect memory for facts

One's own soundtrack: Affective music synthesis

Computer music usually sounds mechanical; hence, if musicality and music expression of virtual actors could be enhanced according to the user's mood, the quality of experience would be amplified. We present a solution that is based on improvisation using cognitive models, case based reasoning (CBR) and fuzzy values acting on close-to-affect-target musical notes as retrieved from CBR per context. It modifies music pieces according to the interpretation of the user's emotive state as computed by the emotive input acquisition componential of the CALLAS framework. The CALLAS framework incorporates the Pleasure-Arousal- Dominance (PAD) model that reflects emotive state of the user and represents the criteria for the music affectivisation process. Using combinations of positive and negative states for affective dynamics, the octants of temperament space as specified by this model are stored as base reference emotive states in the case repository, each case including a configurable mapping of affectivisation parameters. Suitable previous cases are selected and retrieved by the CBR subsystem to compute solutions for new cases, affect values from which control the music synthesis process allowing for a level of interactivity that makes way for an interesting environment to experiment and learn about expression in music

City-Identification of Flickr Videos Using Semantic Acoustic Features

City-identification of videos aims to determine the likelihood of a video belonging to a set of cities. In this paper, we present an approach using only audio, thus we do not use any additional modality such as images, user-tags or geo-tags. In this manner, we show to what extent the city-location of videos correlates to their acoustic information. Success in this task suggests improvements can be made to complement the other modalities. In particular, we present a method to compute and use semantic acoustic features to perform city-identification and the features show semantic evidence of the identification. The semantic evidence is given by a taxonomy of urban sounds and expresses the potential presence of these sounds in the city- soundtracks. We used the MediaEval Placing Task set, which contains Flickr videos labeled by city. In addition, we used the UrbanSound8K set containing audio clips labeled by sound- type. Our method improved the state-of-the-art performance and provides a novel semantic approach to this tas

Electronic Dance Music in Narrative Film

As a growing number of filmmakers are moving away from the traditional model of orchestral underscoring in favor of a more contemporary approach to film sound, electronic dance music (EDM) is playing an increasingly important role in current soundtrack practice. With a focus on two specific examples, Tom Tykwer’s Run Lola Run (1998) and Darren Aronofsky’s Pi (1998), this essay discusses the possibilities that such a distinctive aesthetics brings to filmmaking, especially with regard to audiovisual rhythm and sonic integration

Listening in/To Germany, Pale Mother

A newly restored version of Helma Sanders-Brahms’ 1980 film, Deutschland, bleiche Mutter (Germany, Pale Mother), was premiered in 2014 as a “Berlinale Classic”. This article reveals a complex composition of archival and (re)constructed sound that amplifies the film’s problematisation of the relationship between public history and private memory and the competing claims to authenticity and authority in telling the stories of the past

The longer term value of creativity judgements in computational creativity

During research to develop the Standardised Procedure for Evaluating Creative Systems (SPECS) methodology for evaluat- ing the creativity of ‘creative’ systems, in 2011 an evaluation case study was carried out. The case study investigated how we can make a ‘snapshot’ decision, in a short space of time, on the creativity of systems in various domains. The systems to be evaluated were presented at the International Computational Creativity Conference in 2011. Evaluation was performed by people whose domain expertise ranges from expert to novice, depending on the system. The SPECS methodology was used for evaluation, and was compared to two other creativity evaluation methods (Ritchie’s criteria and Colton’s Creative Tripod) and to results from surveying people’s opinion on the creativity of the systems under investigation. Here, we revisit those results, considering them in the context of what these systems have contributed to computational creativity development. Five years on, we now have data on how influential these systems were within computational creativity, and to what extent the work in these systems has influenced further developments in computational creativity research. This paper investigates whether the evaluations of creativity of these systems have been helpful in predicting which systems will be more influential in computational creativity (as measured by paper citations and further development within later computational systems). While a direct correlation between evaluative results and longer term impact is not discovered (and perhaps too simplistic an aim, given the factors at play in determining research impact), some interesting alignments are noted between the 2011 results and the impact of papers five years on

Listen to Nice

In describing Humphrey Jennings’ wartime documentary propaganda film, 'Listen to Britain' (1942), a film with an overtly poetic sensibility and dominantly musical soundtrack, John Corner asserts that ‘through listening to Britain, we are enabled to properly look at it'. This idea of sound leading our attention to the images has underpinned much of the collaborative work between composer and sound designer, Geoffrey Cox, and documentary filmmaker, Keith Marley. It is in this context that the article will analyse an extract of A Film About Nice (Marley and Cox 2010), a contemporary re-imagining of Jean Vigo’s silent documentary, 'A propos de Nice' (1930). Reference will be made throughout to the historical context, and the filmic and theoretical influences that have informed the way music and creative sound design have been used to place emphasis on hearing a place, as much as seeing it