Affect-based indexing and retrieval of multimedia data

Digital multimedia systems are creating many new opportunities for rapid access to content archives. In order to explore these collections using search, the content must be annotated with significant features. An important and often overlooked aspect o f human interpretation o f multimedia data is the affective dimension. The hypothesis o f this thesis is that affective labels o f content can be extracted automatically from within multimedia data streams, and that these can then be used for content-based retrieval and browsing. A novel system is presented for extracting affective features from video content and mapping it onto a set o f keywords with predetermined emotional interpretations. These labels are then used to demonstrate affect-based retrieval on a range o f feature films. Because o f the subjective nature o f the words people use to describe emotions, an approach towards an open vocabulary query system utilizing the electronic lexical database WordNet is also presented. This gives flexibility for search queries to be extended to include keywords without predetermined emotional interpretations using a word-similarity measure. The thesis presents the framework and design for the affectbased indexing and retrieval system along with experiments, analysis, and conclusions

‘All we have is words, all we have is worlds’- language, looping and the work of Tim Etchells

Since entering the performance lexicon in the 1970s, the term Live Art has been used to describe a diverse but interrelated array of performance practices and approaches. This volume offers a contextual and critical introduction to the scene of contemporary Live Art in Britain. Focusing on the key artists, companies and organisations with a prolific body of work and which have been vital to the development of contemporary practice, this edited volume maps the landscape, illuminating the origins, concerns and aesthetics of Live Art in the UK today

Toward media collection-based storytelling

Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2007.Includes bibliographical references (p. 113-118).Life is filled with stories. Modern technologies enable us to document and share life events with various kinds of media, such as photos, videos, etc. But people still find it time-consuming to select and arrange media fragments to create coherent and engaging narratives. This thesis proposes a novel storytelling system called Storied Navigation, which lets users assemble a sequence of video clips based on their roles in telling a story, rather than solely by explicit start and end times. Storied Navigation uses textual annotations expressed in unconstrained natural language, using parsing and Commonsense reasoning to deduce possible connections between the narrative intent of the storyteller, and descriptions of events and characters in the video. It helps users increase their familiarity with a documentary video corpus. It helps them develop story threads by prompting them with recommendations of alternatives as well as possible continuations for each selected video clip. We view it as a promising first step towards transforming today's fragmented media production experience into an enjoyable, integrated storytelling activity.Edward Yu-Te Chen.S.M

2000-2002 Course Catalog

2000-2002 Course Catalo

Artistic and Musical Applications of Internet Search Technologies: Prospects and a Case Study

This paper explores the idea of internet search as a technology to underpin artistic creation. Concepts of interactivity in art and music are explored, and then an overview of different types of internet-based art is presented. A number of different ways in which internet search have the potential to underpin artistic and musical activity are then discussed, with ideas such as the idea of a collective readymade and aesthetics of mass and unexpected connections are used to give this discussion a theoretical basis. Finally, a case study is given, in which the author discusses one of their own multimedia artworks that makes substantial use of internet search