Creating meaningful multimedia presentations

Finding relevant information is one step in the chain of understanding information. Presenting material to a user in a suitable way is a further step. Our research focuses on using semantic annotations of multimedia elements to increase the "presentability" of retrieved information. We investigate the use of domain semantics and discourse semantics for improving information presentation. In particular, we present work showing the use of domain semantics for grouping search results, the combined use of domain and discourse semantics for creating a particular genre of multimedia presentation (biography) and finally show the combination of argumentation structures and domain semantics for generating coherent sequences of video material. We provide comments and insights into the viability of these techniques

Supporting the generation of argument structure within video sequences

Browsing is a useful way of exploring annotated media repositories. Sets of links can be automatically created from the annotations associated with the media items in the repository. When there are also relationships among the annotations themselves, such as when the annotation terms are part of a thesaurus, these relations can also be used in the link generation process. Using structured annotations and a thesaurus for generating link sets has two advantages. The first is to evaluate the effectiveness of the terms in the thesaurus for classifying the media items in the repository. The second is to be able to control the links being generated by changing relationships within the thesaurus. The work is illustrated using video segments annotated with argument structures, but we show that the method used is independent of the media types and applicable to systems that use similar annotation structures and typed relations among the

Towards smart style : combining RDF semantics with XML document transformations

The 'Document Web' has established itself through the creation of an impressive family of XML and related languages. In addition to this, the 'Semantic Web' is developing its own family of languages based primarily on RDF. Although these families were both developed specifically for 'the Web', each language family has been developed from different premises with specific goals in mind. The result is that combining both families in a single application is surprisingly difficult. This is unfortunate, since the combination of semantic processing with document processing provides advantages in both directions --- namely using semantic inferencing for more intelligent document processing and using document processing tools for presenting semantic representations to an end-user. In this paper, we investigate this integration problem, focusing on the role of (RDF) semantics in selecting, structuring and styling (XML) content. We analyze the approaches taken by two example architectures and use our analysis to derive a more integrated alternative

Video on the semantic web : experiences with media streams

In this paper, we report our experiences with the use of SemanticWeb technology for annotating digital video material.Web technology is used to transform a large, existing video ontology embedded in an annotation tool into a commonly accessible format. The recombination of existing video material is then used as an example application, in which the video metadata enables the retrieval of video footage based on both content descriptions and cinematographic concepts, such as establishing and reaction shots. The paper focuses on the practical issues of porting ontological information to the Semantic Web, the multimedia-specific issues of video annotation, and requirements for Semantic Web query and access patterns. It thereby explicitly aims at providing input to the two new W3C Semantic Web Working Groups (Best Practices and Deployment; Data Access)

Canonical processes of media production

Creating compelling multimedia presentations is a complex task. It involves the capture of media assets, then editing and authoring these into one or more final presentations. Tools tend to concentrate on a single aspect of media production to reduce the complexity of the interface and to tailor support to a specific task. While these tools are suited to the task they are designed for, very often there is no consideration for input requirements for the next tool down the line. Each tool in the multimedia production chain has the potential for adding semantic annotations to the media asset at hand, describing relevant aspects of the asset and why it is being used for a particular purpose. These annotations need to be included in the information handed over to the next tool in the production chain. We specify inputs and outputs to a number of canonical processes we identify in multimedia production. We do not specify the intricate workings of the processes, but concentrate on the information flow between them. Our claim is that by specifying explicitly the input and output required for processes that occur in widely differing uses of media we can provide the tool-building community with a small set of building blocks that can be supported for semantically aware media production tool

Towards a syntax for multimedia semantics

This article describes the current state of the art on representing the fouressential conceptual facets of a multimedia unit, namely the form and substance of content and the form and substance of its expression, and points to the still un solved problems regarding the syntax for media semantics. We first provide a brief overview of the general features of the MPEG-7 standard and its different parts. This serves as a description of the state of the art in content description for audio-visual media. We then analyse the ability of one of these parts for its capability to define structures for describing media semantics. We describe the problems of two currently conflicting MPEG-7 representations of expression-based media semantic, which should be equivalent. We then discuss high-level aspects of media semantics, namely the general problems of an ontology for media semantics. Finally, we talk about the problems of applying the theoretical conceptsto real applications