Capture and transfer of metadata during video production

Video production is a complex process that requires the capture and annotation of video sequences that become assembled together into a final presentation. At different stages of the process information is captured and associated with the video sequence, to be used by some other process at some later stage. In this paper we go through the video production chain step by step and identify where media or metadata is captured and express this in terms of an associated proposed canonical mode

Figure of Speech Detection and Generation as a Service in IDN Authoring Support

IDN authoring is a complex and creative endeavour. This paper provides the basis for a collaborative text-based authoring tool to support the work with figures of speech, such as metaphors, similes and metonymies. Several models have been tested and BERT, as best performing, has been used for creating functions to predict a figure of speech and, using an embedding of the custom database, return figures of speeches that are closest to the input, and generating new figures of speech. The implemented functions were validated using writers active in different fields. All the code, the databases and the models can be found in this GitHub: link to GitHub.</p

Generating Media Stories - Play It Again, Sam

New types of knowledge spaces, such as the Semantic Web, allow for yet uncharted forms of knowledge exploration and social relationships. Such interactive, open and multimodal environments sustain the activation of articulation expressions that form the basis of adaptive discourses. In this paper we are in particular interested what story generation requires, in such a context, from authors and how that reflects on the accessibility of the information to users. The examples are taken form the domain of documentary making

Everything You Wanted to Know About MPEG-7: Part 2

Part 1 of this article provided an overview of the development, functionality, and applicability of MPEG-7. In Part 2 we discuss the description of MPEG-7 s concepts, terminology, and requirements. We then compare MPEG-7 with other approaches to multimedia content description

Everything You Wanted to Know About MPEG-7: Part 1

Part I of this article provides an overview of the development, functionality, and applicability of MPEG-7. We ll first present the role of MPEG-7 within the context of past MPEG standards. We then outline ideas of what should be possible using MPEG-7 technology. In Part II, we ll discuss the description of MPEG-7 s concepts, terminology, and requirements. We ll then compare MPEG-7 to other approaches on multimedia content description

Denotative and connotative semantics in hypermedia: proposal for a semiotic-aware architecture

In this article we claim that the linguistic-centred view within hypermediasystems needs refinement through a semiotic-based approach before real interoperation between media can be achieved. We discuss the problems of visual signification for images and video in dynamic systems, in which users can access visual material in a non-linear fashion. We describe how semiotics can help overcome such problems, by allowing descriptions of the material on both denotative and connotative levels. Finally we propose an architecture for a dynamic semiotic-aware hypermedia system

Towards a syntax for multimedia semantics

This article describes the current state of the art on representing the fouressential conceptual facets of a multimedia unit, namely the form and substance of content and the form and substance of its expression, and points to the still un solved problems regarding the syntax for media semantics. We first provide a brief overview of the general features of the MPEG-7 standard and its different parts. This serves as a description of the state of the art in content description for audio-visual media. We then analyse the ability of one of these parts for its capability to define structures for describing media semantics. We describe the problems of two currently conflicting MPEG-7 representations of expression-based media semantic, which should be equivalent. We then discuss high-level aspects of media semantics, namely the general problems of an ontology for media semantics. Finally, we talk about the problems of applying the theoretical conceptsto real applications

Context aware guidance for multimedia authoring: harmonizing domain and discourse knowledge

This paper presents an approach to assist authors during the authoring of multimedia presentations. We extend existing authoring support by integrating processes of topic identification, content collection and discourse structure building in a single environment. This integration allows identification of the context of the authoring process. Our approach combines this process context awareness with explicit domain and discourse knowledge to steer system suggestions. We evaluate our approach with an experimental system prototyp

Supporting the generation of argument structure within video sequences

Browsing is a useful way of exploring annotated media repositories. Sets of links can be automatically created from the annotations associated with the media items in the repository. When there are also relationships among the annotations themselves, such as when the annotation terms are part of a thesaurus, these relations can also be used in the link generation process. Using structured annotations and a thesaurus for generating link sets has two advantages. The first is to evaluate the effectiveness of the terms in the thesaurus for classifying the media items in the repository. The second is to be able to control the links being generated by changing relationships within the thesaurus. The work is illustrated using video segments annotated with argument structures, but we show that the method used is independent of the media types and applicable to systems that use similar annotation structures and typed relations among the

Designing interactive ambient multimedia applications: requirements and implementation challenges

Ambient intelligence opens new possibilities for interactive multimedia, leading towards applications where the selection, generation and playback of multimedia content can be directed and influenced by multiple users in an ambient sensor network. In this paper, we derive the basic requirements for a flexible infrastructure that can support the integration of multimedia and ambient intelligence, and enable rapid tailoring of interactive multimedia applications. We describe our implementation of the proposed infrastructure, and demonstrate its functionality through several prototype application