Processing Structured Hypermedia : A Matter of Style

With the introduction of the World Wide Web in the early nineties, hypermedia has become the uniform interface to the wide variety of information sources available over the Internet. The full potential of the Web, however, can only be realized by building on the strengths of its underlying research fields. This book describes the areas of hypertext, multimedia, electronic publishing and the World Wide Web and points out fundamental similarities and differences in approaches towards the processing of information. It gives an overview of the dominant models and tools developed in these fields and describes the key interrelationships and mutual incompatibilities. In addition to a formal specification of a selection of these models, the book discusses the impact of the models described on the software architectures that have been developed for processing hypermedia documents. Two example hypermedia architectures are described in more detail: the DejaVu object-oriented hypermedia framework, developed at the VU, and CWI's Berlage environment for time-based hypermedia document transformations

The DIGMAP geo-temporal web gazetteer service

This paper presents the DIGMAP geo-temporal Web gazetteer service, a system providing access to names of places, historical periods, and associated geo-temporal information. Within the DIGMAP project, this gazetteer serves as the unified repository of geographic and temporal information, assisting in the recognition and disambiguation of geo-temporal expressions over text, as well as in resource searching and indexing. We describe the data integration methodology, the handling of temporal information and some of the applications that use the gazetteer. Initial evaluation results show that the proposed system can adequately support several tasks related to geo-temporal information extraction and retrieval

Processing Structured Hypermedia - A Matter of Style

Vliet, J.C. van [Promotor]Eliens, A. [Copromotor

A query description model based on basic semantic unit composite Petri-Net for soccer video

Digital video networks are making available increasing amounts of sports video data. The volume of material on offer means that sports fans often rely on prepared summaries of game highlights to follow the progress of their favourite teams. A significant application area for automated video analysis technology is the generation of personalized highlights of sports events. One of the most popular sports around world is soccer. A soccer game is composed of a range of significant events, such as goal scoring, fouls, and substitutions. Automatically detecting these events in a soccer video can enable users to interactively design their own highlights programmes. From an analysis of broadcast soccer video, we propose a query description model based on Basic Semantic Unit Composite Petri-Nets (BSUCPN) to automatically detect significant events within soccer video. Firstly we define a Basic Semantic Unit (BSU) set for soccer videos based on identifiable feature elements within a soccer video, Secondly we design Composite Petri-Net (CPN) models for semantic queries and use these to describe BSUCPNs for semantic events in soccer videos. A particular strength of this approach is that users are able to design their own semantic event queries based on BSUCPNs to search interactively within soccer videos. Experimental results based on recorded soccer broadcasts are used to illustrate the potential of this approach

Cueing animations: Dynamic signaling aids information extraction and comprehension

The effectiveness of animations containing two novel forms of animation cueing that target relations between event units rather than individual entities was compared with that of animations containing conventional entity-based cueing or no cues. These relational event unit cues (progressive path and local coordinated cues) were specifically designed to support key learning processes posited by the Animation Processing Model (Lowe & Boucheix, 2008). Four groups of undergraduates (N = 84) studied a user-controllable animation of a piano mechanism and then were assessed for mental model quality (via a written comprehension test) and knowledge of the mechanism's dynamics (via a novel non-verbal manipulation test). Time-locked eye tracking was used to characterize participants' obedience to cues (initial engagement versus ongoing loyalty) across the learning period. For both output measures, participants in the two relational event unit cueing conditions were superior to those in the entity-based and uncued conditions. Time-locked eye tracking analysis of cue obedience revealed that initial cue engagement did not guarantee ongoing cue loyalty. The findings suggest that the Animation Processing Model provides a principled basis for designing more effective animation support

Keeping Track of Time:The Role of Spatial and Embodied Cognition in the Comprehension of Nonlinear Storyworlds

ABSTRACT: What allows an audience to make sense of stories with complex nonlinear time structures that are radically different from everyday experience? To address this question, we distinguish between two types of narrative nonlinearity: nonlinear storytelling (a non-chronological presentation of events in the narration) and nonlinear storyworlds (nonlinearity as a feature of the narrated world, for instance by way of time-travel or temporal loops). With most scholarly attention focusing on the former, here we focus on the latter, as the question of what allows audiences to make sense of strange and impossible storyworld temporalities has remained somewhat overlooked. Drawing on the available research on text comprehension, we first discuss how both strategies of nonlinearity affect narrative comprehension differently. We then ask what cognitive abilities allow spectators to engage with nonlinear storyworlds. Drawing on insights from conceptual metaphor theory and mental timeline theory, we propose that the comprehension of nonlinear storyworlds is facilitated by the cognitive ability to mentally represent time in terms of space. By metaphorically blending spatial and embodied concepts into narrative timelines, strategies of spatial mental representation allow spectators to conceive and comprehend various forms of phenomenologically non-experienceable time structures—a hypothesis we seek to demonstrate through several cases of nonlinear storyworlds from contemporary complex cinema

Extensions to the SMIL multimedia language

The goal of this work has been to extend the Synchronized Multimedia Integration Language (SMIL) to study the capabilities and possibilities of declarative multimedia languages for the World Wide Web (Web). The work has involved design and implementation of several extensions to SMIL. A novel approach to include 3D audio in SMIL was designed and implemented. This involved extending the SMIL 2D spatial model with an extra dimension to support a 3D space. New audio elements and a listening point were positioned in the 3D space. The extension was designed to be modular so that it was possible to use it in conjunction with other XML languages, such as XHTML and Scalable Vector Graphics (SVG) language. Web forms are one of the key features in the Web, as they offer a way to send user data to a server. A similar feature is therefore desirable in SMIL, which currently lacks forms. The XForms language, due to its modular approach, was used to add this feature to SMIL. An evaluation of this integration was carried out as part of this work. Furthermore, the SMIL player was designed to play out dynamic SMIL documents, which can be modified at run-time and the result is immediately reflected in the presentation. Dynamic SMIL enables execution of scripts to modify the presentation. XML Events and ECMAScript were chosen to provide the scripting functionality. In addition, generic methods to extend SMIL were studied based on the previous extensions. These methods include ways to attach new input and output capabilities to SMIL. To experiment with the extensions, a Synchronized Multimedia Integration Language (SMIL) player was developed. The current final version can play out SMIL 2.0 Basic profile documents with a few additional SMIL modules, such as event timing, basic animations, and brush media modules. The player includes all above-mentioned extensions. The SMIL player has been designed to work within an XML browser called X-Smiles. X-Smiles is intended for various embedded devices, such as mobile phones, Personal Digital Assistants (PDA), and digital television set-top boxes. Currently, the browser supports XHTML, SMIL, and XForms, which are developed by the current research group. The browser also supports other XML languages developed by 3rd party open-source projects. The SMIL player can also be run as a standalone player without the browser. The standalone player is portable and has been run on a desktop PC, PDA, and digital television set-top box. The core of the SMIL player is platform-independent, only media renderers require platform-dependent implementation.reviewe

Integration of Web Browsers and Interactive TV

Interactive TV(ITV) technologies enhance the conventional TV services and enable user--content interaction. The World Wide Web is currently the most popular approach to information exchange. The ``Integration of Interactive TV and web browsers'' project studies the convergence of the two areas which is important since both areas can benefit each other. We focus on an ITV extension for an existing web browser. The ``Multimedia and Hypermedia information coding Experts Group'' part 5 (MHEG-5) standard is selected as representative for the ITV area, and the Extensible Markup Language (XML) and Document Object Model (DOM) standards for the web browsers area. We present the design and implementation of an MHEG extension for a web browser and integrate the MHEG and DOM event models in order to achieve an easier and more compact MHEG event model implementation. Our study provides the foundation for the convergence of the two technologies by a thorough study, implementation and evaluation of ITV and browser integration