A dynamic petri net model for iterative and interactive distributed multimedia presentation

Object Composition Petri Nets (OCPN), Priority Petri Nets (P-Net), Dynamic OCPN (DOCPN) and Enhanced P-Nets (EP-Net) have extended the original Petri Net to achieve the modeling of media synchronization and asynchronous user interactions during multimedia playback. Dynamic Petri Net (DPN) has been conceptualized to tackle existing problems in these two areas of modeling distributed multimedia systems. DPN features dynamic modeling elements which allows iteration and hence is able to reduce graph sizes of synchronous playback models while allowing greater details to be shown. DPN also introduces asynchronous event handling techniques that are powerful and effective. DPN was used in the design and modeling of a multimedia orchestration tool which is a typical representation of an application that works in a distributed multimedia system

A Component Model for Transmission and Processing of Synchronized Multimedia Data Flows

International audienceOur research deals with distributed multimedia applications built on software components. Currently, multimedia data are omnipresent on the Internet. However, this network is not designed to support and transmit multimedia data. In this perspective, it is necessary to introduce quality of service management in this kind of applications. In this paper, we are particularly interested in the inter-flow synchronization (e.g. audio and image flows of a video). We develop a component model in order to tackle the synchronization between multimedia flows from the source (e.g. media capture) to the destination (e.g. media player). This model is named OSAGAIA* and is made of two entities. The first one is called elementary processor. It is used as the runtime environment (component container) for multimedia components. The second one is called conduit. It is used to transport synchronous multimedia flows between elementary processors. So, distributed applications are composed of multimedia components (within containers) connected by multimedia flows (within conduits). We are working on a distributed prototype which validates the synchronization algorithms that we use. It is implemented with Java language using JMF (Java Media Framework) API and TCP/IP as network protocol

Structured multimedia authoring

We present the user interface to the CMIF authoring environment for constructing and playing multimedia presentations. The CMIF authoring environment supports a rich hypermedia document model allowing structure-based composition of multimedia presentations and the specification of synchronization constraints between constituent media items. An author constructs a multimedia presentation in terms of its structure and additional synchronization constraints, from which the CMIF player derives the precise timing information for the presentation. We discuss the advantages of a structured approach to authoring multimedia, and describe the facilities in the CMIF authoring environment for supporting this approach. The authoring environment presents three main views of a multimedia presentation: the hierarchy view is used for manipulating and viewing a presentation's hierarchical structure; the channel view is used for managing logical resources and specifying and viewing precise timing constra..

Synchronization of Olfaction-enhanced multimedia

This paper presents the results of an experimental study carried out to explore, from an end user perspective, the temporal boundaries within which olfactory data can be used to enhance multimedia applications. Results show the presence of two main synchronization regions, and that olfaction ahead of audiovisual content is more tolerable than olfaction behind content

On the use of adaptive media playout for inter-destination synchronization

[EN] Inter-Destination Multimedia Synchronization (IDMS) is essential in most of the emerging social multimedia applications. In this paper we present a novel Adaptive Media Playout (AMP) scheme that aims to acquire an overall synchronization status between distributed receivers by means of smoothly adjusting their playout timing. Simulation results show that the proposed solution minimizes long-term playout discontinuities (skips and/or pauses) which are subjectively more annoying to users than small variations in the media playout rate.This work was supported by the Universitat Politecnica de Valencia (UPV), under its R&D Support Program in the PAID-01-10 Project, and by Generalitat Valenciana, under its R&D Support Program in the GV 2010/009 Project.Montagud, M.; Boronat, F. (2011). On the use of adaptive media playout for inter-destination synchronization. IEEE Communications Letters. 15(9):863-865. https://doi.org/10.1109/LCOMM.2011.061611.110072S86386515

Automatic Synchronization of Multi-User Photo Galleries

In this paper we address the issue of photo galleries synchronization, where pictures related to the same event are collected by different users. Existing solutions to address the problem are usually based on unrealistic assumptions, like time consistency across photo galleries, and often heavily rely on heuristics, limiting therefore the applicability to real-world scenarios. We propose a solution that achieves better generalization performance for the synchronization task compared to the available literature. The method is characterized by three stages: at first, deep convolutional neural network features are used to assess the visual similarity among the photos; then, pairs of similar photos are detected across different galleries and used to construct a graph; eventually, a probabilistic graphical model is used to estimate the temporal offset of each pair of galleries, by traversing the minimum spanning tree extracted from this graph. The experimental evaluation is conducted on four publicly available datasets covering different types of events, demonstrating the strength of our proposed method. A thorough discussion of the obtained results is provided for a critical assessment of the quality in synchronization.Comment: ACCEPTED to IEEE Transactions on Multimedi