Advanced visual rendering, gesture-based interaction and distributed delivery for immersive and interactive media services

The media industry is currently being pulled in the often-opposing directions of increased realism (high resolution, stereoscopic, large screen) and personalisation (selection and control of content, availability on many devices). A capture, production, delivery and rendering system capable of supporting both these trends is being developed by a consortium of European organisations including partners from the broadcast, film, telecoms and academic sectors, in the EU-funded FascinatE project. This paper reports on the latest project developments in the delivery network and end-user device domains, including advanced audiovisual rendering, computer analysis and scripting, content-aware distributed delivery and gesture-based interaction. The paper includes an overview of existing immersive media services and concludes with initial service concept descriptions and their market potential.Peer ReviewedPreprin

FascinatE D5.1.1 AV renderer specification and basic characterisation of audience interaction

This document presents the renderer specification and basic characterisation of audience interaction for the FascinatE system.Peer ReviewedPostprint (published version

Advanced visual rendering, gesture-based interaction and distributed delivery for immersive and interactive media services

The media industry is currently being pulled in the often-opposing directions of increased realism (high resolution, stereoscopic, large screen) and personalisation (selection and control of content, availability on many devices). A capture, production, delivery and rendering system capable of supporting both these trends is being developed by a consortium of European organisations including partners from the broadcast, film, telecoms and academic sectors, in the EU-funded FascinatE project. This paper reports on the latest project developments in the delivery network and end-user device domains, including advanced audiovisual rendering, computer analysis and scripting, content-aware distributed delivery and gesture-based interaction. The paper includes an overview of existing immersive media services and concludes with initial service concept descriptions and their market potential.Peer Reviewe

FascinatE D5.1.1 AV renderer specification and basic characterisation of audience interaction

This document presents the renderer specification and basic characterisation of audience interaction for the FascinatE system.Peer Reviewe

Format-agnostic approach for production, delivery and rendering of immersive media

The media industry is currently being pulled in the often-opposing directions of increased realism (high resolution, stereoscopic, large screen) and personalisation (selection and control of content, availability on many devices). A capture, production, delivery and rendering system capable of supporting both these trends is being developed by the EU-funded FascinatE project. In this paper, different aspects of the format agnostic approach are discussed which we believe can be a promising concept for future media production and consumption. The different parts of the complete multimedia production and delivery process are revisited demonstrating the requirements and the potential of such an advanced concept

AV renderer with enhanced processing with integration of scripting language. FascinatE deliverable D5.1.3

Postprint (author’s final draft

Dissemination and exploitation plan (including standardisation). FascinatE deliverable D7.1.3b

Postprint (author’s final draft

Towards a format-agnostic approach for production, delivery and rendering of immersive media

The media industry is currently being pulled in the often-opposing directions of increased realism (high resolution, stereoscopic, large screen) and personalization (selection and control of content, availability on many devices). We investigate the feasibility of an end-to-end format-agnostic approach to support both these trends. In this paper, different aspects of a format- agnostic capture, production, delivery and rendering system are discussed. At the capture stage, the concept of layered scene representation is introduced, including panoramic video and 3D audio capture. At the analysis stage, a virtual director component is discussed that allows for automatic execution of cinematographic principles, using feature tracking and saliency detection. At the delivery stage, resolution-independent audiovisual transport mechanisms for both managed and unmanaged networks are treated. In the rendering stage, a rendering process that includes the manipulation of audiovisual content to match the connected display and loudspeaker properties is introduced. Different parts of the complete system are revisited demonstrating the requirements and the potential of this advanced concept.Peer Reviewe

Format-agnostic approach for production, delivery and rendering of immersive media

The media industry is currently being pulled in the often-opposing directions of increased realism (high resolution, stereoscopic, large screen) and personalisation (selection and control of content, availability on many devices). A capture, production, delivery and rendering system capable of supporting both these trends is being developed by the EU-funded FascinatE project. In this paper, different aspects of the format agnostic approach are discussed which we believe can be a promising concept for future media production and consumption. The different parts of the complete multimedia production and delivery process are revisited demonstrating the requirements and the potential of such an advanced concept.Peer Reviewe