A graphics software architecture for high-end interactive TV terminals

This thesis proposes a graphics architecture for next-generation digital television receivers. The starting assumption is that in the future, a number of multimedia terminals will have access through a number of networks to a variety of content and services. One example of such a device is a media station capable of integrating different kinds of multimedia objects such as 2D/3D graphics and video, reacting to user interaction, and supporting the temporal dimension of applications. Some of the services intended for these devices include, for example, games and enhanced information over broadcasted video. First, this thesis provides an overview of the digital television environment, focusing on the limitations of current receivers and hints at future directions. In addition, this thesis compares different solutions from regional standardisation bodies such as DVB, CableLabs, and ARIB. It proposes the adoption of the most relevant initiative, GEM by DVB. Unfortunately, GEM software middleware only considers Java language as an authoring format, meaning that the declarative environment and advanced functionalities (e.g., 3D graphics support) remain to be standardised. Because in the future different user groups will have different demands with regard to television, this thesis identifies two major extensions to the GEM standard. First, it proposes a declarative environment for GEM that takes into account W3C standardisation efforts. This environment is divided into two configurations: one capable of rendering limited interactive applications such as information services, and another intended for more demanding applications, for example a distance learning portal that synchronises videos of lecturers and slides. Second, this thesis proposes to extend the procedural environment of GEM with 3D graphics support. The potential services of this new profile, High-End Interactive, include games and commercials. Then, based on the requirements the proposed profiles should meet, this thesis defines a graphics architecture model composed of five layers. The hardware abstraction layer is in charge of rendering the final graphics output. The graphical context is a cross-platform abstraction of the rendering region and provides graphics primitives (e.g., rectangles and images). The graphical environment provides the means to control different graphical contexts. The GUI toolkit is a set of ready-made user interface widgets and layout schemes. Finally, high-level languages are easy-to-use tools for developing simple services. The thesis concludes with a report of my experience implementing a digital television receiver based on the proposals described. In addition to testing the application of the proposed graphics architecture to the design and implementation of a next-generation digital television receiver, the implementation permits the analysis of the requirements of such receivers and of the services they can provide.reviewe

Converged digital TV services: the role of middleware and future directions of interactive television

The subject of the future of the interactive Television medium has become a topic of great interest to the academic and industrial communities particularly since in the recent years there has been a dramatic increase in the pace of innovation of convergence of digital TV systems and services. The purpose of this paper is to provide a brief overview of what we know as digital TV converged services, to present and categorise the digital Television middleware technologies that contributed to it, and to present possible future trends and directions. A new Television era of converged wireless and mobile content delivery, user-authored content, multimodal interaction, intelligent personalisation, smart space awareness, and 3D content sensations is foreseen, creating ambient and immersive experiences

Interactive Digital Terrestrial Television: The Interoperability Challenge in Brazil

This paper introduces different standards implemented in existing Digital Terrestrial Television Broadcasting systems to allow the fruition of interactive services and applications through digital Set Top Boxes. It focuses on the interoperability issue between the Brazilian and the European architectures. In fact, despite in Brazil the GEM specification has been designed to foster wide content compatibility across a range of interactive platforms, it has never come to a final implementation and deployment. As a result the interoperability issue has been deeply explored in the BEACON project and an innovative system architecture has been developed to deploy t-learning services across Europe and Brazil, providing integration of those systems that were not able to interoperate until nowadays. This work is an important step in the direction of standards' interoperability. As a result, MHP and Ginga NCL-Lua implementation appeared to be the very best choice to deliver interactive services in an interoperable mode between European and Brazilian digital television

Digital television applications

Studying development of interactive services for digital television is a leading edge area of work as there is minimal research or precedent to guide their design. Published research is limited and therefore this thesis aims at establishing a set of computing methods using Java and XML technology for future set-top box interactive services. The main issues include middleware architecture, a Java user interface for digital television, content representation and return channel communications. The middleware architecture used was made up of an Application Manager, Application Programming Interface (API), a Java Virtual Machine, etc., which were arranged in a layered model to ensure the interoperability. The application manager was designed to control the lifecycle of Xlets; manage set-top box resources and remote control keys and to adapt the graphical device environment. The architecture of both application manager and Xlet forms the basic framework for running multiple interactive services simultaneously in future set-top box designs. User interface development is more complex for this type of platform (when compared to that for a desktop computer) as many constraints are set on the look and feel (e.g., TV-like and limited buttons). Various aspects of Java user interfaces were studied and my research in this area focused on creating a remote control event model and lightweight drawing components using the Java Abstract Window Toolkit (AWT) and Java Media Framework (JMF) together with Extensible Markup Language (XML). Applications were designed aimed at studying the data structure and efficiency of the XML language to define interactive content. Content parsing was designed as a lightweight software module based around two parsers (i.e., SAX parsing and DOM parsing). The still content (i.e., text, images, and graphics) and dynamic content (i.e., hyperlinked text, animations, and forms) can then be modeled and processed efficiently. This thesis also studies interactivity methods using Java APIs via a return channel. Various communication models are also discussed that meet the interactivity requirements for different interactive services. They include URL, Socket, Datagram, and SOAP models which applications can choose to use in order to establish a connection with the service or broadcaster in order to transfer data. This thesis is presented in two parts: The first section gives a general summary of the research and acts as a complement to the second section, which contains a series of related publications.reviewe

Contributions to the design and development process of interactive applications for digital TV based on Ginga-NCL

Orientador: Yuzo IanoDissertação (mestrado) - Universidade Estadual de Campinas, Faculdade de Engenharia Elétrica e de ComputaçãoResumo: No entorno atual da televisão digital no Brasil, a interatividade é uma característica importante para se estabelecer uma plataforma de comunicação entre os usuários e as emissoras. O middleware Ginga, ainda em desenvolvimento, se apresenta como uma oportunidade para a interatividade por meio do Ginga-NCL, um framework que permite o desenvolvimento de aplicações usando as linguagens NCL e Lua. Porém, as formas de se implementar aplicações não são padronizadas, uma vez que os receptores no mercado são limitados em hardware e as aplicações nem sempre poderão ser executadas sem seguir algumas regras ou restrições para se otimizar as aplicações. Este trabalho oferece uma nova perspectiva sobre o desenvolvimento de gráfico de aplicações interativas, com técnicas para se otimizar os parâmetros limitantes, além de uma biblioteca de código aberto para se implementar um teclado virtual em qualquer aplicação Ginga-NCLAbstract: Interactivity for digital television is, nowadays, a very important feature to stablish a communication pathway between users and broadcasters, due to digital television's current status in Brazil. The Ginga middleware, still in development status, presents an opportunity for achieving interactivity via Ginga-NCL, a framework that allows application development and deployment using NCL and Lua programming languages. However, there are not standardised ways to develop applications, the currently available receivers in the market are very limited in hardware, and released applications will not be able to always execute flawlessly without standards or guidelines to optimise them. The author's work offers a new perspective on graphical environment development for interactive applications with techniques to optimise against the limiting factors, and presents an open-source library for implementing a virtual keyboard in any Ginga-NCL application as wellMestradoTelecomunicações e TelemáticaMestre em Engenharia Elétric

MediaSync: Handbook on Multimedia Synchronization

This book provides an approachable overview of the most recent advances in the fascinating field of media synchronization (mediasync), gathering contributions from the most representative and influential experts. Understanding the challenges of this field in the current multi-sensory, multi-device, and multi-protocol world is not an easy task. The book revisits the foundations of mediasync, including theoretical frameworks and models, highlights ongoing research efforts, like hybrid broadband broadcast (HBB) delivery and users' perception modeling (i.e., Quality of Experience or QoE), and paves the way for the future (e.g., towards the deployment of multi-sensory and ultra-realistic experiences). Although many advances around mediasync have been devised and deployed, this area of research is getting renewed attention to overcome remaining challenges in the next-generation (heterogeneous and ubiquitous) media ecosystem. Given the significant advances in this research area, its current relevance and the multiple disciplines it involves, the availability of a reference book on mediasync becomes necessary. This book fills the gap in this context. In particular, it addresses key aspects and reviews the most relevant contributions within the mediasync research space, from different perspectives. Mediasync: Handbook on Multimedia Synchronization is the perfect companion for scholars and practitioners that want to acquire strong knowledge about this research area, and also approach the challenges behind ensuring the best mediated experiences, by providing the adequate synchronization between the media elements that constitute these experiences