Ubiquitous volume rendering in the web platform

176 p.The main thesis hypothesis is that ubiquitous volume rendering can be achieved using WebGL. The thesis enumerates the challenges that should be met to achieve that goal. The results allow web content developers the integration of interactive volume rendering within standard HTML5 web pages. Content developers only need to declare the X3D nodes that provide the rendering characteristics they desire. In contrast to the systems that provide specific GPU programs, the presented architecture creates automatically the GPU code required by the WebGL graphics pipeline. This code is generated directly from the X3D nodes declared in the virtual scene. Therefore, content developers do not need to know about the GPU.The thesis extends previous research on web compatible volume data structures for WebGL, ray-casting hybrid surface and volumetric rendering, progressive volume rendering and some specific problems related to the visualization of medical datasets. Finally, the thesis contributes to the X3D standard with some proposals to extend and improve the volume rendering component. The proposals are in an advance stage towards their acceptance by the Web3D Consortium

Enhancing the use of online 3d multimedia content through the analysis of user interactions

De plus en plus de contenus 3D interactifs sont disponibles sur la toile. Visualiser et manipuler ces contenus 3D en temps réel, de façon naturelle et intuitive, devient donc une nécessité. Les applications visées sont nombreuses : le e-commerce, l'éducation et la formation en ligne, la conception, ou l'architecture dans le contexte par exemple de musées virtuels ou de communautés virtuelles. L'utilisation de contenus 3D en ligne ne propose pas de remplacer les contenus traditionnels, tels que les textes, les images ou les vidéos, mais plutôt d'utiliser la 3D en complément, pour enrichir ces contenus. La toile est désormais une plate-forme où les contenus hypertexte, hypermédia, et 3D sont simultanément disponibles pour les utilisateurs. Cette utilisation des contenus 3D pose cependant deux questions principales. Tout d'abord, les interactions 3D sont souvent lourdes puisqu'elles comprennent de nombreux degrés de liberté; la navigation dans les contenus 3D peut s'en trouver inefficace et lente. Nous abordons ce problème en proposant un nouveau paradigme basé sur l'analyse des interactions (crowdsourcing). En analysant les interactions d'utilisateurs 3D, nous identifions des régions d'intérêt (ROI), et générons des recommandations pour les utilisateurs suivants. Ces recommandations permettent à la fois de réduire le temps d'interaction pour identifier une ROI d'un objet 3D et également de simplifier les interactions 3D nécessaires. De plus, les scènes ou objets 3D contiennent une information visuelle riche. Les sites Web traditionnels contiennent, eux, principalement des informations descriptives (textuelles) ainsi que des hyperliens pour permettre la navigation. Des sites contenants d'une part de l'information textuelle, et d'autre part de l'information 3D peuvent s'avérer difficile à appréhender pour les utilisateurs. Pour permettre une navigation cohérente entre les informations 3D et textuelles, nous proposons d'utiliser le crowdsourcing pour la construction d'associations sémantiques entre le texte et la visualisation en 3D. Les liens produits sont proposés aux utilisateurs suivants pour naviguer facilement vers un point de vue d'un objet 3D associé à un contenu textuel. Nous évaluons ces deux méthodes par des études expérimentales. Les évaluations montrent que les recommandations réduisent le temps d'interaction 3D. En outre, les utilisateurs apprécient l'association sémantique proposée, c'est-à-dire, une majorité d'utilisateurs indique que les recommandations ont été utiles pour eux, et préfèrent la navigation en 3D proposée qui consiste à utiliser les liens sémantiques ainsi que la souris par rapport à des interactions utilisant seulement la souris. ABSTRACT : Recent years have seen the development of interactive 3D graphics on the Web. The ability to visualize and manipulate 3D content in real time seems to be the next evolution of the Web for a wide number of application areas such as e-commerce, education and training, architecture design, virtual museums and virtual communities. The use of online 3D graphics in these application domains does not mean to substitute traditional web content of texts, images and videos, but rather acts as a complement for it. The Web is now a platform where hypertext, hypermedia, and 3D graphics are simultaneously available to users. This use of online 3D graphics, however, poses two main issues. First, since 3D interactions are cumbersome as they provide numerous degrees of freedom, 3D browsing may be inefficient. We tackle this problem by proposing a new paradigm based on crowdsourcing to ease online 3D interactions, that consists of analyzing 3D user interactions to identify Regions of Interest (ROIs), and generating recommendations to subsequent users. The recommendations both reduce 3D browsing time and simplify 3D interactions. Second, 3D graphics contain purely rich visual information of the concepts. On the other hand, traditional websites mainly contain descriptive information (text) with hyperlinks as navigation means. The problem is that viewing and interacting with the websites that use two very different mediums (hypertext and 3D graphics) may be complicated for users. To address this issue, we propose to use crowdsourcing for building semantic associations between texts and 3D visualizations. The produced links are suggested to upcoming users so that they can readily locate 3D visualization associated with a textual content. We evaluate the proposed methods with experimental user studies. The evaluations show that the recommendations reduce 3D interaction time. Moreover, the results from the user study showed that our proposed semantic association is appreciated by users, that is, a majority of users assess that recommendations were helpful for them, and browsing 3D objects using both mouse interactions and the proposed links is preferred compared to having only mouse interactions

Design and implementation of 3D buildings integration for a Webgl-Based Virtual Globe: a case study of Valencian Cadastre and Fide Building Mode

Dissertation submitted in partial fulfillment of the requirements for the Degree of Master of Science in Geospatial Technologies.Since nowadays Web applications are increasingly providing plenty of creative and interesting services relying on new standards and more powerful computers, it becomes important to create similar applications, to process and visualize geographic data taking advantage of such groundings. In this context, it results interesting to develop new Web-based geo-processing based on a 3D data representation, exploiting the recent WebGL graphic specification from a client-side point of view. This research explains the novel way in which whole Valencian cadastre was analyzed, processed and finally represented into a WebGL-based virtual globe. These improvements provide end-users firstly, an optimization of computer graphics performance, by natively accessing to graphics instructions; and secondly a functional data management and representation for the present and forthcoming geo-processing Web-based platform

The Winckelmann300 Project: Dissemination of Culture with Virtual Reality at the Capitoline Museum in Rome

The best way to disseminate culture is, nowadays, the creation of scenarios with virtual and augmented reality that supply the visitors of museums with a powerful, interactive tool that allows to learn sometimes difficult concepts in an easy, entertaining way. 3D models derived from reality-based techniques are nowadays used to preserve, document and restore historical artefacts. These digital contents are also powerful instrument to interactively communicate their significance to non-specialist, making easier to understand concepts sometimes complicated or not clear. Virtual and Augmented Reality are surely a valid tool to interact with 3D models and a fundamental help in making culture more accessible to the wide public. These technologies can help the museum curators to adapt the cultural proposal and the information about the artefacts based on the different type of visitor’s categories. These technologies allow visitors to travel through space and time and have a great educative function permitting to explain in an easy and attractive way information and concepts that could prove to be complicated. The aim of this paper is to create a virtual scenario and an augmented reality app to recreate specific spaces in the Capitoline Museum in Rome as they were during Winckelmann’s time, placing specific statues in their original position in the 18th century

REDISCOVERING CULTURAL HERITAGE SITES BY INTERACTIVE 3D EXPLORATION: A PRACTICAL REVIEW OF OPEN-SOURCE WEBGL TOOLS

Georeferenced reconstructions can help understand the dynamic evolution of the urban context surrounding a historical site, supporting decision-making processes in the field of urban planning. The development of web applications that allow the interaction between 2D and 3D products, as well as their exploration, can facilitate virtual inspections and foster collaboration in digitization of interventions and site evolutions over time. The article discusses how virtual scene reconstructions and visits can provide alternatives to traditional in-situ tourism promotion, through digital storytelling solutions for the exploration of sites. The article also describes how 3D storytelling technologies are currently being used for dissemination cultural heritage sites. The case study of the Castello Farnese, an old XVI century heritage site in Piacenza (Italy), test the adoption of two distinct free and open-source JavaScript WebGL, Potree and Cesium, for the rendering of photogrammetric and laser scanning georeferenced scaled products and for the integration of narrative features such as annotations, camera animations, texts, and other multimedia contents. Potentials and limitations of both tools are discussed in detail, highlighting how they can be implemented for enhancing user experience in virtual tour and exploration of 3D products. In order to guarantee replicability for other case studies, source code of the implemented application is shared on GitHub along with its documentation for contributions

Web on TV - Designing web content for enhanced user experience on an internet-connected television device

This thesis was submitted for the award of Doctor of Philosophy and was awarded by Brunel University LondonThe Internet is gradually expanding to many new devices, in addition to its original native environment that was the Personal Computer. This wave started with mobile devices and as we enter the Internet of Things era, connectivity is possible from cars to light switches. One of the first devices, to follow mobiles, is the Television. Connectivity and two-way interaction on the TV device has in fact started even in the first days of the medium, but had failed to make it widely available, due to technological limitations of the past. Now, this has changed, with the Smart TV devices that can utilize the fast internet connections that are available in most developed countries. However, even though the technology and devices are now widely available there are still challenges in order to make the vast Internet and web content available in the Smart TVs. These challenges, have a familiar resemblance to what happened a few years ago, when internet connectivity was introduced on the mobile phone. Although, it was “feasible” to access any webpage from your mobile device, the experience for the user was often very frustrating, due to many factors, that derived from the fact that the web was designed for large screens and mice of the desktop computers, not the small touch screens and limited hardware of the phone. Nonetheless, these obstacles were successfully overcome, by introducing techniques and methodologies (e.g. Responsive Web Design) to make the web more mobile-friendly and also work from the manufacturers to improve their devices to this direction as well. The success of these actions is now evident, since the access to the web from mobile devices has surpassed the PC, and it is now a standard practice for every new website to be mobile-friendly. In this research work, we will attempt to do one very significant step towards this direction for the Smart TV. In other words, to discover what has to be done to make the web more TV-friendly. To do this, we explore many different TV devices from several manufacturers and see their similarities and differences. We explore numerous user studies and surveys to discover what is the problem in the Web experience on the TV, so that we can propose solutions to make web content TV-friendly. Based on these findings, we design prototypes and put them to the test on different devices and userevaluation. Finally, we propose a set of guidelines, that web designers can apply on their websites to make them TV-friendly, in the hope to introduce the first step towards a friendlier internet era for the TV