Lively3D: building a 3D desktop environment as a single page application

The Web has rapidly evolved from a simple document browsing and distribution environment into a rich software platform, where desktop-style applications are treated as first class citizens. Despite the associated technical complexities and limitations, it is not unusual to find complex applications that build on the web as their only platform, with no traditional installable application for the desktop environment - such systems are simply accessed via a web page that is downloaded inside the browser and once loading is completed, the application will begin its execution immediately. With the recent standardization efforts, including HTML5 and WebGL in particular, compelling, visually rich applications are increasingly supported by the the browsers. In this paper, we demonstrate the new facilities of the browser as a visualization tool, going beyond what is expected of traditional web applications. In particular, we demonstrate that with mashup technologies, which enable combining already existing content from various sites into an integrated experience, the new graphics facilities unleashes unforeseen potential for visualizations

Geovisualization Using HTML5 : a case study to improve animations of historical geographic data

Popular science Visualize geographic data Using HTML5 The Scanian Economic-Demographic Database (SEDD) has been assembled by the Centre for Economic Demography (CED), Lund University. It contains demographic and economic information of Scania from the 17th century until the present. The SEDD database has been integrated with geographic data, which are digitized from four independent historical maps. To help the users well understand these data, a web mapping application called SEDD Map has been developed and tested. The previous version of SEDD Map is constructed using Silverlight plugin. It cannot run on most popular portable devices. As Hypertext Markup Languages (HTML) continue to develop, a recent version, HTML5, was published in 2012. It aims to support the latest multimedia formats and reduce the need for plugins. So, to improve the compatibility of SEDD Map, this work using HTML5 to developed a new version of SEDD Map. Before we constructed the new version of SEDD Map, a set of web mapping applications and programs were evaluated. From this evaluation and comparison, we found that SEDD Map could be improved in many area, such as improving the animation of historical geographic data. Animation is a useful tool when presenting historical data. The geographic data in SEDD Map are taken from four independent historical maps. To visualize geographic data as an animation, we need to create a time sense sequential dataset. In this study, we used linear interpolation and the four historical maps as start years and end years to simulate 159 maps to visualize the geographic data as animations. From this study, we found that: The commonly used web mapping applications for investigating demographic data contain functions, such as interactive visualization, statistical graphics, basic map tools, animations, etc; HTML5 can replace (and improve) the used of Silverlight for web mapping; Animations can be generated (filling in what is missing is to improve the data sets).The Scanian Economic-Demographic Database (SEDD) has been assembled by the Centre for Economic Demography (CED), Lund University. It contains information about the demographic and economic conditions of people that have lived in 5 parishes in Scania from the 17th century until the present. The SEDD database has been integrated with geographic data, which are digitized from four independent historical maps. To visualize and analyze these data, a GIS based web mapping application called SEDD Map has been developed and tested. The previous version of SEDD Map is constructed using Silverlight. As a result, it only can be used on computers which have installed the Silverlight plugin. As Hypertext Markup Languages (HTML) continue to develop, a recent version, HTML5, was published in 2012. It aims to support the latest multimedia formats and reduce the need for plugins. In this study, we use HTML5, Cascading Style Sheets (CSS3), JavaScript and the ArcGIS API for JavaScript to create a new version of SEDD Map to visualize data stored in the SEDD database. Before we constructed the new version of SEDD Map, a set of web mapping applications and programs were evaluated by the requirements which were needed to create the new version of SEDD Map. From this evaluation and comparison, we found that SEDD Map could be improved in many area, such as improving the animation of historical geographic data. Animation is a useful tool when presenting historical data. The geographic data in SEDD Map are taken from four independent historical maps. To visualize geographic data as an animation, we need to create a time sense sequential dataset, which is done in a parallel project. In this study, we evaluate techniques for data animation. We used linear interpolation and the four historical maps as start years and end years to simulate 159 maps to visualize the geographic data as animations. The conclusions are as follows: 1) The commonly used web mapping applications for investigating demographic data contain functions, such as interactive visualization, statistical graphics, basic map tools, animations, etc. 2) HTML5 can replace (and improve) the used of Silverlight for web mapping. 3) Animations can be generated (filling in what is missing is to improve the data sets)

Mashup Ecosystems: Integrating Web Resources on Desktop and Mobile Devices

The Web is increasingly used as an application platform, and recent development of it has introduced software ecosystems where different actors collaborate. This collaboration is international from day one, and it evolves and grows rapidly. In web ecosystems applications are provided as services, and interdependencies between ecosystem parts can vary from very strong and obvious to loose and recondite. Mashups -- web application hybrids that combine resources from different services into an integrated system that has increased value from user perspective -- are exploiting services of the Web and creating ecosystems where end-users, mashup authors, and service providers collaborate. The term "resources" is used here in a broad sense, and it can refer to user's local data, infinite content of the Web, and even executable code. This dissertation presents mashups as a new breed of web applications that are intended for parsing the web content into an easily accessed form on both regular desktop computers as well as on mobile devices. Constantly evolving web technologies and new web services open up unforeseen possibilities for mashup development. However, developing mashups with current methods and tools for existing deployment environments is challenging. First, the Web as an application platform faces numerous shortcomings, second, web application development practices in general are still immature, and third, development of mashups has additional requirements that need to be addressed. In addition, mobility sets even more challenges for mashup authoring. This dissertation describes and addresses numerous issues regarding mashup ecosystems and client-side mashup development. To achieve this, we have implemented technical research artifacts including mashup ecosystems and different kinds of mashup compositions. The artifacts are developed with numerous runtime environments and tools and targeted at different end-user platforms. This has allowed us to evaluate methods, tools, and practises used during the implementation. As result, this dissertation identifies the fundamental challenges of mashup ecosystems and describes how service providers and mashup ecosystem authors can address these challenges in practice. In addition, example implementation of a specialized multimedia mashup ecosystem for mobile devices is described. To address mashup development issues, this dissertation introduces practical guidelines and a reference architecture that can be applied when mashups are created with traditional web development tools. Moreover, environments that can be used on mobile devices to create mashups that have access to both web and local resources are introduced. Finally, a novel approach to web software development -- creating software as a mashup -- is introduced, and a realization of such concept is described

Analysis of Visualisation and Interaction Tools Authors

This document provides an in-depth analysis of visualization and interaction tools employed in the context of Virtual Museum. This analysis is required to identify and design the tools and the different components that will be part of the Common Implementation Framework (CIF). The CIF will be the base of the web-based services and tools to support the development of Virtual Museums with particular attention to online Virtual Museum.The main goal is to provide to the stakeholders and developers an useful platform to support and help them in the development of their projects, despite the nature of the project itself. The design of the Common Implementation Framework (CIF) is based on an analysis of the typical workflow ofthe V-MUST partners and their perceived limitations of current technologies. This document is based also on the results of the V-MUST technical questionnaire (presented in the Deliverable 4.1). Based on these two source of information, we have selected some important tools (mainly visualization tools) and services and we elaborate some first guidelines and ideas for the design and development of the CIF, that shall provide a technological foundation for the V-MUST Platform, together with the V-MUST repository/repositories and the additional services defined in the WP4. Two state of the art reports, one about user interface design and another one about visualization technologies have been also provided in this document

Virtual library:a technical implementation for a virtual reality library interface

Abstract. Libraries, as traditional information storages, serve an important role in providing free access to civilization’s knowledge to the public. In the advent of the information society, conventional means of knowledge seeking slowly become obsolete. As technologies advance, libraries shall discover how available inventions could be utilized in enhancing library services and raising public awareness. The offer to discover Virtual Library project was given to the author by the Center for Ubiquitous Computing in the University of Oulu, with the idea originating from Oulu City Library. The goal of the project was to implement an interactive application that would provide a unique experience for library users and show off capabilities of modern virtual technologies. The requirements for it were elicited and refined in a series of participatory design workshops held in Oulu City Library, and as a result, the content of initial web prototype was utilized in the creation of standalone virtual reality application on Unreal Engine 4. The application works with Oculus Rift headset and Oculus Touch motion controllers and lets the user explore the virtual model of Oulu City Library premises as well as some fictional places, added for diverse experience, and experience several activities. Virtual Library was evaluated in a series of testing sessions held in the Oulu City Library with a total of 12 participants, which were primarily the library’s staff members. Overall, the application was positively acclaimed, providing an interesting and unusual library experience, and presenting capabilities of modern virtual reality technologies.Virtuaalikirjasto : tekninen kuvaus virtuaalitodellisuutta hyödyntävälle kirjastopalvelulle. Tiivistelmä. Kirjastoilla on perinteisesti tärkeä rooli tiedon välittäjinä ja tallentajina. Kirjastojen tulee myös mahdollistaa pääsy tiedon ääreen. Siirryttäessä lähemmäksi tietoyhteiskuntaa, perinteiset tavat käsitellä ja havainnoida tietoa ovat jäämässä historiaan. Myös kirjastot kehittyvät ja oppivat kuinka uusia teknologioita on mahdollista hyödyntää tiedon välittämisessä yhteisöille. Virtuaalikirjasto-projekti lähti Oulun kaupungin kirjaston pyynnöstä Oulun yliopiston Jokapaikan tietotekniikan tutkimusryhmälle. Projektin päämääränä oli toteuttaa interaktiivinen sovellus, joka tarjoaisi kirjaston asiakkaille elämyksellistä sisältöä samalla havainnollistaen virtuaalitodellisuuden ja siihen liittyvien teknologioiden mahdollisuuksia. Sovelluksen toteutusta hiottiin Oulun kaupunginkirjastossa sarjalla osallistavan suunnittelun mukaisia työpajoja. Virtuaalitodellisuussovellus toteutettiin Unreal Engine 4 -pelimoottorilla. Se toimii Oculus Rift -virtuaalilaseilla ja Oculus Touch -ohjaimilla. Sovelluksessa on mahdollista kulkea vapaasti virtuaalisessa Oulun kaupunginkirjastossa, sekä tilaan liitetyissä mielikuvituksellisemmissa maailmoissa. Virtuaalikirjasto-sovellus evaluoitiin Oulun kaupunginkirjastossa sarjalla käyttäjätestejä. Testikäyttäjiä oli kaikkiaan 12 ja he olivat pääosin kirjaston työntekijöitä. Sovelluksen vastaanotto oli positiivinen. Käyttäjät totesivat sen havainnollistavan käytettävissä olevan tekniikan mahdollisuuksia samalla tarjoten mielenkiintoisen ja epätavallisen kirjastokokemuksen

Fachlich erweiterbare 3D-Stadtmodelle – Management, Visualisierung und Interaktion

Domain-extendable semantic 3D city models are complex mappings and inventories of the urban environment which can be utilized as an integrative information backbone to facilitate a range of application fields like urban planning, environmental simulations, disaster management, and energy assessment. Today, more and more countries and cities worldwide are creating their own 3D city models based on the CityGML specification which is an international standard issued by the Open Geospatial Consortium (OGC) to provide an open data model and XML-based format for describing the relevant urban objects with regards to their 3D geometry, topology, semantics, and appearance. It especially provides a flexible and systematic extension mechanism called “Application Domain Extension (ADE)” which allows third parties to dynamically extend the existing CityGML definitions with additional information models from different application domains for representing the extended or newly introduced geographic object types within a common framework. However, due to the consequent large size and high model complexity, the practical utilization of country-wide CityGML datasets has posed a tremendous challenge regarding the setup of an extensive application system to support the efficient data storage, analysis, management, interaction, and visualization. These requirements have been partly solved by the existing free 3D geo-database solution called ‘3D City Database (3DCityDB)’ which offers a rich set of functionalities for dealing with standard CityGML data models, but lacked the support for CityGML ADEs. The key motivation of this thesis is to develop a reliable approach for extending the existing database solution to support the efficient management, visualization, and interaction of large geospatial data elements of arbitrary CityGML ADEs. Emphasis is first placed on answering the question of how to dynamically extend the relational database schema by parsing and interpreting the XML schema files of the ADE and dynamically create new database tables accordingly. Based on a comprehensive survey of the related work, a new graph-based framework has been proposed which uses typed and attributed graphs for semantically representing the object-oriented data models of CityGML ADEs and utilizes graph transformation systems to automatically generate compact table structures extending the 3DCityDB. The transformation process is performed by applying a series of fine-grained graph transformation rules which allow users to declaratively describe the complex mapping rules including the optimization concepts that are employed in the development of the 3DCityDB database schema. The second major contribution of this thesis is the development of a new multi-level system which can serve as a complete and integrative platform for facilitating the various analysis, simulation, and modification operations on the complex-structured 3D city models based on CityGML and 3DCityDB. It introduces an additional application level based on a so-called ‘app-concept’ that allows for constructing a light-weight web application to reach a good balance between the high data model complexity and the specific application requirements of the end users. Each application can be easily built on top of a developed 3D web client whose functionalities go beyond the efficient 3D geo-visualization and interactive exploration, and also allows for performing collaborative modifications and analysis of 3D city models by taking advantage of the Cloud Computing technology. This multi-level system along with the extended 3DCityDB have been successfully utilized and evaluated by many practical projects.Fachlich erweiterbare semantische 3D-Stadtmodelle sind komplexe Abbildungen und Datenbestände der städtischen Umgebung, die als ein integratives Informationsrückgrat genutzt werden können, um eine Reihe von Anwendungsfeldern wie z. B. Stadtplanung, Umweltsimulationen, Katastrophenmanagement und Energiebewertung zu ermöglichen. Heute schaffen immer mehr Länder und Städte weltweit ihre eigenen 3D-Stadtmodelle auf Basis des internationalen Standards CityGML des Open Geospatial Consortium (OGC), um ein offenes Datenmodell und ein XML-basiertes Format zur Beschreibung der relevanten Stadtobjekte in Bezug auf ihre 3D-Geometrien, Topologien, Semantik und Erscheinungen zur Verfügung zu stellen. Es bietet insbesondere einen flexiblen und systematischen Erweiterungsmechanismus namens „Application Domain Extension“ (ADE), der es Dritten ermöglicht, die bestehenden CityGML-Definitionen mit zusätzlichen Informationsmodellen aus verschiedenen Anwendungsdomänen dynamisch zu erweitern, um die erweiterten oder neu eingeführten Stadtobjekt-Typen innerhalb eines gemeinsamen Framework zu repräsentieren. Aufgrund der konsequent großen Datenmenge und hohen Modellkomplexität bei der praktischen Nutzung der landesweiten CityGML-Datensätze wurden jedoch enorme Anforderungen an den Aufbau eines umfangreichen Anwendungssystems zur Unterstützung der effizienten Speicherung, Analyse, Verwaltung, Interaktion und Visualisierung der Daten gestellt. Die bestehende kostenlose 3D-Geodatenbank-Lösung „3D City Database“ (3DCityDB) entsprach bereits teilweise diesen Anforderungen, indem sie zwar eine umfangreiche Funktionalität für den Umgang mit den Standard-CityGML-Datenmodellen, jedoch keine Unterstützung für CityGML-ADEs bietet. Die Schlüsselmotivation für diese Arbeit ist es, einen zuverlässigen Ansatz zur Erweiterung der bestehenden Datenbanklösung zu entwickeln, um das effiziente Management, die Visualisierung und Interaktion großer Datensätze beliebiger CityGML-ADEs zu unterstützen. Der Schwerpunkt liegt zunächst auf der Beantwortung der Schlüsselfrage, wie man das relationale Datenbankschema dynamisch erweitern kann, indem die XML-Schemadateien der ADE analysiert und interpretiert und anschließend dem entsprechende neue Datenbanktabellen erzeugt werden. Auf Grundlage einer umfassenden Studie verwandter Arbeiten wurde ein neues graphbasiertes Framework entwickelt, das die typisierten und attributierten Graphen zur semantischen Darstellung der objektorientierten Datenmodelle von CityGML-ADEs verwendet und anschließend Graphersetzungssysteme nutzt, um eine kompakte Tabellenstruktur zur Erweiterung der 3DCityDB zu generieren. Der Transformationsprozess wird durch die Anwendung einer Reihe feingranularer Graphersetzungsregeln durchgeführt, die es Benutzern ermöglicht, die komplexen Mapping-Regeln einschließlich der Optimierungskonzepte aus der Entwicklung des 3DCityDB-Datenbankschemas deklarativ zu formalisieren. Der zweite wesentliche Beitrag dieser Arbeit ist die Entwicklung eines neuen mehrstufigen Systemkonzepts, das auf CityGML und 3DCityDB basiert und gleichzeitig als eine komplette und integrative Plattform zur Erleichterung der Analyse, Simulationen und Modifikationen der komplex strukturierten 3D-Stadtmodelle dienen kann. Das Systemkonzept enthält eine zusätzliche Anwendungsebene, die auf einem sogenannten „App-Konzept“ basiert, das es ermöglicht, eine leichtgewichtige Applikation bereitzustellen, die eine gute Balance zwischen der hohen Modellkomplexität und den spezifischen Anwendungsanforderungen der Endbenutzer erreicht. Jede Applikation lässt sich ganz einfach mittels eines bereits entwickelten 3D-Webclients aufbauen, dessen Funktionalitäten über die effiziente 3D-Geo-Visualisierung und interaktive Exploration hinausgehen und auch die Durchführung kollaborativer Modifikationen und Analysen von 3D-Stadtmodellen mit Hilfe von der Cloud-Computing-Technologie ermöglichen. Dieses mehrstufige System zusammen mit dem erweiterten 3DCityDB wurde erfolgreich in vielen praktischen Projekten genutzt und bewertet