Scalable exploration of highly detailed and annotated 3D models

With the widespread availability of mobile graphics terminals andWebGL-enabled browsers, 3D graphics over the Internet is thriving. Thanks to recent advances in 3D acquisition and modeling systems, high-quality 3D models are becoming increasingly common, and are now potentially available for ubiquitous exploration. In current 3D repositories, such as Blend Swap, 3D Café or Archive3D, 3D models available for download are mostly presented through a few user-selected static images. Online exploration is limited to simple orbiting and/or low-fidelity explorations of simplified models, since photorealistic rendering quality of complex synthetic environments is still hardly achievable within the real-time constraints of interactive applications, especially on on low-powered mobile devices or script-based Internet browsers. Moreover, navigating inside 3D environments, especially on the now pervasive touch devices, is a non-trivial task, and usability is consistently improved by employing assisted navigation controls. In addition, 3D annotations are often used in order to integrate and enhance the visual information by providing spatially coherent contextual information, typically at the expense of introducing visual cluttering. In this thesis, we focus on efficient representations for interactive exploration and understanding of highly detailed 3D meshes on common 3D platforms. For this purpose, we present several approaches exploiting constraints on the data representation for improving the streaming and rendering performance, and camera movement constraints in order to provide scalable navigation methods for interactive exploration of complex 3D environments. Furthermore, we study visualization and interaction techniques to improve the exploration and understanding of complex 3D models by exploiting guided motion control techniques to aid the user in discovering contextual information while avoiding cluttering the visualization. We demonstrate the effectiveness and scalability of our approaches both in large screen museum installations and in mobile devices, by performing interactive exploration of models ranging from 9Mtriangles to 940Mtriangles

COLLADA + MPEG-4 or X3D + MPEG-4

The paper is an overview of 3D graphics assets and applications standards.The authors analyzed the three main open standards dealing with three-dimensional (3-D) graphics content and applications, X3D, COLLADA, and MPEG4, to clarify the role of each with respect to the following criteria: ability to describe only the graphics assets in a synthetic 3-D scene or also its behavior as an application, compression capacities, and appropriateness for authoring, transmission, and publishing. COLLADA could become the interchange format for authoring tools; MPEG4 on top of it (as specified in MPEG-4 Part 25), the publishing format for graphics assets; and X3D, the standard for interactive applications, enriched by MPEG-4 compression in the case of online ones. The authors also mentioned that in order to build a mobile application, a developer has to consider different hardware configurations and performances, different operating systems, different screen sizes, and input controls

A model for adapting 3D graphics based on scalable coding, real-time simplification and remote rendering

Most current multiplayer 3D games can only be played on dedicated platforms, requiring specifically designed content and communication over a predefined network. To overcome these limitations, the OLGA (On-Line GAming) consortium has devised a framework to develop distributive, multiplayer 3D games. Scalability at the level of content, platforms and networks is exploited to achieve the best trade-offs between complexity and quality

Semantic multimedia remote display for mobile thin clients

Current remote display technologies for mobile thin clients convert practically all types of graphical content into sequences of images rendered by the client. Consequently, important information concerning the content semantics is lost. The present paper goes beyond this bottleneck by developing a semantic multimedia remote display. The principle consists of representing the graphical content as a real-time interactive multimedia scene graph. The underlying architecture features novel components for scene-graph creation and management, as well as for user interactivity handling. The experimental setup considers the Linux X windows system and BiFS/LASeR multimedia scene technologies on the server and client sides, respectively. The implemented solution was benchmarked against currently deployed solutions (VNC and Microsoft-RDP), by considering text editing and WWW browsing applications. The quantitative assessments demonstrate: (1) visual quality expressed by seven objective metrics, e.g., PSNR values between 30 and 42 dB or SSIM values larger than 0.9999; (2) downlink bandwidth gain factors ranging from 2 to 60; (3) real-time user event management expressed by network round-trip time reduction by factors of 4-6 and by uplink bandwidth gain factors from 3 to 10; (4) feasible CPU activity, larger than in the RDP case but reduced by a factor of 1.5 with respect to the VNC-HEXTILE

Digital Fishes - An Interactive Virtual Aquarium

This work is supported by AUIP - Asociación Universitaria Iberoamericana de PostgradoThis work describes the creation of an interactive virtual aquarium, Digital Fishes, with a physical representation in a cubic fish tank with synchronized visual information and animated elements, such as fish and vegetation, which can be used for educational purposes. Here the solution to simulate the movement of marine flora and fauna added to our virtual Aquarium is described. An implementation of the fish behavior, to move in groups using the Boids algorithm, is created, in addition to autonomous behaviors such as chasing prey and fleeing from predators, interactive behaviors such as following the finger on the screen and going towards the food that the user may throw in the pond. The solution described in this work has managed to bring into the hands of children an interactive virtual representation of an interactive as one more learning tool at their disposal. These children who participated in the Digital Fishes Interactive Aquarium's evaluation provided positive feedback, showing great enthusiasm and positively assessed the solution

Design of A Virtual Laboratory for Automation Control

In the past, only students who studied on campus were able to access laboratory equipment in traditional lab courses; distance learning students, enrolled in online courses, were at a disadvantage for they could learn basic lab experiment principles but could never experience hands-on learning. Modeling and simulation can be a powerful tool for generating virtual laboratories for distance learning students. This thesis describes the design and development of a virtual laboratory for automation control using mechanical, electrical, and pneumatic components for an automation and control course at Old Dominion University. This virtual laboratory application was implemented for two platforms — Windows personal computers and Android smartphones. The virtual lab serves as pre-lab session for on-campus students and a virtual lab tool for distance-learning students to gain some “hands-on” lab experience. Utilizing the virtual learning environment as a supplement to engineering-based laboratories is also beneficial for students to prepare for the physical experiment and obtain a “hands-on,” practical lab experience without the hazards present in the physical lab. Such a methodology can also be applied to experiments in different fields such chemistry, etc

Cloud-to-end rendering and storage management for virtual reality in experimental education

Background Real-time 3D rendering and interaction is important for virtual reality (VR) experimental education. Unfortunately, standard end-computing methods prohibitively escalate computational costs. Thus, reducing or distributing these requirements needs urgent attention, especially in light of the COVID-19 pandemic. Methods In this study, we design a cloud-to-end rendering and storage system for VR experimental education comprising two models: background and interactive. The cloud server renders items in the background and sends the results to an end terminal in a video stream. Interactive models are then lightweight-rendered and blended at the end terminal. An improved 3D warping and hole-filling algorithm is also proposed to improve image quality when the user’s viewpoint changes. Results We build three scenes to test image quality and network latency. The results show that our system can render 3D experimental education scenes with higher image quality and lower latency than any other cloud rendering systems. Conclusions Our study is the first to use cloud and lightweight rendering for VR experimental education. The results demonstrate that our system provides good rendering experience without exceeding computation costs

Survey on some key technologies of virtual tourism system based on Web3D

Some key technologies on how to build large-scale virtual tourism systssems comprehensively on Web browsers and mobiles were analyzed and the current R&D status on Web3D virtual tourism was surveyed insightfully. Then, some methods were summarized, including 3D trees or plants modeling, 3D architectural modeling, 3D Virtual Human behavior modeling, virtual agents path planning, collision detection and progressive transmission strategy suitable for developing large scale Web3D tourism scenarios. Also, some bottleneck problems of Web3D virtual tourism system were investigated. At the same time, the lightweight 3D engine, the lightweight 3D modeling, the lightweight 3D streaming and P2P based progressive transmission of huge Web3D tourism contents would become much helpful to breakthrough those bottlenecks of Web3D tourism systems were pointed out. In addition, all kinds of Web3D engines in terms of lightweight, realism and efficiency that would be a good reference for developers to choose during various applications were compared comprehensively. Finally, the prospect of future investigation of Web3D tourism system is presented, which will be going on in terms of four characteristics lightweight, high-speed, realism, beauty.