On Consistency and Network Latency in Distributed Interactive Applications: A Survey—Part I

This paper is the first part of a two-part paper that documents a detailed survey of the research carried out on consistency and latency in distributed interactive applications (DIAs) in recent decades. Part I reviews the terminology associated with DIAs and offers definitions for consistency and latency. Related issues such as jitter and fidelity are also discussed. Furthermore, the various consistency maintenance mechanisms that researchers have used to improve consistency and reduce latency effects are considered. These mechanisms are grouped into one of three categories, namely time management, Information management and system architectural management. This paper presents the techniques associated with the time management category. Examples of such mechanisms include time warp, lock step synchronisation and predictive time management. The remaining two categories are presented in part two of the survey

Vibrations in Single-Degrees-of-Freedom Sampled-Data Linear Mechanical Systems

This paper aims to present that the effect of sampling can result in multi-frequency vibration even in the case of a single-degree-of-freedom linear mechanical model. Even though the sampled-data systems have an infinite number of characteristic exponents due to sampling, the vibrations of these systems can still be characterized by an effective system model with a single dominant frequency. However, as this paper shows, additional harmonics become relevant, resulting in multi-frequency vibrations depending on the magnitude of applied control parameters. The vibrations presented by the time histories of vibration and their spectra resulted in numerical simulation of the sampled-data system

An Experimental Hybrid User Interface for Collaboration

We present EMMIE (Environment Management for Multi-user Information Environments), an experimental user interface to a collaborative augmented environment. Users share a 3D virtual space and manipulate virtual objects representing information to be discussed. This approach not only allows for cooperation in a shared physical space, but also addresses tele-collaboration in physically separate but virtually shared spaces. We refer to EMMIE as a hybrid user interface because it combines a variety of different technologies and techniques, including virtual elements such as 3D widgets, and physical objects such as tracked displays and input devices. See-through head-worn displays overlay the virtual environment on the physical environment. Our research prototype includes additional 2D and 3D displays, ranging from palm-sized to wall-sized, allowing the most appropriate one to be used for any task. Objects can be moved among displays (including across dimensionalities) through drag & drop. In analogy to 2D window managers, we describe a prototype implementation of a shared 3Denvironment manager that is distributed across displays, machines, and operating systems. We also discuss two methods we are exploring for handling information privacy in such an environment

Dronevision: An Experimental 3D Testbed for Flying Light Specks

Today's robotic laboratories for drones are housed in a large room. At times, they are the size of a warehouse. These spaces are typically equipped with permanent devices to localize the drones, e.g., Vicon Infrared cameras. Significant time is invested to fine-tune the localization apparatus to compute and control the position of the drones. One may use these laboratories to develop a 3D multimedia system with miniature sized drones configured with light sources. As an alternative, this brave new idea paper envisions shrinking these room-sized laboratories to the size of a cube or cuboid that sits on a desk and costs less than 10K dollars. The resulting Dronevision (DV) will be the size of a 1990s Television. In addition to light sources, its Flying Light Specks (FLSs) will be network-enabled drones with storage and processing capability to implement decentralized algorithms. The DV will include a localization technique to expedite development of 3D displays. It will act as a haptic interface for a user to interact with and manipulate the 3D virtual illuminations. It will empower an experimenter to design, implement, test, debug, and maintain software and hardware that realize novel algorithms in the comfort of their office without having to reserve a laboratory. In addition to enhancing productivity, it will improve safety of the experimenter by minimizing the likelihood of accidents. This paper introduces the concept of a DV, the research agenda one may pursue using this device, and our plans to realize one

Engaging immersive video consumers: Challenges regarding 360-degree gamified video applications

360-degree videos is a new medium that has gained the attention of the research community imposing challenges for creating more interactive and engaging immersive experiences. The purpose of this study is to introduce a set of technical and design challenges for interactive, gamified 360-degree mixed reality applications that immerse and engage users. The development of gamified applications refers to the merely incorporation of game elements in the interaction design process to attract and engage the user through playful interaction with the virtual world. The study presents experiments with the incorporation of series of game elements such as time pressure challenges, badges and user levels, storytelling narrative and immediate visual feedback to the interaction design logic of a mixed reality mobile gaming application that runs in an environment composed of 360-degree video and 3D computer generated objects. In the present study, the architecture and overall process for creating such an application is being presented along with a list of design implications and constraints. The paper concludes with future directions and conclusions on improving the level of immersion and engagement of 360-degree video consumers

Computational haptics : the Sandpaper system for synthesizing texture for a force-feedback display

Thesis (Ph. D.)--Massachusetts Institute of Technology, Program in Media Arts & Sciences, 1995.Includes bibliographical references (p. 155-180).by Margaret Diane Rezvan Minsky.Ph.D

Design methodology for 360° immersive video applications: the case study of a cultural heritage virtual tour

Three hundred sixty–degree (360°) immersive video applications for Head Mounted Display (HMD) devices offer great potential in providing engaging forms of experiential media solutions especially in Cultural Heritage education. Design challenges emerge though by this new kind of immersive media due to the 2D form of resources used for their construction, the lack of depth, the limited interaction and the need to address the sense of presence. In addition, the use of Virtual Reality (VR) headsets often causes nausea, or motion sickness effects imposing further implications in moderate motion design tasks. This paper introduces a methodological categorisation of tasks and techniques for the design of 360° immersive video applications. Following the design approach presented, a testbed application has been created as an immersive interactive virtual tour at the historical centre of the city of Rethymno in Crete, Greece, which has undergone user trials. Based on the analysis of the results of this study, a set of design guidelines for the implementation of 360° immersive video virtual tours is proposed

The ARP Virtual Reality System in Addressing Security Threats and Disaster Scenarios

Nations, corporations and political organizations around the world today are forced to deal with an increasing number of security threats. As a result, various organizations must find ways to adequately equip and prepare themselves to handle numerous dangerous and life threatening circumstances. Virtual reality is an extremely important technology that can be used across a variety of different fields and for a number of diverse applications, ranging from simulation training to visualization tools, in order to prepare for and manage disaster situations. Head mounted display (HMD) virtual reality systems attempt visually to immerse the user in a virtual environment. However, it is well recognized that latency, the delay in responding to a user\u27s head movement, is a major shortcoming that plagues immersive HMD virtual reality systems. Excessive latency destroys the illusion of reality that such systems attempt to present to the user. A hardware architecture known as the address recalculation pipeline (ARP) and a computer graphics rendering technique called priority rendering, were designed to reduce the end-to-end latency suffered by immersive HMD virtual reality systems. This paper discusses the benefits of using the ARP virtual reality system in addressing security threats and disaster situations