Capin, T. K

Thalmann, D

Infoscience - École polytechnique fédérale de Lausanne

A Taxonomy of Networked Virtual EnvironmentsTolga K. Capin, Daniel ThalmannComputer Graphics Laboratory (LIG)Swiss Federal Institute of Technology (EPFL)1015 Lausanne, Switzerland{capin, thalmann}@lig.di.epfl.chAbstractThere have been several networked virtualenvironments (NVEs) described in the literature.Each NVE system considers a separate part ofthe problem and a reference frame for listing allcomponents and comparing different NVEsmissing. We summarize the issues to considerwhile developing complete NVEs, and wecompare the most characteristic solutions in theliterature for each issue.1. IntroductionIn order to discuss the issues to be considered inNVE development and analysis, we can divideour taxonomy into three elements:• Preconditions are the facts that NVE systemdesigners have minimum control of. Thesetypically include the target applicationrequirements, constraints of the network,computing and interface equipment.• Design decisions include the tools andparameters that NVE system developers cancontrol, such as the protocol forcommunication and the client architecture.• Further issues include the further tools andtechniques that NVE system designers canexploit in order to run the NVE system moreefficiently, and to increase the quality of thefeedback to the user.2. Preconditions of NVEs2.1 Target ApplicationsThere have been a number of pilot orworking applications constructed in theliterature.  Although the theoretical approach ofthe early systems tried to provide a general-purpose virtual environment for any type ofapplication (Bricken and Coco 1993), it was laterrealized that these systems lack efficiency, oneof the principal requirements for NVE systems.Recent efforts concentrated on characterizingapplications for different dimensions. Slater etal. (1995) proposed three such dimensions: 1)the number of participants and entitiessimultaneously involved in the same world. 2)the complexity of the objects and theirbehaviours, ranging from static data to thoseresponding to participant interaction, and on todynamically changing objects without userintervention. 3) the degree of interaction amongparticipants, ranging from low (users can seeeach other), through medium (users can beinvolved in complex activities), to high(synchronized activities to achieve a commontask). Each of the applications will need differentnetwork requirements and interentitysynchronization; this will affect the developmentof the NVE system.2.2 Underlying NetworkThe network characteristics underlying the NVEsystem can have a wide range. Funkhouser(1996) classified the network characteristics ofwide area networks into three types:1) Connection: this allows two workstations tosend data unidirectionally over a connection-oriented link. An example is the modem linkusing a standard telephone line, with two-way,connection-oriented, unicast data transport withlow latency and bandwidth. 2) Unicast: thisallows a message to be sent to each other entityon the network for distributing messages. AnInternet connection without the multicastcapabilities is an example. This distribution ofone update message requires O(N) separatecommunications. 3) Multicast: a subset ofworkstations can communicate with each otherusing connectionless messages. The underlyingnetwork should support the multicast operation.The MBONE (Multicast Backbone implementedover the Internet) is an example. This requiresone update message for distributing a message.For generality, heterogeneous networks canbe constructed using a combination of thesedifferent network types.2.3 Projected HostsThe projected number of connecting hosts isan important factor in developing efficient NVEsystems. Although the number of connectinghosts is expected to increase with the concurrentdevelopments in network and CPU technology,we can postulate that some applications willrequire smaller numbers of participating hoststhan others. These applications will typicallyrequire better display quality and representationthan large-scale NVEs (e.g. teleconferencing). Inaddition, it is also important to consider theproperties of the connecting hosts. Theprocessing power of the workstation should besufficient to cope with the messages received,and to perform the environment simulation andprocessing of remote entities without degradingthe performance and quality of the simulation.A number of research groups studiedmedium- to large-scale virtual environments.Among them, NPSNET was reported to besuccessfully simulated with 300 entities,theoretically shown to grow to thousands(Macedonia et al. 1995).2.4 Input Devices and RenderingMany different types of input device are incurrent use. In their number of tracked degreesof freedom, they range from the ubiquitousmouse to a large number of magnetic trackersattached to the body. Similarly, the displaysystems can be as simple as a desktop display, ora more complicated set of helmet-mounteddisplays.3. Design Decisions for NVEsThe design decisions of NVEs are the parametersunder the control of NVE system developers.Different than the preconditions of NVEs, theseare the elements that can be changed duringsoftware development, in order to have anefficient simulation of the virtual world.3.1 Host Program ArchitectureAn NVE is defined as a single environmentshared by multiple participants connecting fromdifferent hosts. Each host typically stores thewhole or a subset of the scene description, andlets the participant use their own avatar to movearound the NVE. Additionally, the local programsimulates the behaviour of a set of entities in theworld, and also handles the real-world sensingusing a set of input devices.NVE software shares similar design goals asthe other types of software: generality, usability,portability, understandability and efficiency. Inaddition, there are other characteristic goals ofNVEs: rapid development of applications,modularity, decoupling of main VE tasks fromthe application, immersion and embodiment ofparticipant.Toolkit-Based ArchitecturesToolkit-based architectures provide tools andlibraries for creation and interaction with virtualenvironments. They provide: controlling theobjects in the environment, moving the bodyrepresentation, changing viewpoint, objectrelationships, display, management andsynchronization of resources, networkingmultiple participants, obtaining statistics.Example toolkits are WorldToolKit, MR Toolkit,and other 3D graphics toolkits such asPerformer, Java3D. We will review theadvantage and disadvantage of each toolkit.Integrated Software-Based Architectures Integrated software-based architectures, incontrast to toolkit approaches, provide acomplete system that implements basic VE tasks.This is similar to thinking of implementing theNVE system as a distributed database accessproblem, therefore the details of the main NVEtasks and synchronization of data are transparentto the application developer. The newapplications are developed either by using thepreviously developed components, or byreplacing them with new programs. VEOS, dVS,NPSNET, DIVE, MASSIVE, SPLINE,BrickNet, VISTEL are some of the systems.3.2 Data and Task DistributionEach virtual object and each participantembodiment within the NVE affects theperformance of the different parts of thesimulation: network, CPU, graphics. Theseoverheads easily become significant withincreasing number of participants andcomplexity of environments. The main solutionto this problem is to let each participant’s hostcomputer process only the part of theenvironment it is interested in. Many researcherspropose methods for dividing and sharing the VEdata and processing at each host computer.Distribution may depend on the application,client architecture, network topology and otherdesign decisions. Generally, the data distributionis not transparent; the application developer,designer of the applications and the participantsshould be aware of the data distribution, so it isneither possible nor necessary to make thedistribution fully transparent. In this section andthe following sections, we survey the variousmethods for sharing and distributing a virtualworld over multiple participants, i.e. their hostcomputers.Sharing of the virtual world typicallyinvolves sharing the geometry, and transmittingobject updates. However, some systems such asBrickNet allow applications to share thebehaviours too.Partitioning of the virtual world is necessaryto decrease the CPU, network and graphicsoverheads of the simulation. Additionaladvantages of distribution are minimizedcommunication between network tail links, andlocalized reliability problems caused when a hostor link goes down (Macedonia et al. 1994).Macedonia et al. (1995) also suggest that thereare three possible approaches for partitioning thescene: spatial, temporal, functional. Variousresearch groups have proposed methods forspatial NVE partitioning.Four schemes are possible (Capin 1999):separate servers (that separate the world intoindependent worlds), uniform geometricalstructure (that divide the world uniformly), freegeometrical structure (that divide the worldbased on users choices), user-centred dynamicstructure (that divide the world based oninteractions between users).3.3 Network TopologyWe have discussed possible networkcharacteristics: unicast, multicast, broadcast. It isnecessary also to consider network topologiesfor connecting the clients in the NVE. Thechoice of network topology depends on thenetwork characteristics and applications, amongother preconditions. Network topologies into twocategories: peer-to-peer and client–server. It isalso possible to use a hybrid combination ofthese topologies (Funkhouser 1996) (Capin1999).3.4 Avatar RepresentationThe participant is an important element in theintegrated NVE system, so the embodimentshould be represented realistically andefficiently. The embodiment has functions forself-representation and for representation toother participants in the same world. Here aresome functions for self-representation: Thevisual embodiment of the user, the means ofinteraction with the world, the means of feelingvarious attributes of the world using the senses.The functions for interaction with others are:perception, localization, identification,visualization of others’ interest focus andactions, and social representation throughdecoration of the avatar.Most of the common systems use simpleavatars to represent participants. Among themost complex representations, the VLNETsystem from EPFL and Miralab uses a widerange of animation techniques from magnetictrackers to autonomous control, SPLINE systemfrom MERL Labs uses procedural animation,VISTEL from ATR labs uses computer visiontechniques.3.5 ProtocolDevelopers of NVE systems should consider allthe factors described up to now, in order todefine the architecture of the system, thetopology for communication, avatarrepresentation, and the classification of entitiesin the VE. Once the NVE system designer makesthese decisions, the system should implement aprotocol to be able to communicate efficiently.This mainly depends on how the participants andvirtual objects are represented, as well as thepreconditions and design decisions of the NVEsystem. The protocol will ideally contain sessionmanagement, state and event information, andinteraction among objects. Until now there hasbeen a lack of efficient standard protocols formanaging NVE systems. The DistributedInteractive Simulation (DIS) system provides aspecial-purpose protocol for militaryapplications. On the other hand, a general-purpose reliable multicast protocol is used tosynchronize distributed versions of the NVEworld data. There is also a new standardizationeffort within the ISO SC29 MPEG-4 body tostandardize bitstream syntax and semantics forcomputer graphics applications and a special adhoc group has been formed for multiuser worlds.4. Further ImprovementsThe fidelities in NVEs can be further improvedby introducing the following additional featuresin the virtual environment:• Default parameters for different worlds: TheNVE system can provide default behavioursof objects in order to minimize the worlddesign complexity. For example, the gravityproperty can be part of the worldclassification, and the application designer ofthe virtual world does not need to specifygravity behaviour for each entity.• Collisions: Collisions significantly improvethe quality of the virtual world simulation.• Access rights: Virtual environments withlarge numbers of participants create theproblem of accessing different objects andparts of the virtual world. This can bemoderated by introducing access rights thatparticipants need to be given to enter parts ofthe world, similar to access rights for files inoperating systems.• Picking resolution: By default, most of thecurrent NVEs provide a coarse resolution tocompute intersection tests for picking. Thiscan be improved by introducing fine objectmanipulation techniques.• Force feedback: Haptics is an importantfactor that increases the natural interactionwithin the virtual environment.  Furthermore, the NVE system developers canexploit various techniques to decrease thecommunication and computation overhead fortasks connected with participant-to-participantcommunication; and there are other techniquesto increase the quality and response rate of thesimulation. Here are some of them: 1) Level ofdetail: for representing the geometrical data indifferent resolutions. 2) Motion level of detail:for sending the state update messages to remotehosts in different rates, depending on theirdistance. 3) Filtering messages: so that onlyinterested hosts receive the state changes of anentity. 4) Dead reckoning: a technique todecrease the network requirements, based onextrapolation of future states of entities. 5)Compression of messages: sending messageswith a loss of information, for using lessbandwidth. 6) Synchronization: so that each hostmachine has similar states of the virtual world.5.  ConclusionWe have presented a taxonomy for NVEsystems. We believe that this taxonomy is auseful tool to analyze and compare various NVEsystems.ReferencesBricken W., Coco G. (1993) The VEOS Project,Technical Report R-93-3, Human InterfaceTechnology Laboratory, University ofWashington.Capin T.K., Pandzic I.S., Thalmann D.,Magnenat Thalmann N. (1997a) A Dead-Reckoning Algorithm for Virtual HumanFigures, Proc. VRAIS ’97, pp. 161–169.Capin T.K., Pandzic I.S., Noser H., MagnenatThalmann N., Thalmann D. (1997b) VirtualHuman Representation and Communicationin VLNET Networked VirtualEnvironments,  IEEE Computer Graphicsand Applications, Vol.17, No.2, pp. 42–53.Capin T.K., Pandzic I.S., Thalmann D.,Magnenat Thalmann N. Avatars inNetworked Virtual Environments, JohnWiley, June 1999.Funkhouser T.A. (1996) Network Topologies forScaleable Multi-User Virtual Environments,Proc. VRAIS ’96, pp. 222–228.Macedonia M.R., Zyda M.J., Pratt D.R., BarhamP.T., Zestwitz (1994) NPSNET: A NetworkSoftware Architecture for Large-ScaleVirtual Environments, Presence, MIT Press,Vol.3, No.4, pp. 265–287.

A Taxonomy of Networked Virtual Environments

http://infoscience.epfl.ch/record/101321/files/Capin_Thalmann_2_SNHC_99.pdf

A Taxonomy of Networked Virtual Environments

Abstract

Similar works

Full text

Available Versions

Infoscience - École polytechnique fédérale de Lausanne