Structuring information through gesture and intonation

Face-to-face communication is multimodal. In unscripted spoken discourse we can observe the interaction of several “semiotic layers”, modalities of information such as syntax, discourse structure, gesture, and intonation. We explore the role of gesture and intonation in structuring and aligning information in spoken discourse through a study of the co-occurrence of pitch accents and gestural apices. Metaphorical spatialization through gesture also plays a role in conveying the contextual relationships between the speaker, the government and other external forces in a naturally-occurring political speech setting

System engineering techniques for establishing balanced design and performance guidelines for the advanced telerobotic testbed

Novel system engineering techniques have been developed and applied to establishing structured design and performance objectives for the Telerobotics Testbed that reduce technical risk while still allowing the testbed to demonstrate an advancement in state-of-the-art robotic technologies. To estblish the appropriate tradeoff structure and balance of technology performance against technical risk, an analytical data base was developed which drew on: (1) automation/robot-technology availability projections, (2) typical or potential application mission task sets, (3) performance simulations, (4) project schedule constraints, and (5) project funding constraints. Design tradeoffs and configuration/performance iterations were conducted by comparing feasible technology/task set configurations against schedule/budget constraints as well as original program target technology objectives. The final system configuration, task set, and technology set reflected a balanced advancement in state-of-the-art robotic technologies, while meeting programmatic objectives and schedule/cost constraints

Leading and following with a virtual trainer

This paper describes experiments with a virtual fitness trainer capable of mutually coordinated interaction. The virtual human co-exercises along with the user, leading as well as following in tempo, to motivate the user and to influence the speed with which the user performs the exercises. In a series of three experiments (20 participants in total) we attempted to influence the users' performance by manipulating the (timing of the) exercise behavior of the virtual trainer. The results show that it is possible to do this implicitly, using only micro adjustments to its bodily behavior. As such, the system is a rst step in the direction of mutually coordinated bodily interaction for virtual humans

Advanced satellite workstation: An integrated workstation environment for operational support of satellite system planning and analysis

A prototype integrated environment, the Advanced Satellite Workstation (ASW), is described that has been developed and delivered for evaluation and operator feedback in an operational satellite control center. The current ASW hardware consists of a Sun Workstation and Macintosh II Workstation connected via an ethernet Network Hardware and Software, Laser Disk System, Optical Storage System, and Telemetry Data File Interface. The central mission of ASW is to provide an intelligent decision support and training environment for operator/analysts of complex systems such as satellites. There have been many workstation implementations recently which incorporate graphical telemetry displays and expert systems. ASW is a considerably broader look at intelligent, integrated environments for decision support, based upon the premise that the central features of such an environment are intelligent data access and integrated toolsets. A variety of tools have been constructed in support of this prototype environment including: an automated pass planner for scheduling vehicle support activities, architectural modeler for hierarchical simulation and analysis of satellite vehicle subsystems, multimedia-based information systems that provide an intuitive and easily accessible interface to Orbit Operations Handbook and other relevant support documentation, and a data analysis architecture that integrates user modifiable telemetry display systems, expert systems for background data analysis, and interfaces to the multimedia system via inter-process communication

From images via symbols to contexts: using augmented reality for interactive model acquisition

Systems that perform in real environments need to bind the internal state to externally perceived objects, events, or complete scenes. How to learn this correspondence has been a long standing problem in computer vision as well as artificial intelligence. Augmented Reality provides an interesting perspective on this problem because a human user can directly relate displayed system results to real environments. In the following we present a system that is able to bootstrap internal models from user-system interactions. Starting from pictorial representations it learns symbolic object labels that provide the basis for storing observed episodes. In a second step, more complex relational information is extracted from stored episodes that enables the system to react on specific scene contexts

Holistic engineering design : a combined synchronous and asynchronous approach

To aid the creation and through-life support of large, complex engineering products, organizations are placing a greater emphasis on constructing complete and accurate records of design activities. Current documentary approaches are not sufficient to capture activities and decisions in their entirety and can lead to organizations revisiting and in some cases reworking design decisions in order to understand previous design episodes. Design activities are undertaken in a variety of modes; many of which are dichotomous, and thus each require separate documentary mechanisms to capture information in an efficient manner. It is possible to identify the modes of learning and transaction to describe whether an activity is aimed at increasing a level of understanding or whether it involves manipulating information to achieve a tangible task. The dichotomy of interest in this paper is that of synchronous and asynchronous working, where engineers may work alternately as part of a group or as individuals and where different forms of record are necessary to adequately capture the processes and rationale employed in each mode. This paper introduces complimentary approaches to achieving richer representations of design activities performed synchronously and asynchronously, and through the undertaking of a design based case study, highlights the benefit of each approach. The resulting records serve to provide a more complete depiction of activities undertaken, and provide positive direction for future co-development of the approaches

Holographic and 3D teleconferencing and visualization: implications for terabit networked applications

Abstract not available

Asperger's syndrome: learner characteristics and teaching strategies

Students with Asperger's syndrome present a particular challenge for their parents, teachers, and peers. Therefore it is important for teachers working in inclusive settings to become aware of the unique needs of these students. In this paper, challenges for students with Asperger's syndrome are discussed in terms of five aspects; communication, motor clumsiness, obsessional interests, attention and social skills. These characteristics are discussed in a wav that will facilitate teachers' understanding of the difficulties associated with student participation in the school environment. Challenges for teachers are discussed under the headings: inclusive schooling; need for a structured program; behaviour management; communication; and creativity in planning. Adaptive and compensatory strategies for teachers are described which will facilitate learning and participation of students with Asperger's syndrome in the regular classroom

Bursts of activity in collective cell migration

Dense monolayers of living cells display intriguing relaxation dynamics, reminiscent of soft and glassy materials close to the jamming transition, and migrate collectively when space is available, as in wound healing or in cancer invasion. Here we show that collective cell migration occurs in bursts that are similar to those recorded in the propagation of cracks, fluid fronts in porous media and ferromagnetic domain walls. In analogy with these systems, the distribution of activity bursts displays scaling laws that are universal in different cell types and for cells moving on different substrates. The main features of the invasion dynamics are quantitatively captured by a model of interacting active particles moving in a disordered landscape. Our results illustrate that collective motion of living cells is analogous to the corresponding dynamics in driven, but inanimate, systems