Virtual Meeting Rooms: From Observation to Simulation

Much working time is spent in meetings and, as a consequence, meetings have become the subject of multidisciplinary research. Virtual Meeting Rooms (VMRs) are 3D virtual replicas of meeting rooms, where various modalities such as speech, gaze, distance, gestures and facial expressions can be controlled. This allows VMRs to be used to improve remote meeting participation, to visualize multimedia data and as an instrument for research into social interaction in meetings. This paper describes how these three uses can be realized in a VMR. We describe the process from observation through annotation to simulation and a model that describes the relations between the annotated features of verbal and non-verbal conversational behavior.\ud As an example of social perception research in the VMR, we describe an experiment to assess human observers’ accuracy for head orientation

Explorations in engagement for humans and robots

This paper explores the concept of engagement, the process by which individuals in an interaction start, maintain and end their perceived connection to one another. The paper reports on one aspect of engagement among human interactors--the effect of tracking faces during an interaction. It also describes the architecture of a robot that can participate in conversational, collaborative interactions with engagement gestures. Finally, the paper reports on findings of experiments with human participants who interacted with a robot when it either performed or did not perform engagement gestures. Results of the human-robot studies indicate that people become engaged with robots: they direct their attention to the robot more often in interactions where engagement gestures are present, and they find interactions more appropriate when engagement gestures are present than when they are not.Comment: 31 pages, 5 figures, 3 table

Developmental pathways to autism: a review of prospective studies of infants at risk

Autism Spectrum Disorders (ASDs) are neurodevelopmental disorders characterized by impairments in social interaction and communication, and the presence of restrictive and repetitive behaviors. Symptoms of ASD likely emerge from a complex interaction between pre-existing neurodevelopmental vulnerabilities and the child's environment, modified by compensatory skills and protective factors. Prospective studies of infants at high familial risk for ASD (who have an older sibling with a diagnosis) are beginning to characterize these developmental pathways to the emergence of clinical symptoms. Here, we review the range of behavioral and neurocognitive markers for later ASD that have been identified in high-risk infants in the first years of life. We discuss theoretical implications of emerging patterns, and identify key directions for future work, including potential resolutions to several methodological challenges for the field. Mapping how ASD unfolds from birth is critical to our understanding of the developmental mechanisms underlying this disorder. A more nuanced understanding of developmental pathways to ASD will help us not only to identify children who need early intervention, but also to improve the range of interventions available to them

A Review of Verbal and Non-Verbal Human-Robot Interactive Communication

In this paper, an overview of human-robot interactive communication is presented, covering verbal as well as non-verbal aspects of human-robot interaction. Following a historical introduction, and motivation towards fluid human-robot communication, ten desiderata are proposed, which provide an organizational axis both of recent as well as of future research on human-robot communication. Then, the ten desiderata are examined in detail, culminating to a unifying discussion, and a forward-looking conclusion

Multi-party Interaction in a Virtual Meeting Room

This paper presents an overview of the work carried out at the HMI group of the University of Twente in the domain of multi-party interaction. The process from automatic observations of behavioral aspects through interpretations resulting in recognized behavior is discussed for various modalities and levels. We show how a virtual meeting room can be used for visualization and evaluation of behavioral models as well as a research tool for studying the effect of modified stimuli on the perception of behavior

Social referencing in the domestic horse

Dogs and cats use human emotional information directed to an unfamiliar situation to guide their behavior, known as social referencing. It is not clear whether other domestic species show similar socio-cognitive abilities in interacting with humans. We investigated whether horses (n = 46) use human emotional information to adjust their behavior to a novel object and whether the behavior of horses differed depending on breed type. Horses were randomly assigned to one of two groups: an experimenter positioned in the middle of a test arena directed gaze and voice towards the novel object with either (a) a positive or (b) a negative emotional expression. The duration of subjects’ position to the experimenter and the object in the arena, frequency of gazing behavior, and physical interactions (with either object or experimenter) were analyzed. Horses in the positive condition spent more time between the experimenter and object compared to horses in the negative condition, indicating less avoidance behavior towards the object. Horses in the negative condition gazed more often towards the object than horses in the positive condition, indicating increased vigilance behavior. Breed types differed in their behavior: thoroughbreds showed less human-directed behavior than warmbloods and ponies. Our results provide evidence that horses use emotional cues from humans to guide their behavior towards novel objects

Giving subjects the eye and showing them the finger: socio-biological cues and saccade generation in the anti-saccade task.

Pointing with the eyes or the finger occurs frequently in social interaction to indicate direction of attention and one's intentions. Research with a voluntary saccade task (where saccade direction is instructed by the colour of a fixation point) suggested that gaze cues automatically activate the oculomotor system, but non-biological cues, like arrows, do not. However, other work has failed to support the claim that gaze cues are special. In the current research we introduced biological and non-biological cues into the anti-saccade task, using a range of stimulus onset asynchronies (SOAs). The anti-saccade task recruits both top ^ down and bottom^ up attentional mechanisms, as occurs in naturalistic saccadic behaviour. In experiment 1 gaze, but not arrows, facilitated saccadic reaction times (SRTs) in the opposite direction to the cues over all SOAs, whereas in experiment 2 directional word cues had no effect on saccades. In experiment 3 finger pointing cues caused reduced SRTs in the opposite direction to the cues at short SOAs. These findings suggest that biological cues automatically recruit the oculomotor system whereas non- biological cues do not. Furthermore, the anti-saccade task set appears to facilitate saccadic responses in the opposite direction to the cues