The Human-Robot Interaction Operating System

In order for humans and robots to work effectively together, they need to be able to converse about abilities, goals and achievements. Thus, we are developing an interaction infrastructure called the "Human-Robot Interaction Operating System" (HRI/OS). The HRI/OS provides a structured software framework for building human-robot teams, supports a variety of user interfaces, enables humans and robots to engage in task-oriented dialogue, and facilitates integration of robots through an extensible API

A Preliminary Study of Peer-to-Peer Human-Robot Interaction

The Peer-to-Peer Human-Robot Interaction (P2P-HRI) project is developing techniques to improve task coordination and collaboration between human and robot partners. Our work is motivated by the need to develop effective human-robot teams for space mission operations. A central element of our approach is creating dialogue and interaction tools that enable humans and robots to flexibly support one another. In order to understand how this approach can influence task performance, we recently conducted a series of tests simulating a lunar construction task with a human-robot team. In this paper, we describe the tests performed, discuss our initial results, and analyze the effect of intervention on task performance

Collaborating with a Mobile Robot: An Augmented Reality Multimodal Interface

Invited paperWe have created an infrastructure that allows a human to collaborate in a natural manner with a robotic system. In this paper we describe our system and its implementation with a mobile robot. In our prototype the human communicates with the mobile robot using natural speech and gestures, for example, by selecting a point in 3D space and saying “go here” or “go behind that”. The robot responds using speech so the human is able to understand its intentions and beliefs. Augmented Reality (AR) technology is used to facilitate natural use of gestures and provide a common 3D spatial reference for both the robot and human, thus providing a means for grounding of communication and maintaining spatial awareness. This paper first discusses related work then gives a brief overview of AR and its capabilities. The architectural design we have developed is outlined and then a case study is discussed

Human-Robot Site Survey and Sampling for Space Exploration

NASA is planning to send humans and robots back to the Moon before 2020. In order for extended missions to be productive, high quality maps of lunar terrain and resources are required. Although orbital images can provide much information, many features (local topography, resources, etc) will have to be characterized directly on the surface. To address this need, we are developing a system to perform site survey and sampling. The system includes multiple robots and humans operating in a variety of team configurations, coordinated via peer-to-peer human-robot interaction. In this paper, we present our system design and describe planned field tests

Object Based Augmented Reality Case Study- Literature Survey on Application based approach towards Augmented Reality

This paper is about Augmented Reality (AR) using object-based visualization and implementation on the smartphone devices. Augmented Reality (AR) employs computer vision, image processing and computer graphics techniques to merge digital content into the real world. It enables real-time interaction between the user, real objects and virtual objects. AR can, for example, be used to embed 2D graphics into a video in such a way as if the virtual elements were part of the real environment. In this work, we are designing AR based software in which we are solving the problem for ease of access of documents on check post. One of the challenges of AR is to align virtual data with the environment. A marker-based approach solves the problem using visual markers, e.g. 2D barcodes, detectable with computer vision methods

An Augmented Reality Human-Robot Collaboration System

InvitedThis article discusses an experimental comparison of three user interface techniques for interaction with a remotely located robot. A typical interface for such a situation is to teleoperate the robot using a camera that displays the robot's view of its work environment. However, the operator often has a difficult time maintaining situation awareness due to this single egocentric view. Hence, a multimodal system was developed enabling the human operator to view the robot in its remote work environment through an augmented reality interface, the augmented reality human-robot collaboration (AR-HRC) system. The operator uses spoken dialogue, reaches into the 3D representation of the remote work environment and discusses intended actions of the robot. The result of the comparison was that the AR-HRC interface was found to be most effective, increasing accuracy by 30%, while reducing the number of close calls in operating the robot by factors of ~3x. It thus provides the means to maintain spatial awareness and give the users the feeling of working in a true collaborative environment

Human-robot interaction in groups: Methodological and research practices

Understanding the behavioral dynamics that underline human-robot interactions in groups remains one of the core challenges in social robotics research. However, despite a growing interest in this topic, there is still a lack of established and validated measures that allow researchers to analyze human-robot interactions in group scenarios; and very few that have been developed and tested specifically for research conducted in the wild. This is a problem because it hinders the development of general models of human-robot interaction, and makes the comprehension of the inner workings of the relational dynamics between humans and robots, in group contexts, significantly more difficult. In this paper, we aim to provide a reflection on the current state of research on human-robot interaction in small groups, as well as to outline directions for future research with an emphasis on methodological and transversal issues.info:eu-repo/semantics/publishedVersio

Towards a framework for architecting heterogeneous teams of humans and robots for space exploration

Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Aeronautics and Astronautics, 2006.Includes bibliographical references (p. 113-121).Human-robotic systems will play a critical role in space exploration, should NASA embark on missions to the Moon and Mars. A unified framework to optimally leverage the capabilities of humans and robots in space exploration will be an invaluable tool for mission planning. Although there is a growing body of literature on human robotic interactions (HRI), there is not yet a framework that lends itself both to a formal representation of heterogeneous teams of humans and robots, and to an evaluation of such teams across a series of common, task-based metrics. My objective in this thesis is to lay the foundations of a unified framework for architecting human-robotic systems for optimal task performance given a set of metrics. First, I review literature from different fields including HRI and human-computer interaction, and synthesize multiple considerations for architecting heterogeneous teams of humans and robots. I then present methods to systematically and formally capture the characteristics that describe a human-robotic system to provide a basis for evaluating human-robotic systems against a common set of metrics.(cont.) I propose an analytical formulation of common metrics to guide the design and evaluate the performance of human-robot systems, and I then apply the analytical formulation to a case study of a multi-agent human-robot system developed at NASA. Finally, I discuss directions for further research aimed at developing this framework.by Julie Ann Arnold.S.M