The Human-Robot Interaction Operating System

In order for humans and robots to work effectively together, they need to be able to converse about abilities, goals and achievements. Thus, we are developing an interaction infrastructure called the "Human-Robot Interaction Operating System" (HRI/OS). The HRI/OS provides a structured software framework for building human-robot teams, supports a variety of user interfaces, enables humans and robots to engage in task-oriented dialogue, and facilitates integration of robots through an extensible API

Intelligence for Human-Assistant Planetary Surface Robots

The central premise in developing effective human-assistant planetary surface robots is that robotic intelligence is needed. The exact type, method, forms and/or quantity of intelligence is an open issue being explored on the ERA project, as well as others. In addition to field testing, theoretical research into this area can help provide answers on how to design future planetary robots. Many fundamental intelligence issues are discussed by Murphy [2], including (a) learning, (b) planning, (c) reasoning, (d) problem solving, (e) knowledge representation, and (f) computer vision (stereo tracking, gestures). The new "social interaction/emotional" form of intelligence that some consider critical to Human Robot Interaction (HRI) can also be addressed by human assistant planetary surface robots, as human operators feel more comfortable working with a robot when the robot is verbally (or even physically) interacting with them. Arkin [3] and Murphy are both proponents of the hybrid deliberative-reasoning/reactive-execution architecture as the best general architecture for fully realizing robot potential, and the robots discussed herein implement a design continuously progressing toward this hybrid philosophy. The remainder of this chapter will describe the challenges associated with robotic assistance to astronauts, our general research approach, the intelligence incorporated into our robots, and the results and lessons learned from over six years of testing human-assistant mobile robots in field settings relevant to planetary exploration. The chapter concludes with some key considerations for future work in this area

Centaur: NASA’s mobile humanoid designed for filed work

Abstract -NASA's future lunar and martian missions will require a suite of advanced robotic systems to complete tasks during precursor visits and to assist humans while present on the surface. The Centaur is a new mobile, dexterous manipulation system designed with this future role in mind. Centaur combines the sophisticated upper body dexterity of NASA's humanoid, Robonaut, with a rugged and versatile four-wheeled base. This combination allows for robotic use of human tools and interfaces in remote locations by incorporating design improvements to the existing Robonaut that target the challenges of planetary field work: rough terrain, a varied environment (temperature, dust, wind, etc.), and distance from human operators. An overview of Centaur's design is presented focusing on the features that serve to mitigate the above risks and allow the robot to perform human-like tasks in unstructured environments. The success of this design is also demonstrated by the results of a recent coordinated field demonstration in which Centaur, under both teleoperated and autonomous control, cooperated with other NASA robots

Robotics and AI-Enabled On-Orbit Operations With Future Generation of Small Satellites

The low-cost and short-lead time of small satellites has led to their use in science-based missions, earth observation, and interplanetary missions. Today, they are also key instruments in orchestrating technological demonstrations for On-Orbit Operations (O 3 ) such as inspection and spacecraft servicing with planned roles in active debris removal and on-orbit assembly. This paper provides an overview of the robotics and autonomous systems (RASs) technologies that enable robotic O 3 on smallsat platforms. Major RAS topics such as sensing & perception, guidance, navigation & control (GN&C) microgravity mobility and mobile manipulation, and autonomy are discussed from the perspective of relevant past and planned missions

Humanity and Space

Space exploration is motivated by our desire to ensure the survival of the human species and commercial enterprises. To avoid extinction and maintain quality of life of the human species, humanity has to experiment with colonization and manipulation of our Solar System. Commercial enterprise includes technological advancements, communications, and new sources of energy available throughout the Solar System and to the benefit of humanity. This project explores all of these possibilities, provides guidelines, and a vision for the future

Embedding runtime verification post-deployment for real-time health management of safety-critical systems

As cyber-physical systems increase in both complexity and criticality, formal methods have gained traction for design-time verification of safety properties. A lightweight formal method, runtime verification (RV), embeds checks necessary for safety-critical system health management; however, these techniques have been slow to appear in practice despite repeated calls by both industry and academia to leverage them. Additionally, the state-of-the-art in RV lacks a best practice approach when a deployed system requires increased flexibility due to a change in mission, or in response to an emergent condition not accounted for at design time. Human-robot interaction necessitates stringent safety guarantees to protect humans sharing the workspace, particularly in hazardous environments. For example, Robonaut2 (R2) developed an emergent fault while deployed to the International Space Station. Possibly-inaccurate actuator readings trigger the R2 safety system, preventing further motion of a joint until a ground-control operator determines the root-cause and initiates proper corrective action. Operator time is scarce and expensive; when waiting, R2 is an obstacle instead of an asset. We adapt the Realizable, Responsive, Unobtrusive Unit (R2U2) RV framework for resource-constrained environments. We retrofit the R2 motor controller, embedding R2U2 within the remaining resources of the Field-Programmable Gate Array (FPGA) controlling the joint actuator. We add online, stream-based, real-time system health monitoring in a provably unobtrusive way that does not interfere with the control of the joint. We design and embed formal temporal logic specifications that disambiguate the emergent faults and enable automated corrective actions. We overview the challenges and techniques for formally specifying behaviors of an existing command and data bus. We present our specification debugging, validation, and refinement steps. We demonstrate success in the Robonaut2 case study, then detail effective techniques and lessons learned from adding RV with real-time fault disambiguation under the constraints of a deployed system

Multigenerational Independent Colony for Extraterrestrial Habitation, Autonomy, and Behavior Health (MICEHAB): An Investigation of a Long Duration, Partial Gravity, Autonomous Rodent Colony

The path from Earth to Mars requires exploration missions to be increasingly Earth-independent as the foundation is laid for a sustained human presence in the following decades. NASA pioneering of Mars will expand the boundaries of human exploration, as a sustainable presence on the surface requires humans to successfully reproduce in a partial gravity environment independent from Earth intervention. Before significant investment is made in capabilities leading to such pioneering efforts, the challenges of multigenerational mammalian reproduction in a partial gravity environment need be investigated. The Multi-generational Independent Colony for Extraterrestrial Habitation, Autonomy, and Behavior health is designed to study these challenges. The proposed concept is a conceptual, long duration, autonomous habitat designed to house rodents in a partial gravity environment with the goal of understanding the effects of partial gravity on mammalian reproduction over multiple generations and how to effectively design such a facility to operate autonomously while keeping the rodents healthy in order to achieve multiple generations. All systems are designed to feed forward directly to full-scale human missions to Mars. This paper presents the baseline design concept formulated after considering challenges in the mission and vehicle architectures such as: vehicle automation, automated crew health management/medical care, unique automated waste disposal and hygiene, handling of deceased crew members, reliable long-duration crew support systems, and radiation protection. This concept was selected from an architectural trade space considering the balance between mission science return and robotic and autonomy capabilities. The baseline design is described in detail including: transportation and facility operation constraints, artificial gravity system design, habitat design, and a full-scale mock-up demonstration of autonomous rodent care facilities. The proposed concept has the potential to integrate into existing mission architectures in order to achieve exploration objectives, and to demonstrate and mature common capabilities that enable a range of destinations and missions

Autonomous Systems, Robotics, and Computing Systems Capability Roadmap: NRC Dialogue

Contents include the following: Introduction. Process, Mission Drivers, Deliverables, and Interfaces. Autonomy. Crew-Centered and Remote Operations. Integrated Systems Health Management. Autonomous Vehicle Control. Autonomous Process Control. Robotics. Robotics for Solar System Exploration. Robotics for Lunar and Planetary Habitation. Robotics for In-Space Operations. Computing Systems. Conclusion

Minimally Invasive Expeditionary Surgical Care Using Human-Inspired Robots

This technical report serves as an updated collection of subject matter experts on surgical care using human-inspired robotics for human exploration. It is a summary of the Blue Sky Meeting, organized by the Florida Institute for Human and Machine Cognition (IHMC), Pensacola, Florida, and held on October 2-3, 2018. It contains an executive summary, the final report, all of the presentation materials, and an updated reference list

Towards a framework for architecting heterogeneous teams of humans and robots for space exploration

Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Aeronautics and Astronautics, 2006.Includes bibliographical references (p. 113-121).Human-robotic systems will play a critical role in space exploration, should NASA embark on missions to the Moon and Mars. A unified framework to optimally leverage the capabilities of humans and robots in space exploration will be an invaluable tool for mission planning. Although there is a growing body of literature on human robotic interactions (HRI), there is not yet a framework that lends itself both to a formal representation of heterogeneous teams of humans and robots, and to an evaluation of such teams across a series of common, task-based metrics. My objective in this thesis is to lay the foundations of a unified framework for architecting human-robotic systems for optimal task performance given a set of metrics. First, I review literature from different fields including HRI and human-computer interaction, and synthesize multiple considerations for architecting heterogeneous teams of humans and robots. I then present methods to systematically and formally capture the characteristics that describe a human-robotic system to provide a basis for evaluating human-robotic systems against a common set of metrics.(cont.) I propose an analytical formulation of common metrics to guide the design and evaluate the performance of human-robot systems, and I then apply the analytical formulation to a case study of a multi-agent human-robot system developed at NASA. Finally, I discuss directions for further research aimed at developing this framework.by Julie Ann Arnold.S.M