Augmented robotics dialog system for enhancing human-robot interaction

Augmented reality, augmented television and second screen are cutting edge technologies that provide end users extra and enhanced information related to certain events in real time. This enriched information helps users better understand such events, at the same time providing a more satisfactory experience. In the present paper, we apply this main idea to human-robot interaction (HRI), to how users and robots interchange information. The ultimate goal of this paper is to improve the quality of HRI, developing a new dialog manager system that incorporates enriched information from the semantic web. This work presents the augmented robotic dialog system (ARDS), which uses natural language understanding mechanisms to provide two features: (i) a non-grammar multimodal input (verbal and/or written) text; and (ii) a contextualization of the information conveyed in the interaction. This contextualization is achieved by information enrichment techniques that link the extracted information from the dialog with extra information about the world available in semantic knowledge bases. This enriched or contextualized information (information enrichment, semantic enhancement or contextualized information are used interchangeably in the rest of this paper) offers many possibilities in terms of HRI. For instance, it can enhance the robot's pro-activeness during a human-robot dialog (the enriched information can be used to propose new topics during the dialog, while ensuring a coherent interaction). Another possibility is to display additional multimedia content related to the enriched information on a visual device. This paper describes the ARDS and shows a proof of concept of its applications.The authors gratefully acknowledge the funds provided by the Spanish MICINN (Ministry of Science and Innovation) through the project “Aplicaciones de los robots sociales”, DPI2011-26980 from the Spanish Ministry of Economy and Competitiveness. The research leading to these results has received funding from the RoboCity2030-III-CM project (Robótica aplicada a la mejora de la calidad de vida de los ciudadanos. fase III; S2013/MIT-2748), funded by Programas de Actividades I+D en la Comunidad de Madrid and co-funded by the Structural Funds of the EU

A Review of Verbal and Non-Verbal Human-Robot Interactive Communication

In this paper, an overview of human-robot interactive communication is presented, covering verbal as well as non-verbal aspects of human-robot interaction. Following a historical introduction, and motivation towards fluid human-robot communication, ten desiderata are proposed, which provide an organizational axis both of recent as well as of future research on human-robot communication. Then, the ten desiderata are examined in detail, culminating to a unifying discussion, and a forward-looking conclusion

From libertarian paternalism to liberalism: behavioural science and policy in an age of new technology

Behavioural science has been effectively used by policy makers in various domains, from health to savings. However, interventions that behavioural scientists typically employ to change behaviour have been at the centre of an ethical debate, given that they include elements of paternalism that have implications for people’s freedom of choice. In the present article, we argue that this ethical debate could be resolved in the future through implementation and advancement of new technologies. We propose that several technologies which are currently available and are rapidly evolving (i.e., virtual and augmented reality, social robotics, gamification, self-quantification, and behavioural informatics) have a potential to be integrated with various behavioural interventions in a non-paternalistic way. More specifically, people would decide themselves which behaviours they want to change and select the technologies they want to use for this purpose, and the role of policy makers would be to develop transparent behavioural interventions for these technologies. In that sense, behavioural science would move from libertarian paternalism to liberalism, given that people would freely choose how they want to change, and policy makers would create technological interventions that make this change possible

Extending Human-Robot Relationships Based in Music With Virtual Presence

Social relationships between humans and robots require both long term engagement and a feeling of believability or social presence toward the robot. It is our contention that music can provide the extended engagement that other open-ended interaction studies have failed to do, also, that in combination with the engaging musical interaction, the addition of simulated social behaviors is necessary to trigger this sense of believability or social presence. Building on previous studies with our robot drummer Mortimer that show including social behaviors can increase engagement and social presence, we present the results of a longitudinal study investigating the effect of extending weekly collocated musical improvisation sessions by making Mortimer an active member of the participant's virtual social network. Although, we found the effects of extending the relationship into the virtual world were less pronounced than results we have previously found by adding social modalities to human-robot musical interaction, interesting questions are raised about the interpretation of our automated behavioral metrics across different contexts. Further, we found repeated results of increasingly uninteruppted playing and notable differences in responses to online posts by Mortimer and posts by participant's human friends

Shaping technologies for older adults with and without dementia: Reflections on ethics and preferences

As a result of several years of European funding, progressive introduction of assistive technologies in our society has provided many researchers and companies with opportunities to develop new information and communication technologies aimed at overcoming the digital divide of those at a greater risk of being left behind, as can be the case with healthy older people and those developing cognitive decline and dementia. Moreover, in recent years, when considering how information and communication technologies have been integrated into older people’s lives, and how technology has influenced these individuals, doubts remain regarding whether technologies really fulfil older users’ needs and wishes and whether technologies developed specifically for older users necessarily protect and consider main ethical values. In this article, we address the relevance of privacy, vulnerability and preservation of autonomy as key factors when involving older individuals as target users for information and communication technology research and development. We provide explanatory examples on ethical issues involved in the particular case of developing different types of information and communication technology for older people (from robotics to serious games), what previously performed research tells us about older adults’ preferences and wishes for information and communication technology and what steps should be taken into consideration in the near future

Organizational Posthumanism

Building on existing forms of critical, cultural, biopolitical, and sociopolitical posthumanism, in this text a new framework is developed for understanding and guiding the forces of technologization and posthumanization that are reshaping contemporary organizations. This ‘organizational posthumanism’ is an approach to analyzing, creating, and managing organizations that employs a post-dualistic and post-anthropocentric perspective and which recognizes that emerging technologies will increasingly transform the kinds of members, structures, systems, processes, physical and virtual spaces, and external ecosystems that are available for organizations to utilize. It is argued that this posthumanizing technologization of organizations will especially be driven by developments in three areas: 1) technologies for human augmentation and enhancement, including many forms of neuroprosthetics and genetic engineering; 2) technologies for synthetic agency, including robotics, artificial intelligence, and artificial life; and 3) technologies for digital-physical ecosystems and networks that create the environments within which and infrastructure through which human and artificial agents will interact. Drawing on a typology of contemporary posthumanism, organizational posthumanism is shown to be a hybrid form of posthumanism that combines both analytic, synthetic, theoretical, and practical elements. Like analytic forms of posthumanism, organizational posthumanism recognizes the extent to which posthumanization has already transformed businesses and other organizations; it thus occupies itself with understanding organizations as they exist today and developing strategies and best practices for responding to the forces of posthumanization. On the other hand, like synthetic forms of posthumanism, organizational posthumanism anticipates the fact that intensifying and accelerating processes of posthumanization will create future realities quite different from those seen today; it thus attempts to develop conceptual schemas to account for such potential developments, both as a means of expanding our theoretical knowledge of organizations and of enhancing the ability of contemporary organizational stakeholders to conduct strategic planning for a radically posthumanized long-term future

Anthropomorphic Robot Design and User Interaction Associated with Motion

Though in its original concept a robot was conceived to have some human-like shape, most robots now in use have specific industrial purposes and do not closely resemble humans. Nevertheless, robots that resemble human form in some way have continued to be introduced. They are called anthropomorphic robots. The fact that the user interface to all robots is now highly mediated means that the form of the user interface is not necessarily connected to the robots form, human or otherwise. Consequently, the unique way the design of anthropomorphic robots affects their user interaction is through their general appearance and the way they move. These robots human-like appearance acts as a kind of generalized predictor that gives its operators, and those with whom they may directly work, the expectation that they will behave to some extent like a human. This expectation is especially prominent for interactions with social robots, which are built to enhance it. Often interaction with them may be mainly cognitive because they are not necessarily kinematically intricate enough for complex physical interaction. Their body movement, for example, may be limited to simple wheeled locomotion. An anthropomorphic robot with human form, however, can be kinematically complex and designed, for example, to reproduce the details of human limb, torso, and head movement. Because of the mediated nature of robot control, there remains in general no necessary connection between the specific form of user interface and the anthropomorphic form of the robot. But their anthropomorphic kinematics and dynamics imply that the impact of their design shows up in the way the robot moves. The central finding of this report is that the control of this motion is a basic design element through which the anthropomorphic form can affect user interaction. In particular, designers of anthropomorphic robots can take advantage of the inherent human-like movement to 1) improve the users direct manual control over robot limbs and body positions, 2) improve users ability to detect anomalous robot behavior which could signal malfunction, and 3) enable users to be better able to infer the intent of robot movement. These three benefits of anthropomorphic design are inherent implications of the anthropomorphic form but they need to be recognized by designers as part of anthropomorphic design and explicitly enhanced to maximize their beneficial impact. Examples of such enhancements are provided in this report. If implemented, these benefits of anthropomorphic design can help reduce the risk of Inadequate Design of Human and Automation Robotic Integration (HARI) associated with the HARI-01 gap by providing efficient and dexterous operator control over robots and by improving operator ability to detect malfunctions and understand the intention of robot movement

Envisioning social drones in education

Education is one of the major application fields in social Human-Robot Interaction. Several forms of social robots have been explored to engage and assist students in the classroom environment, from full-bodied humanoid robots to tabletop robot companions, but flying robots have been left unexplored in this context. In this paper, we present seven online remote workshops conducted with 20 participants to investigate the application area of Education in the Human-Drone Interaction domain; particularly focusing on what roles a social drone could fulfill in a classroom, how it would interact with students, teachers and its environment, what it could look like, and what would specifically differ from other types of social robots used in education. In the workshops we used online collaboration tools, supported by a sketch artist, to help envision a social drone in a classroom. The results revealed several design implications for the roles and capabilities of a social drone, in addition to promising research directions for the development and design in the novel area of drones in education