Conveying Audience Emotions through Humanoid Robot Gestures to an Orchestra during a Live Musical Exhibition

In the last twenty years, robotics have been applied in many heterogeneous contexts. Among them, the use of humanoid robots during musical concerts have been proposed and investigated by many authors. In this paper, we propose a contribution in the area of robotics application in music, consisting of a system for conveying audience emotions during a live musical exhibition, by means of a humanoid robot. In particular, we provide all spectators with a mobile app, by means of which they can select a specific color while listening to a piece of music (act). Each color is mapped to an emotion, and the audience preferences are then processed in order to select the next act to be played. This decision, based on the overall emotion felt by the audience, is then communicated by the robot through body gestures to the orchestra. Our first results show that spectators enjoy such kind of interactive musical performance, and are encouraging for further investigations

Your New Best Friends: An Exploration of Furby, Siri, and Other Sociable Electronics

Your New Best Friends: An Exploration of Furby, Siri and Other Sociable Electronics is focused around interactive electronic systems and the effect these systems can have on our human psyches. My work focuses on two particular periods of development: the late 80’s to early 90’s, and the 2010’s to present. One period represents my childhood and the other my early adulthood. By comparing the two I can examine trends in the ways we engage with robotics and can better understand the ubiquity of electronically mediated interactions today. I utilize these new understandings to manipulate the capabilities of devices from both periods to create pieces that communicate care in a new way, sparking a moment of joy for the viewer while also increasing the awareness of the failings of devices when compared with true human interaction

Overview and Strategy Analysis of Technology-Based Nonpharmacological Interventions for In-Hospital Delirium Prevention and Reduction:Systematic Scoping Review

BACKGROUND: Delirium prevention is crucial, especially in critically ill patients. Nonpharmacological multicomponent interventions for preventing delirium are increasingly recommended and technology-based interventions have been developed to support them. Despite the increasing number and diversity in technology-based interventions, there has been no systematic effort to create an overview of these interventions for in-hospital delirium prevention and reduction. OBJECTIVE: This systematic scoping review was carried out to answer the following questions: (1) what are the technologies currently used in nonpharmacological technology-based interventions for preventing and reducing delirium? and (2) what are the strategies underlying these currently used technologies? METHODS: A systematic search was conducted in Scopus and Embase between 2015 and 2020. A selection was made in line with the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR). Studies were eligible if they contained any type of technology-based interventions and assessed delirium-/risk factor–related outcome measures in a hospital setting. Data extraction and quality assessment were performed using a predesigned data form. RESULTS: A total of 31 studies were included and analyzed focusing on the types of technology and the strategies used in the interventions. Our review revealed 8 different technology types and 14 strategies that were categorized into the following 7 pathways: (1) restore circadian rhythm, (2) activate the body, (3) activate the mind, (4) induce relaxation, (5) provide a sense of security, (6) provide a sense of control, and (7) provide a sense of being connected. For all technology types, significant positive effects were found on either or both direct and indirect delirium outcomes. Several similarities were found across effective interventions: using a multicomponent approach or including components comforting the psychological needs of patients (eg, familiarity, distraction, soothing elements). CONCLUSIONS: Technology-based interventions have a high potential when multidimensional needs of patients (eg, physical, cognitive, emotional) are incorporated. The 7 pathways pinpoint starting points for building more effective technology-based interventions. Opportunities were discussed for transforming the intensive care unit into a healing environment as a powerful tool to prevent delirium. TRIAL REGISTRATION: PROSPERO International Prospective Register of Systematic Reviews CRD42020175874; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=17587

A roboethics framework for the development and introduction of social assistive robots in elderly care

There is an emerging “aging phenomenon” worldwide. It is likely that we will require the introduction of assistive technologies that can assist caregivers in the exercise of elderly care. Such technologies should be designed in ways that promote high levels of human dignity and quality of life through the aging process. Social Assistive Robots (SARs) demonstrate high potential for complementing elderly care when it comes to cognitive assistance, entertainment, communication and supervision. However such close Human Robotics Interactions (HRIs) encompass a rich set of ethical scenarios that need to be addressed before SARs are introduced into mass markets. To date the HRI benchmarks of “Imitation”, “Safety”, “Autonomy”, “Privacy”, “Scalability”, “Social success” and “Understanding of the domain” are the only guidelines to inform SARs developers when developing robotic prototypes for human assistance. However such HRI benchmarks are broad and lack of theoretical background to understand potential ethical issues in elderly care. Further, there is little guidance for either developers or those involved in the provision of care, regarding the appropriate introduction of SARs.In this research the current HRI benchmarks are reviewed alongside the core ethical principles of beneficence, non-maleficence, autonomy and justice, together with a social care ethos. Based on such interpretation, practical robotics workshops were conducted in five care and extra care institutions with the direct participation of elderly groups, caregivers and relatives. “In-situ” robotics demonstrations, informal interviews and observations were conducted, investigating human behaviours, attitudes, expectations, concerns, and levels of acceptance towards the introduction of SARs in elderly care settings. Following a thematic analysis of the findings, a roboethics framework is proposed to support the research and development of SARs. The developed framework highlights the importance of selection, categorization and completion of relevant HRI benchmarks, HRI templates, HRI supervision schemes and ethical specifications for SARs applications

Talking to computers

A popular belief amongst UX designers is that the more voice user interfaces (i.e. Alexa, Siri, Google Assistant) speak and behave like people, the more functional they will be. But, conversational mimicry is not the only way a screenless computer can communicate information. The scope of sounds humans can interpret, manipulate, and make is broad. This project seeks to identify ways designers can mine this domain for interaction cues that promote a deeper understanding of digital content and the systems that deliver it

Responsible domestic robotics:Exploring ethical implications of robots in the home

Purpose: The vision of robotics in the home promises increased convenience, comfort, companionship, and greater security for users. The robot industry risks causing harm to users, being rejected by society at large, or being regulated in overly prescriptive ways if robots are not developed in a socially responsible manner. The purpose of this paper is to explore some of the challenges and requirements for designing responsible domestic robots.Design/methodology/approach: The paper examines definitions of robotics and the current commercial state of the art. In particular it considers the emerging technological trends, such as smart homes, that are already embedding computational agents in the fabric of everyday life. The paper then explores the role of values in design, aligning with human computer interaction and considers the importance of the home as a deployment setting for robots. The paper examines what responsibility in robotics means and draws lessons from past home information technologies. An exploratory pilot survey was conducted to understand user concerns about different aspects of domestic robots such as form, privacy and trust. The paper provides these findings, married with literature analysis from across technology law, computer ethics and computer science.Findings: By drawing together both empirical observations and conceptual analysis, this paper concludes that user centric design is needed to create responsible domestic robotics in the future.Originality/value: This multidisciplinary paper provides conceptual and empirical research from different domains to unpack the challenges of designing responsible domestic robotics

Designing Sound for Social Robots: Advancing Professional Practice through Design Principles

Sound is one of the core modalities social robots can use to communicate with the humans around them in rich, engaging, and effective ways. While a robot's auditory communication happens predominantly through speech, a growing body of work demonstrates the various ways non-verbal robot sound can affect humans, and researchers have begun to formulate design recommendations that encourage using the medium to its full potential. However, formal strategies for successful robot sound design have so far not emerged, current frameworks and principles are largely untested and no effort has been made to survey creative robot sound design practice. In this dissertation, I combine creative practice, expert interviews, and human-robot interaction studies to advance our understanding of how designers can best ideate, create, and implement robot sound. In a first step, I map out a design space that combines established sound design frameworks with insights from interviews with robot sound design experts. I then systematically traverse this space across three robot sound design explorations, investigating (i) the effect of artificial movement sound on how robots are perceived, (ii) the benefits of applying compositional theory to robot sound design, and (iii) the role and potential of spatially distributed robot sound. Finally, I implement the designs from prior chapters into humanoid robot Diamandini, and deploy it as a case study. Based on a synthesis of the data collection and design practice conducted across the thesis, I argue that the creation of robot sound is best guided by four design perspectives: fiction (sound as a means to convey a narrative), composition (sound as its own separate listening experience), plasticity (sound as something that can vary and adapt over time), and space (spatial distribution of sound as a separate communication channel). The conclusion of the thesis presents these four perspectives and proposes eleven design principles across them which are supported by detailed examples. This work contributes an extensive body of design principles, process models, and techniques providing researchers and designers with new tools to enrich the way robots communicate with humans

Human—Robot companionship: A mixed-methods investigation

In recent years, the arts have brought robots to life in spectacular fashion. In popular fiction we have been presented with machines that can run, leap, fight, and (perhaps most impressively of all) robots which can ascend stairs with absolutely no trouble at all. Amidst these chaotic and often dystopian scenes, we are exposed to moments of humour and lightness – robots can be seen engaging in conversation, cracking jokes, and comforting someone in their time of need. In these relatively mundane moments (as we smile, laugh, and cry) the impression emerges that the robot is something special to the person depicted. Rather than simply being a household appliance, it appears to be something more: a sort of… friend. Returning from the pages and screens of fiction to the real world, we find human society ever more fractured, and the loneliness epidemic at large. Unsurprisingly, given the engaging depictions in popular fiction, the idea of robots for companionship and social support is gaining traction and garnering increasing research attention. In care homes, robot animals can be found cooing and purring in the laps of individuals with dementia, while in schools, friendly humanoid robots may be seen teaching social skills to children with additional needs. What remains unknown, though, is the extent to which people will grow fond of such ‘social robots’ over time, and if so, whether their relationships with these machines might ever resemble (or indeed, replace) those with other humans. Is a ‘robot friend’ the stuff of science-fiction, or could it someday soon become sciencereality? In this thesis, this question is explored from a range of perspectives using a variety of methods spanning lab-based experiments, online surveys, and focus groups. This thesis begins with an introduction to social robots, and an exploration of the background regarding the nature and importance of human social relationships. After introducing relevant theories, I highlight gaps in our understanding of human—robot companionship that I seek to explore through this thesis (Chapter 1). In the subsequent chapters, I present four empirical pieces of work, each offering a unique perspective on the subject. Specifically, in Chapter 2, I report results from a lab-based experiment in which a robot’s lights (located within its shoulders) were programmed to illuminate in a synchronous or asynchronous manner relative to a participant’s heart rate. I aimed to determine whether such a synchrony manipulation might increase prosocial behaviours and improve attitudes towards a social robot - based on prior work showing that experimentally-induced movement synchrony can improve rapport between people, and increase their liking of social robots (Hove & Risen, 2009; Lehmann et al., 2015, Mogan, Fischer & Bulbulia, 2017). Despite demonstrating no positive effect of the light manipulation, this study raises important questions regarding the complexities of defining and measuring attachment to a robot. In Chapter 3, I delve deeper into the qualitative data collected in Chapter 2 to build a more complete appreciation of the value of open questions – particularly in terms of method validation and understanding participants’ internal experiences. After this chapter, I shift perspective from a focus on humanoid robots (and manipulations based on human social behaviours), to human relationships with non-human companion animals. This shift was motivated by my desire to explore how non-human agents form deep and enduring social bonds with humans – as opposed to basing the thesis on human interpersonal relationships alone. Due to the success of dogs as companions, I conducted a study in which dog owners were asked to identify behaviours that they perceived as important to the bond with their dog (Chapter 4). Seven key themes emerged from this research, indicating the importance of attunement, communication, consistency and predictability, physical affection, positivity and enthusiasm, proximity, and shared activities. In the following chapter, I implement a selection of ‘desirable’ dog behaviours within an animal-inspired robot (Chapter 5). By showing the behaviours to members of the general public, and conducting focus groups, I gained deeper insights into the polarising nature of robot animals – not only in terms of how their behaviours are perceived, but also in terms of the roles people think robots should (and should not) hold. In addition to these themes, this final empirical chapter discusses insights regarding the high expectations people place upon robots, as well as public concerns around overdependence on robots, and privacy. By releasing these chapters to the HRI community (through publications or preprints) we sparked conversations within the HRI community – not only about the ethics of robot abuse studies, but also the potential value of qualitative approaches within the field. Our team was commended for publishing qualitative research, in a field heavily dominated by quantitative methods, and we have since been working to continue the conversations around the value of qualitative approaches. Specifically, we hosted the “Enriching HRI Research with Qualitative Methods” workshop at the International Journal on Social Robotics (2020) and launched a “Qualitative Research in HRI/HCI Discussion Group” online - allowing HRI researchers to discuss their work, and share relevant resources (e.g., events and publications). This thesis concludes by detailing work to be done moving forwards, to enhance our understanding of human—robot social relationships, and a broader discussion of our possible future with social robots (Chapter 6). Pulling from various disciplines (including psychology, cognitive science, human—robot interaction (HRI) Studies, robot ethics, and philosophy), this section concludes with consideration of potential consequences of companion technologies – not only for the individual, but perhaps for society as a whole, as we continue to grapple with questions concerning how much of science fiction we wish to welcome into our daily lives