Advances in Human-Robot Interaction

Rapid advances in the field of robotics have made it possible to use robots not just in industrial automation but also in entertainment, rehabilitation, and home service. Since robots will likely affect many aspects of human existence, fundamental questions of human-robot interaction must be formulated and, if at all possible, resolved. Some of these questions are addressed in this collection of papers by leading HRI researchers

From Mind to Machine: An Embodied Approach to Image Creation with Generative AI

This thesis explores the integration of embodied interactions within Human-to-Artificial Intelligence (AI) collaborative activity to support creative engagement and reduce the perception of AI as an uncontrollable, autonomous entity, also known as the AI “black box” rhetoric. Specifically, it investigates the utilization of kinetic sand as a sensory material and physiological data collector, facilitating the translation of users' hand motions and imprints in the sand into inputs for generative AI image creation. Informed by sociocultural frameworks of creativity, theories of embodied cognition and the positioning of AI as a statistical model, while grounded in iterative design methodologies and phenomenological analysis, the research aims to identify emergent guidelines from this collaborative creative process between humans and AI. The findings hope to contribute to the development of guidelines that inform the future design and implementation of generative AI systems for creative work. These guidelines account for embodied cognition as an essential facet of human creativity, promoting more intuitive and meaningful interactions between humans and generative AI. Ultimately, this research seeks to advance the discourse on human-AI collaboration, emphasizing the importance of embodied techniques in fostering creative synergy and mitigating the black box effect

Finding resilience through music for neurodivergent children

This research paper presents a collaborative effort to design a music-making tool that seamlessly blends enjoyment with accessibility, specifically tailored to meet the needs of children with diverse abilities including those who are neurodiverse and have varying musical abilities. The study's primary objective is to provide support to children who encounter challenges in learning traditional musical instruments or who have sensory processing issues and learn their experience of using this tool. Additionally, the research explores the potential role of music therapy in this context, with a focus on how the designed tool can serve as an ideal platform for fostering creativity and self-regulation among children. Qualitative research methods, namely participatory design and cooperative inquiry, were employed to develop and refine different aspects of the music-making tool iteratively. Active involvement and feedback from the primary participants, comprising children with diverse abilities and a music therapist, played a central role throughout the tool's development process. The findings indicate that children responded positively to the technology, revealing diverse applications in music education, therapy, and play. Furthermore, this study identified valuable opportunities for immediate improvements in the robot's design to enhance its overall usability and effectiveness in catering to the needs of its users. The collaborative design approach and the integration of music therapy perspectives demonstrate significant potential for advancing inclusive music education, play and therapeutic interventions for children with diverse abilities

Designing Sound for Social Robots: Advancing Professional Practice through Design Principles

Sound is one of the core modalities social robots can use to communicate with the humans around them in rich, engaging, and effective ways. While a robot's auditory communication happens predominantly through speech, a growing body of work demonstrates the various ways non-verbal robot sound can affect humans, and researchers have begun to formulate design recommendations that encourage using the medium to its full potential. However, formal strategies for successful robot sound design have so far not emerged, current frameworks and principles are largely untested and no effort has been made to survey creative robot sound design practice. In this dissertation, I combine creative practice, expert interviews, and human-robot interaction studies to advance our understanding of how designers can best ideate, create, and implement robot sound. In a first step, I map out a design space that combines established sound design frameworks with insights from interviews with robot sound design experts. I then systematically traverse this space across three robot sound design explorations, investigating (i) the effect of artificial movement sound on how robots are perceived, (ii) the benefits of applying compositional theory to robot sound design, and (iii) the role and potential of spatially distributed robot sound. Finally, I implement the designs from prior chapters into humanoid robot Diamandini, and deploy it as a case study. Based on a synthesis of the data collection and design practice conducted across the thesis, I argue that the creation of robot sound is best guided by four design perspectives: fiction (sound as a means to convey a narrative), composition (sound as its own separate listening experience), plasticity (sound as something that can vary and adapt over time), and space (spatial distribution of sound as a separate communication channel). The conclusion of the thesis presents these four perspectives and proposes eleven design principles across them which are supported by detailed examples. This work contributes an extensive body of design principles, process models, and techniques providing researchers and designers with new tools to enrich the way robots communicate with humans

Contemporary Robotics

This book book is a collection of 18 chapters written by internationally recognized experts and well-known professionals of the field. Chapters contribute to diverse facets of contemporary robotics and autonomous systems. The volume is organized in four thematic parts according to the main subjects, regarding the recent advances in the contemporary robotics. The first thematic topics of the book are devoted to the theoretical issues. This includes development of algorithms for automatic trajectory generation using redudancy resolution scheme, intelligent algorithms for robotic grasping, modelling approach for reactive mode handling of flexible manufacturing and design of an advanced controller for robot manipulators. The second part of the book deals with different aspects of robot calibration and sensing. This includes a geometric and treshold calibration of a multiple robotic line-vision system, robot-based inline 2D/3D quality monitoring using picture-giving and laser triangulation, and a study on prospective polymer composite materials for flexible tactile sensors. The third part addresses issues of mobile robots and multi-agent systems, including SLAM of mobile robots based on fusion of odometry and visual data, configuration of a localization system by a team of mobile robots, development of generic real-time motion controller for differential mobile robots, control of fuel cells of mobile robots, modelling of omni-directional wheeled-based robots, building of hunter- hybrid tracking environment, as well as design of a cooperative control in distributed population-based multi-agent approach. The fourth part presents recent approaches and results in humanoid and bioinspirative robotics. It deals with design of adaptive control of anthropomorphic biped gait, building of dynamic-based simulation for humanoid robot walking, building controller for perceptual motor control dynamics of humans and biomimetic approach to control mechatronic structure using smart materials

New Challenges in HCI: Ambient Intelligence for Human Performance Improvement

Ambient Intelligence is new multidisciplinary paradigm that is going to change the relation between humans, technology and the environment they live in. This paradigm has its roots in the ideas Ubiquitous and Pervasive computing. In this vision, that nowadays is almost reality, technology becomes pervasive in everyday lives but, despite its increasing importance, it (should) becomes “invisible”, so deeply intertwined in our day-to-day activities to disappear into the fabric of our lives. The new environment should become “intelligent” and “smart”, able to actively and adaptively react to the presence, actions and needs of humans (not only users but complex human being), in order to support daily activities and improve the quality of life. Ambient Intelligence represents a trend able to profoundly affect every aspect of our life. It is not a problem regarding only technology but is about a new way to be “human”, to inhabit our environment, and to dialogue with technology. But what makes an environment smart and intelligent is the way it understands and reacts to changing conditions. As a well-designed tool can help us carry out our activities more quickly and easily, a poorly designed one could be an obstacle. Ambient Intelligence paradigm tends to change some human’s activities by automating certain task. However is not always simple to decide what automate and when and how much the user needs to have control. In this thesis we analyse the different levels composing the Ambient Intelligence paradigm, from its theoretical roots, through technology until the issues related the Human Factors and the Human Computer Interaction, to better understand how this paradigm is able to change the performance and the behaviour of the user. After a general analysis, we decided to focus on the problem of smart surveillance analysing how is possible to automate certain tasks through a context capture system, based on the fusion of different sources and inspired to the paradigm of Ambient Intelligence. Particularly we decide to investigate, from a Human Factors point of view, how different levels of automation (LOAs) may result in a change of user’s behaviour and performances. Moreover this investigation was aimed to find the criteria that may help to design a smart surveillance system. After the design of a general framework for fusion of different sensor in a real time locating system, an hybrid people tracking system, based on the combined use of RFID UWB and computer vision techniques was developed and tested to explore the possibilities of a smart context capture system. Taking this system as an example we developed 3 simulators of a smart surveillance system implementing 3 different LOAs: manual, low system assistance, high system assistance. We performed tests (using quali-quantitative measures) to see changes in performances, Situation Awareness and workload in relation to different LOAs. Based on the results obtained, is proposed a new interaction paradigm for control rooms based on the HCI concepts related to Ambient Intelligence paradigm and especially related to Ambient Display’s concept, highlighting its usability advantages in a control room scenario. The assessments made through test showed that if from a technological perspective is possible to achieve very high levels of automation, from a Human Factors point of view this doesn’t necessarily reflect in an improvement of human performances. The latter is rather related to a particular balance that is not fixed but changes according to specific context. Thus every Ambient Intelligence system may be designed in a human centric perspective considering that, sometimes less can be more and vice-versa