Estimation of Confidence in the Dialogue based on Eye Gaze and Head Movement Information

In human-robot interaction, human mental states in dialogue have attracted attention to human-friendly robots that support educational use. Although estimating mental states using speech and visual information has been conducted, it is still challenging to estimate mental states more precisely in the educational scene. In this paper, we proposed a method to estimate human mental state based on participants’ eye gaze and head movement information. Estimated participants’ confidence levels in their answers to the miscellaneous knowledge question as a human mental state. The participants’ non-verbal information, such as eye gaze and head movements during dialog with a robot, were collected in our experiment using an eye-tracking device. Then we collect participants’ confidence levels and analyze the relationship between human mental state and non-verbal information. Furthermore, we also applied a machine learning technique to estimate participants’ confidence levels from extracted features of gaze and head movement information. As a result, the performance of a machine learning technique using gaze and head movements information achieved over 80 % accuracy in estimating confidence levels. Our research provides insight into developing a human-friendly robot considering human mental states in the dialogue

Bringing Human Robot Interaction towards _Trust and Social Engineering

Robots started their journey in books and movies; nowadays, they are becoming an important part of our daily lives: from industrial robots, passing through entertainment robots, and reaching social robotics in fields like healthcare or education. An important aspect of social robotics is the human counterpart, therefore, there is an interaction between the humans and robots. Interactions among humans are often taken for granted as, since children, we learn how to interact with each other. In robotics, this interaction is still very immature, however, critical for a successful incorporation of robots in society. Human robot interaction (HRI) is the domain that works on improving these interactions. HRI encloses many aspects, and a significant one is trust. Trust is the assumption that somebody or something is good and reliable; and it is critical for a developed society. Therefore, in a society where robots can part, the trust they could generate will be essential for cohabitation. A downside of trust is overtrusting an entity; in other words, an insufficient alignment of the projected trust and the expectations of a morally correct behaviour. This effect could negatively influence and damage the interactions between agents. In the case of humans, it is usually exploited by scammers, conmen or social engineers - who take advantage of the people's overtrust in order to manipulate them into performing actions that may not be beneficial for the victims. This thesis tries to shed light on the development of trust towards robots, how this trust could become overtrust and be exploited by social engineering techniques. More precisely, the following experiments have been carried out: (i) Treasure Hunt, in which the robot followed a social engineering framework where it gathered personal information from the participants, improved the trust and rapport with them, and at the end, it exploited that trust manipulating participants into performing a risky action. (ii) Wicked Professor, in which a very human-like robot tried to enforce its authority to make participants obey socially inappropriate requests. Most of the participants realized that the requests were morally wrong, but eventually, they succumbed to the robot'sauthority while holding the robot as morally responsible. (iii) Detective iCub, in which it was evaluated whether the robot could be endowed with the ability to detect when the human partner was lying. Deception detection is an essential skill for social engineers and professionals in the domain of education, healthcare and security. The robot achieved 75% of accuracy in the lie detection. There were also found slight differences in the behaviour exhibited by the participants when interacting with a human or a robot interrogator. Lastly, this thesis approaches the topic of privacy - a fundamental human value. With the integration of robotics and technology in our society, privacy will be affected in ways we are not used. Robots have sensors able to record and gather all kind of data, and it is possible that this information is transmitted via internet without the knowledge of the user. This is an important aspect to consider since a violation in privacy can heavily impact the trust. Summarizing, this thesis shows that robots are able to establish and improve trust during an interaction, to take advantage of overtrust and to misuse it by applying different types of social engineering techniques, such as manipulation and authority. Moreover, robots can be enabled to pick up different human cues to detect deception, which can help both, social engineers and professionals in the human sector. Nevertheless, it is of the utmost importance to make roboticists, programmers, entrepreneurs, lawyers, psychologists, and other sectors involved, aware that social robots can be highly beneficial for humans, but they could also be exploited for malicious purposes

Designing a robot to evaluate group formations

Robots are making their way in environments inhabited by people. Whether in domestic or public crowded environments, robots should take into consideration social norms and behaviors in order to become a social robot. This dissertation focuses on the problem of how to develop a robotic platform in order to validate human-robot interaction experiences in realistic environments. More specifically, we are concerned with social interactions in human-robot groups in public scenarios, where a variety of people can converge. Our final goal is the develop of a social robot based on certain theories of group behavior and the use of space, known as spatial relationships. The intermediate goals are related with the design and development of the experiences in the wild: as minor changes as possible in the scenario, definition of social tasks, gradual development of a robotic platform as transparent as possible from the robotic side. Initially, this research introduces several preliminary studies of human-robot interaction (HRI) with the PAL Robotics’ REEM robot at the CosmoCaixa Science Museum in Barcelona. Based on certain theories about the use of space as a form of social communication or interaction, the task under study with the commercial robot is as a museum guide, both when the group was in motion (\ie when it was being guided) as well as a group in a static place. Moreover, a second HRI study with REEM robot accomplishing the task of a teacher's assistant was carried out to analyze the perception of the robot's social presence and identity. Likewise, the development of a robotic platform, known as MASHI, for the study of HRI is presented. Based on the service to be completed by the robot, improvements in the experimental robotic platform (structure, morphology, head, face, arms) were carried out in continuous cycles following the development of HRI experiences. This structure should be hold as simple as possible in order to make it `transparent' in the social HRI study. Next, the field study of human-robot social interaction with the MASHI robot with the role of exhibition guide in a cultural center is presented. Based on direct observation techniques, a study is made of the different spatial relationships that are generated when a robot interacts with a person or groups of people. Finally, a novel approach to represent the spatial relationships of HRI in a qualitative way is introduced for future experiences. In this concluding study, we analyze different spatial arrangements generated in a social scenario with a robot within the guide role. As a main conclusion, it can be stated that people follow social norms, in the form of spatial relationships, when interacting with a robot that provide a social service in a public space. Children, however, recurrently challenge these social norms, probably because they are constantly learning about the norms that regulate our coexistence. Spatial relationships are clearly reinforced when the role assigned to the robot is more explicit and understood by people. Spatial relationships can be affected by the characteristics of the environment, either by the available space or by the elements arranged in it, as well as by the number of people who inhabit it. Overall, this dissertation points out that the provided service, and its understanding from the user’s side, is more important that the robotic skills of the robotic platform in order to improve user experiences in public environments.Los robots se abren paso en entornos habitados por personas. Ya sea en entornos domésticos o públicos, los robots deben tener en cuenta ciertas normas y comportamientos sociales para convertirse en un robot social. Esta disertación se centra en el problema de cómo desarrollar una plataforma robótica para validar experiencias de interacción humano-robot en entornos realistas. Más específicamente, nos preocupamos por las interacciones sociales en grupos humano-robot en escenarios públicos, donde una gran variedad de personas puede converger. Nuestro objetivo final es el desarrollo de un robot social basado en ciertas teorías de comportamiento grupal y el uso del espacio, conocidas como relaciones espaciales. Los objetivos intermedios están relacionados con el diseño y desarrollo de las experiencias `en la naturaleza': cambios mínimos como sea posible en el escenario, definición de tareas sociales, desarrollo gradual de una plataforma robótica lo más transparente posible desde el lado robótico. Inicialmente, esta investigación presenta varios estudios preliminares de interacción humano-robot (HRI) con el robot REEM de PAL Robotics en el Museo de Ciencias CosmoCaixa de Barcelona. Basado en ciertas teorías sobre el uso del espacio como una forma de comunicación o interacción social, la tarea en este estudio con el robot comercial es como guía de museo, tanto cuando el grupo estaba en movimiento (es decir, cuando estaba siendo guiado) como cuando el grupo estaba en un lugar estático. Además, se llevó a cabo un segundo estudio de HRI con un robot REEM que realizaba la tarea de un asistente de profesor para analizar la percepción de la presencia e identidad social del robot. Asimismo, se presenta el desarrollo de una plataforma robótica, conocida como MASHI, para el estudio de la HRI. En función del servicio que debe completar el robot, las mejoras en la plataforma robótica experimental (estructura, morfología, cabeza, cara, brazos) se llevaron a cabo en ciclos continuos siguiendo el desarrollo de las experiencias de HRI. Esta estructura debe mantenerse lo más simple posible para que sea 'transparente' en el estudio de HRI social. A continuación, se presenta el estudio de campo de la interacción social humano-robot con el robot MASHI con el papel de guía de exposición en un centro cultural. Con base en técnicas de observación directa, se realiza un estudio de las diferentes relaciones espaciales que se generan cuando un robot interactúa con una persona o grupos de personas. Finalmente, se introduce un enfoque novedoso para representar las relaciones espaciales de la HRI de forma cualitativa para las experiencias futuras. En este estudio final, analizamos diferentes arreglos espaciales generados en un escenario social con un robot con el rol de guía. Como conclusión principal, se puede afirmar que las personas siguen normas sociales, en forma de relaciones espaciales, cuando interactúan con un robot que brinda un servicio social en un espacio público. Los niños, sin embargo, desafían recurrentemente estas normas sociales, probablemente porque están aprendiendo constantemente sobre las normas que regulan nuestra convivencia. Las relaciones espaciales se refuerzan claramente cuando el rol asignado al robot es más explícito y entendido por las personas. Las relaciones espaciales pueden verse afectadas por las características del entorno, ya sea por el espacio disponible o por los elementos dispuestos en él, así como por el número de personas que lo habitan. En general, esta disertación señala que el servicio prestado, y su comprensión del lado del usuario, es más importante que las habilidades robóticas de la plataforma robótica con el fin de mejorar las experiencias del usuario en entornos público

Designing a robot to evaluate group formations

Robots are making their way in environments inhabited by people. Whether in domestic or public crowded environments, robots should take into consideration social norms and behaviors in order to become a social robot. This dissertation focuses on the problem of how to develop a robotic platform in order to validate human-robot interaction experiences in realistic environments. More specifically, we are concerned with social interactions in human-robot groups in public scenarios, where a variety of people can converge. Our final goal is the develop of a social robot based on certain theories of group behavior and the use of space, known as spatial relationships. The intermediate goals are related with the design and development of the experiences in the wild: as minor changes as possible in the scenario, definition of social tasks, gradual development of a robotic platform as transparent as possible from the robotic side. Initially, this research introduces several preliminary studies of human-robot interaction (HRI) with the PAL Robotics’ REEM robot at the CosmoCaixa Science Museum in Barcelona. Based on certain theories about the use of space as a form of social communication or interaction, the task under study with the commercial robot is as a museum guide, both when the group was in motion (\ie when it was being guided) as well as a group in a static place. Moreover, a second HRI study with REEM robot accomplishing the task of a teacher's assistant was carried out to analyze the perception of the robot's social presence and identity. Likewise, the development of a robotic platform, known as MASHI, for the study of HRI is presented. Based on the service to be completed by the robot, improvements in the experimental robotic platform (structure, morphology, head, face, arms) were carried out in continuous cycles following the development of HRI experiences. This structure should be hold as simple as possible in order to make it `transparent' in the social HRI study. Next, the field study of human-robot social interaction with the MASHI robot with the role of exhibition guide in a cultural center is presented. Based on direct observation techniques, a study is made of the different spatial relationships that are generated when a robot interacts with a person or groups of people. Finally, a novel approach to represent the spatial relationships of HRI in a qualitative way is introduced for future experiences. In this concluding study, we analyze different spatial arrangements generated in a social scenario with a robot within the guide role. As a main conclusion, it can be stated that people follow social norms, in the form of spatial relationships, when interacting with a robot that provide a social service in a public space. Children, however, recurrently challenge these social norms, probably because they are constantly learning about the norms that regulate our coexistence. Spatial relationships are clearly reinforced when the role assigned to the robot is more explicit and understood by people. Spatial relationships can be affected by the characteristics of the environment, either by the available space or by the elements arranged in it, as well as by the number of people who inhabit it. Overall, this dissertation points out that the provided service, and its understanding from the user’s side, is more important that the robotic skills of the robotic platform in order to improve user experiences in public environments.Los robots se abren paso en entornos habitados por personas. Ya sea en entornos domésticos o públicos, los robots deben tener en cuenta ciertas normas y comportamientos sociales para convertirse en un robot social. Esta disertación se centra en el problema de cómo desarrollar una plataforma robótica para validar experiencias de interacción humano-robot en entornos realistas. Más específicamente, nos preocupamos por las interacciones sociales en grupos humano-robot en escenarios públicos, donde una gran variedad de personas puede converger. Nuestro objetivo final es el desarrollo de un robot social basado en ciertas teorías de comportamiento grupal y el uso del espacio, conocidas como relaciones espaciales. Los objetivos intermedios están relacionados con el diseño y desarrollo de las experiencias `en la naturaleza': cambios mínimos como sea posible en el escenario, definición de tareas sociales, desarrollo gradual de una plataforma robótica lo más transparente posible desde el lado robótico. Inicialmente, esta investigación presenta varios estudios preliminares de interacción humano-robot (HRI) con el robot REEM de PAL Robotics en el Museo de Ciencias CosmoCaixa de Barcelona. Basado en ciertas teorías sobre el uso del espacio como una forma de comunicación o interacción social, la tarea en este estudio con el robot comercial es como guía de museo, tanto cuando el grupo estaba en movimiento (es decir, cuando estaba siendo guiado) como cuando el grupo estaba en un lugar estático. Además, se llevó a cabo un segundo estudio de HRI con un robot REEM que realizaba la tarea de un asistente de profesor para analizar la percepción de la presencia e identidad social del robot. Asimismo, se presenta el desarrollo de una plataforma robótica, conocida como MASHI, para el estudio de la HRI. En función del servicio que debe completar el robot, las mejoras en la plataforma robótica experimental (estructura, morfología, cabeza, cara, brazos) se llevaron a cabo en ciclos continuos siguiendo el desarrollo de las experiencias de HRI. Esta estructura debe mantenerse lo más simple posible para que sea 'transparente' en el estudio de HRI social. A continuación, se presenta el estudio de campo de la interacción social humano-robot con el robot MASHI con el papel de guía de exposición en un centro cultural. Con base en técnicas de observación directa, se realiza un estudio de las diferentes relaciones espaciales que se generan cuando un robot interactúa con una persona o grupos de personas. Finalmente, se introduce un enfoque novedoso para representar las relaciones espaciales de la HRI de forma cualitativa para las experiencias futuras. En este estudio final, analizamos diferentes arreglos espaciales generados en un escenario social con un robot con el rol de guía. Como conclusión principal, se puede afirmar que las personas siguen normas sociales, en forma de relaciones espaciales, cuando interactúan con un robot que brinda un servicio social en un espacio público. Los niños, sin embargo, desafían recurrentemente estas normas sociales, probablemente porque están aprendiendo constantemente sobre las normas que regulan nuestra convivencia. Las relaciones espaciales se refuerzan claramente cuando el rol asignado al robot es más explícito y entendido por las personas. Las relaciones espaciales pueden verse afectadas por las características del entorno, ya sea por el espacio disponible o por los elementos dispuestos en él, así como por el número de personas que lo habitan. En general, esta disertación señala que el servicio prestado, y su comprensión del lado del usuario, es más importante que las habilidades robóticas de la plataforma robótica con el fin de mejorar las experiencias del usuario en entornos públicosPostprint (published version

Cooperative social robots: accompanying, guiding and interacting with people

The development of social robots capable of interacting with humans is one of the principal challenges in the field of robotics. More and more, robots are appearing in dynamic environments, like pedestrian walkways, universities, and hospitals; for this reason, their interaction with people must be conducted in a natural, gradual, and cordial manner, given that their function could be aid, or assist people. Therefore, navigation and interaction among humans in these environments are key skills that future generations of robots will require to have. Additionally, robots must also be able to cooperate with each other, if necessary. This dissertation examines these various challenges and describes the development of a set of techniques that allow robots to interact naturally with people in their environments, as they guide or accompany humans in urban zones. In this sense, the robots' movements are inspired by the persons' actions and gestures, determination of appropriate personal space, and the rules of common social convention. The first issue this thesis tackles is the development of an innovative robot-companion approach based on the newly founded Extended Social-Forces Model. We evaluate how people navigate and we formulate a set of virtual social forces to describe robot's behavior in terms of motion. Moreover, we introduce a robot companion analytical metric to effectively evaluate the system. This assessment is based on the notion of "proxemics" and ensures that the robot's navigation is socially acceptable by the person being accompanied, as well as to other pedestrians in the vicinity. Through a user study, we show that people interpret the robot's behavior according to human social norms. In addition, a new framework for guiding people in urban areas with a set of cooperative mobile robots is presented. The proposed approach offers several significant advantages, as compared with those outlined in prior studies. Firstly, it allows a group of people to be guided within both open and closed areas; secondly, it uses several cooperative robots; and thirdly, it includes features that enable the robots to keep people from leaving the crowd group, by approaching them in a friendly and safe manner. At the core of our approach, we propose a "Discrete Time Motion" model, which works to represent human and robot motions, to predict people's movements, so as to plan a route and provide the robots with concrete motion instructions. After, this thesis goes one step forward by developing the "Prediction and Anticipation Model". This model enables us to determine the optimal distribution of robots for preventing people from straying from the formation in specific areas of the map, and thus to facilitate the task of the robots. Furthermore, we locally optimize the work performed by robots and people alike, and thereby yielding a more human-friendly motion. Finally, an autonomous mobile robot capable of interacting to acquire human-assisted learning is introduced. First, we present different robot behaviors to approach a person and successfully engage with him/her. On the basis of this insight, we furnish our robot with a simple visual module for detecting human faces in real-time. We observe that people ascribe different personalities to the robot depending on its different behaviors. Once contact is initiated, people are given the opportunity to assist the robot to improve its visual skills. After this assisted learning stage, the robot is able to detect people by using the enhanced visual methods. Both contributions are extensively and rigorously tested in real environments. As a whole, this thesis demonstrates the need for robots that are able to operate acceptably around people; to behave in accordance with social norms while accompanying and guiding them. Furthermore, this work shows that cooperation amongst a group of robots optimizes the performance of the robots and people as well.El desenvolupament de robots socials capaços d'interactuar amb els éssers humans és un dels principals reptes en el camp de la robòtica. Actualment, els robots comencen a aparèixer en entorns dinàmics, com zones de vianants, universitats o hospitals; per aquest motiu, aquesta interacció ha de realitzar-se de manera natural, progressiva i cordial, ja que la seva utilització pot ser col.laboració, assistència o ajuda a les persones. Per tant, la navegació i la interacció amb els humans, en aquests entorns, són habilitats importants que les futures generacions de robots han de posseir, a més a més, els robots han de ser aptes de cooperar entre ells si fos requerit. El present treball estudia aquests reptes plantejats. S’han desenvolupat un conjunt de tècniques que permeten als robots interectuar de manera natural amb les persones i el seu entorn, mentre que guien o acompanyen als humans en zones urbanes. En aquest sentit, el moviment dels robots s’inspira en la manera com es mouen els humans en les convenvions socials, així com l’espai personal.El primer punt que aquesta tesi comprèn és el desenvolupament d’un nou mètode per a "robots-acompanyants" basat en el nou model estès de forces socials. S’ha evaluat com es mouen les persones i s’han formulat un conjunt de forces socials virtuals que descriuren el comportament del robot en termes de moviments. Aquesta evaluació es basa en el concepte de “proxemics” i assegura que la navegació del robot està socialment acceptada per la persona que està sent acompanyada i per la gent que es troba a l’entorn. Per mitjà d’un estudi social, mostrem que els humans interpreten el comportament del robot d’acord amb les normes socials. Així mateix, un nou sistema per a guiar a persones en zones urbanes amb un conjunt de robots mòbils que cooperen és presentat. El model proposat ofereix diferents avantatges comparat amb treballs anteriors. Primer, es permet a un grup de persones ser guiades en entorns oberts o amb alta densitat d’obstacles; segon, s’utilitzen diferents robots que cooperen; tercer, els robots són capaços de reincorporar a la formació les persones que s’han allunyat del grup anteriorment de manera segura. La base del nostre enfocament es basa en el nou model anomenat “Discrete Time Motion”, el qual representa els movimients dels humans i els robots, prediu el comportament de les persones, i planeja i proporciona una ruta als robots.Posteriorment, aquesta tesi va un pas més enllà amb el desenvolupament del model “Prediction and Anticipation Model”. Aquest model ens permet determinar la distribució òptima de robots per a prevenir que les persones s’allunyin del grup en zones especíıfiques del mapa, i per tant facilitar la tasca dels robots. A més, s’optimitza localment el treball realitzat pels robots i les persones, produint d’aquesta manera un moviment més amigable. Finalment, s’introdueix un robot autònom mòbil capaç d’interactuar amb les persones per realitzar un aprenentatge assistit. Incialment, es presenten diferents comportaments del robot per apropar-se a una persona i crear un víıncle amb ell/ella. Basant-nos en aquesta idea, un mòdul visual per a la detecció de cares humanes en temps real va ser proporcionat al robot. Hem observat que les persones atribueixen diferents personalitats al robot en funció dels seus diferents comportaments. Una vegada que el contacte va ser iniciat es va donar l’oportunitat als voluntaris d’ajudar al robot per a millorar les seves habilitats visuals. Després d’aquesta etapa d’aprenentatge assistit, el robot va ser capaç d’identificar a les persones mitjançant l'ús de mètodes visuals.En resum, aquesta tesi presenta i demostra la necessitat de robots que siguin capaços d’operar de forma acceptable amb la gent i que es comportin d’acord amb les normes socials mentres acompanyen o guien a persones. Per altra banda, aquest treball mostra que la coperació entre un grup de robots pot optimitzar el rendiment tant dels robots com dels humans

Creating robotic characters for long-term interaction

Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2012.Cataloged from PDF version of thesis.Includes bibliographical references (p. 177-181).Researchers studying ways in which humans and robots interact in social settings have a problem: they don't have a robot to use. There is a need for a socially expressive robot that can be deployed outside of a laboratory and support remote operation and data collection. This work aims to fill that need with DragonBot - a platform for social robotics specifically designed for long-term interactions. This thesis is divided into two parts. The first part describes the design and implementation of the hardware, software, and aesthetics of the DragonBot-based characters. Through the use of a mobile phone as the robot's primary computational device, we aim to drive down the hardware cost and increase the availability of robots "in the wild". The second part of this work takes an initial step towards evaluating DragonBot's effectiveness through interactions with children. We describe two different teleoperation interfaces for allowing a human to control DragonBot's behavior differing amounts of autonomy by the robot. A human subject study was conducted and these interfaces were compared through a sticker sharing task between the robot and children aged four to seven. Our results show that when a human operator is able to focus on the social portions of an interaction and the robot is given more autonomy, children treat the character more like a peer. This is indicated by the fact that more children re-engaged the robot with the higher level of autonomy when they were asked to split up stickers between the two participants.by Adam Setapen.S.M

Imaginative play with blended reality characters

Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2011.Cataloged from PDF version of thesis.Includes bibliographical references (p. 132-137).The idea and formative design of a blended reality character, a new class of character able to maintain visual and kinetic continuity between the fully physical and fully virtual; the technical underpinnings of its unique blended physical and digital play context and the evaluation of its impact on children's play are the contents of this thesis. A play test study with thirty-four children aged three and a half to seven was conducted using non-reactive, unobtrusive observational methods and a validated evaluation instrument. Our claim is that young children have accepted the idea, persistence and continuity of blended reality characters. Furthermore, we found that children are more deeply engaged with blended reality characters and are more fully immersed in blended reality play as co-protagonists in the experience, in comparison to interactions with strictly screen-based representations. As substantiated through the use of quantitative and qualitative analysis of drawings and verbal utterances, the study showed that young children produce longer, detailed and more imaginative descriptions of their experiences following blended reality play. The desire to continue engaging in blended reality play as expressed by children's verbal requests to revisit and extend their play time with the character positively affirms the potential for the development of an informal learning platform with sustained appeal to young children.by David Yann Robert.S.M

High Social Acceptance of Head Gaze Loosely Synchronized with Speech for Social Robots

This research demonstrates that robots can achieve socially acceptable interactions, using loosely synchronized head gaze-speech, without understanding the semantics of the dialog. Prior approaches used tightly synchronized head gaze-speech, which requires significant human effort and time to manually annotate synchronization events in advance, restricting interactive dialog, and requiring the operator to act as a puppeteer. This approach has two novel aspects. First, it uses affordances in the sentence structure, time delays, and typing to achieve autonomous synchronization of head gaze-speech. Second, it is implemented within a behavioral robotics framework derived from 32 previous implementations. The efficacy of the loosely synchronized approach was validated through a 93-participant 1 x 3 (loosely synchronized head gaze-speech, tightly synchronized head gaze-speech, no-head gazespeech) between-subjects experiment using the “Survivor Buddy” rescue robot in a victim management scenario. The results indicated that the social acceptance of loosely synchronized head gaze-speech is similar to tightly synchronized head gazespeech (manual annotation), and preferred to the no head gaze-speech case. These findings contribute to the study of social robotics in three ways. First, the research overall contributes to a fundamental understanding of the role of social head gaze in social acceptance, and the production of social head gaze. Second, it shows that autonomously generated head gaze-speech coordination is both possible and acceptable. Third, the behavioral robotics framework simplifies creation, analysis, and comparison of implementations

Cognitive-developmental learning for a humanoid robot : a caregiver's gift

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2004.Includes bibliographical references (p. 319-341).(cont.) which are then applied to developmentally acquire new object representations. The humanoid robot therefore sees the world through the caregiver's eyes. Building an artificial humanoid robot's brain, even at an infant's cognitive level, has been a long quest which still lies only in the realm of our imagination. Our efforts towards such a dimly imaginable task are developed according to two alternate and complementary views: cognitive and developmental.The goal of this work is to build a cognitive system for the humanoid robot, Cog, that exploits human caregivers as catalysts to perceive and learn about actions, objects, scenes, people, and the robot itself. This thesis addresses a broad spectrum of machine learning problems across several categorization levels. Actions by embodied agents are used to automatically generate training data for the learning mechanisms, so that the robot develops categorization autonomously. Taking inspiration from the human brain, a framework of algorithms and methodologies was implemented to emulate different cognitive capabilities on the humanoid robot Cog. This framework is effectively applied to a collection of AI, computer vision, and signal processing problems. Cognitive capabilities of the humanoid robot are developmentally created, starting from infant-like abilities for detecting, segmenting, and recognizing percepts over multiple sensing modalities. Human caregivers provide a helping hand for communicating such information to the robot. This is done by actions that create meaningful events (by changing the world in which the robot is situated) thus inducing the "compliant perception" of objects from these human-robot interactions. Self-exploration of the world extends the robot's knowledge concerning object properties. This thesis argues for enculturating humanoid robots using infant development as a metaphor for building a humanoid robot's cognitive abilities. A human caregiver redesigns a humanoid's brain by teaching the humanoid robot as she would teach a child, using children's learning aids such as books, drawing boards, or other cognitive artifacts. Multi-modal object properties are learned using these tools and inserted into several recognition schemes,by Artur Miguel Do Amaral Arsenio.Ph.D

Fluency and embodiment for robots acting with humans

Thesis (Ph. D.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2007.Includes bibliographical references (p. 225-234).This thesis is concerned with the notion of fluency in human-robot interaction (HRI), exploring cognitive mechanisms for robotic agents that would enable them to overcome the stop-and-go rigidity present in much of HRI to date. We define fluency as the ethereal yet manifest quality existent when two agents perform together at high level of coordination and adaptation, in particular when they are well-accustomed to the task and to each other. Based on mounting psychological and neurological evidence, we argue that one of the keys to this goal is the adaptation of an embodied approach to robot cognition. We show how central ideas from this psychological school are applicable to robot cognition and present a cognitive architecture making use of perceptual symbols, simulation, and perception-action networks. In addition, we demonstrate that anticipation of perceptual input, and in particular of the actions of others, are an important ingredient of fluent joint action. To that end, we show results from an experiment studying the effects of anticipatory action on fluency and teamwork, and use these results to suggest benchmark metrics for fluency. We also show the relationship between anticipatory action and a simulator approach to perception, through a comparative human subject study of an implemented cognitive architecture on the robot AUR, a robotic desk lamp, designed for this thesis. A result of this work is modeling the effect of practice on human-robot joint action, arguing that mechanisms that govern the passage of cognitive capabilities from a deliberate yet slower system to a faster, sub-intentional, and more rigid one, are crucial to fluent joint action in well-rehearsed ensembles. Theatrical acting theory serves as an inspiration for this work, as we argue that lessons from acting method can be applied to human-robot interaction.by Guy Hoffman.Ph.D