Brave New GES World:A Systematic Literature Review of Gestures and Referents in Gesture Elicitation Studies

How to determine highly effective and intuitive gesture sets for interactive systems tailored to end users’ preferences? A substantial body of knowledge is available on this topic, among which gesture elicitation studies stand out distinctively. In these studies, end users are invited to propose gestures for specific referents, which are the functions to control for an interactive system. The vast majority of gesture elicitation studies conclude with a consensus gesture set identified following a process of consensus or agreement analysis. However, the information about specific gesture sets determined for specific applications is scattered across a wide landscape of disconnected scientific publications, which poses challenges to researchers and practitioners to effectively harness this body of knowledge. To address this challenge, we conducted a systematic literature review and examined a corpus of N=267 studies encompassing a total of 187, 265 gestures elicited from 6, 659 participants for 4, 106 referents. To understand similarities in users’ gesture preferences within this extensive dataset, we analyzed a sample of 2, 304 gestures extracted from the studies identified in our literature review. Our approach consisted of (i) identifying the context of use represented by end users, devices, platforms, and gesture sensing technology, (ii) categorizing the referents, (iii) classifying the gestures elicited for those referents, and (iv) cataloging the gestures based on their representation and implementation modalities. Drawing from the findings of this review, we propose guidelines for conducting future end-user gesture elicitation studies

Human-computer interaction in ubiquitous computing environments

Purpose &ndash; The purpose of this paper is to explore characteristics of human-computer interaction when the human body and its movements become input for interaction and interface control in pervasive computing settings. Design/methodology/approach &ndash; The paper quantifies the performance of human movement based on Fitt\u27s Law and discusses some of the human factors and technical considerations that arise in trying to use human body movements as an input medium. Findings &ndash; The paper finds that new interaction technologies utilising human movements may provide more flexible, naturalistic interfaces and support the ubiquitous or pervasive computing paradigm. Practical implications &ndash; In pervasive computing environments the challenge is to create intuitive and user-friendly interfaces. Application domains that may utilize human body movements as input are surveyed here and the paper addresses issues such as culture, privacy, security and ethics raised by movement of a user\u27s body-based interaction styles. Originality/value &ndash; The paper describes the utilization of human body movements as input for interaction and interface control in pervasive computing settings. <br /

Virtual Pet Companion A digital console to enhance the Experience of Children with Cerebral Palsy

This research investigates the use of game style consoles as service technology for children with Cerebral Palsy, in order to help them develop their fine motor skills and thereby become more independent in interactions with family and caregivers. The game involves a virtual pet companion for a six-year-old child with Cerebral Palsy currently living in Toronto. It was designed specifically to cater to his interests and needs; however, this research more broadly seeks to explore the potentiality of video games for rehabilitation for children with Cerebral Palsy, taking into account the propensity and interest children often have for new technologies. Drawing from research on Cerebral Palsy, the psychology of play, existing service technologies for children with disabilities, pet therapy and gamification, my project provides insight into how new interactive technologies can afford children with Cerebral Palsy the opportunity to interact more easily with the physical world

Toddlers and Technology: An Examination of how the Digital Surround may be Related to Prototypic Vocabulary Development and Social Interactions during Play

This study sought to examine how the digital technology that surrounds young children may be related to prototypic vocabulary development and Social interactions during play. Twenty-six families in the Northwest Arkansas region with children between 15-36 months of age participated in the study. Thirteen children attended a campus preschool, six children attended a grant-funded local preschool, and seven children, all from the Northwest Arkansas area, were part of an earlier home-based study. The materials for the study included a developmental-technology use questionnaire and the MacArthur-Bates Communicative Development Inventories. Archival videotaped play sessions with the seven home-based children utilized a “Little People™ Apptivity™ Barnyard” play set and an iPad with a corresponding app to the barnyard set were used for a secondary analysis of Social interactions during play. Data was analyzed across education setting (campus, local, home) and by type and amount of technology reported to be used in the home. Results suggested that parental values reduce a child’s experience, if not their exposure, to technology use; that the digital surround of today’s world is expansive and not exclusive; that, perhaps, children from varying degrees of technological homes differ in communicative development; and that development may be dynamically changing in ways that differ from or are not currently reflected by normative measures

Designing a robot to evaluate group formations

Robots are making their way in environments inhabited by people. Whether in domestic or public crowded environments, robots should take into consideration social norms and behaviors in order to become a social robot. This dissertation focuses on the problem of how to develop a robotic platform in order to validate human-robot interaction experiences in realistic environments. More specifically, we are concerned with social interactions in human-robot groups in public scenarios, where a variety of people can converge. Our final goal is the develop of a social robot based on certain theories of group behavior and the use of space, known as spatial relationships. The intermediate goals are related with the design and development of the experiences in the wild: as minor changes as possible in the scenario, definition of social tasks, gradual development of a robotic platform as transparent as possible from the robotic side. Initially, this research introduces several preliminary studies of human-robot interaction (HRI) with the PAL Robotics’ REEM robot at the CosmoCaixa Science Museum in Barcelona. Based on certain theories about the use of space as a form of social communication or interaction, the task under study with the commercial robot is as a museum guide, both when the group was in motion (\ie when it was being guided) as well as a group in a static place. Moreover, a second HRI study with REEM robot accomplishing the task of a teacher's assistant was carried out to analyze the perception of the robot's social presence and identity. Likewise, the development of a robotic platform, known as MASHI, for the study of HRI is presented. Based on the service to be completed by the robot, improvements in the experimental robotic platform (structure, morphology, head, face, arms) were carried out in continuous cycles following the development of HRI experiences. This structure should be hold as simple as possible in order to make it `transparent' in the social HRI study. Next, the field study of human-robot social interaction with the MASHI robot with the role of exhibition guide in a cultural center is presented. Based on direct observation techniques, a study is made of the different spatial relationships that are generated when a robot interacts with a person or groups of people. Finally, a novel approach to represent the spatial relationships of HRI in a qualitative way is introduced for future experiences. In this concluding study, we analyze different spatial arrangements generated in a social scenario with a robot within the guide role. As a main conclusion, it can be stated that people follow social norms, in the form of spatial relationships, when interacting with a robot that provide a social service in a public space. Children, however, recurrently challenge these social norms, probably because they are constantly learning about the norms that regulate our coexistence. Spatial relationships are clearly reinforced when the role assigned to the robot is more explicit and understood by people. Spatial relationships can be affected by the characteristics of the environment, either by the available space or by the elements arranged in it, as well as by the number of people who inhabit it. Overall, this dissertation points out that the provided service, and its understanding from the user’s side, is more important that the robotic skills of the robotic platform in order to improve user experiences in public environments.Los robots se abren paso en entornos habitados por personas. Ya sea en entornos domésticos o públicos, los robots deben tener en cuenta ciertas normas y comportamientos sociales para convertirse en un robot social. Esta disertación se centra en el problema de cómo desarrollar una plataforma robótica para validar experiencias de interacción humano-robot en entornos realistas. Más específicamente, nos preocupamos por las interacciones sociales en grupos humano-robot en escenarios públicos, donde una gran variedad de personas puede converger. Nuestro objetivo final es el desarrollo de un robot social basado en ciertas teorías de comportamiento grupal y el uso del espacio, conocidas como relaciones espaciales. Los objetivos intermedios están relacionados con el diseño y desarrollo de las experiencias `en la naturaleza': cambios mínimos como sea posible en el escenario, definición de tareas sociales, desarrollo gradual de una plataforma robótica lo más transparente posible desde el lado robótico. Inicialmente, esta investigación presenta varios estudios preliminares de interacción humano-robot (HRI) con el robot REEM de PAL Robotics en el Museo de Ciencias CosmoCaixa de Barcelona. Basado en ciertas teorías sobre el uso del espacio como una forma de comunicación o interacción social, la tarea en este estudio con el robot comercial es como guía de museo, tanto cuando el grupo estaba en movimiento (es decir, cuando estaba siendo guiado) como cuando el grupo estaba en un lugar estático. Además, se llevó a cabo un segundo estudio de HRI con un robot REEM que realizaba la tarea de un asistente de profesor para analizar la percepción de la presencia e identidad social del robot. Asimismo, se presenta el desarrollo de una plataforma robótica, conocida como MASHI, para el estudio de la HRI. En función del servicio que debe completar el robot, las mejoras en la plataforma robótica experimental (estructura, morfología, cabeza, cara, brazos) se llevaron a cabo en ciclos continuos siguiendo el desarrollo de las experiencias de HRI. Esta estructura debe mantenerse lo más simple posible para que sea 'transparente' en el estudio de HRI social. A continuación, se presenta el estudio de campo de la interacción social humano-robot con el robot MASHI con el papel de guía de exposición en un centro cultural. Con base en técnicas de observación directa, se realiza un estudio de las diferentes relaciones espaciales que se generan cuando un robot interactúa con una persona o grupos de personas. Finalmente, se introduce un enfoque novedoso para representar las relaciones espaciales de la HRI de forma cualitativa para las experiencias futuras. En este estudio final, analizamos diferentes arreglos espaciales generados en un escenario social con un robot con el rol de guía. Como conclusión principal, se puede afirmar que las personas siguen normas sociales, en forma de relaciones espaciales, cuando interactúan con un robot que brinda un servicio social en un espacio público. Los niños, sin embargo, desafían recurrentemente estas normas sociales, probablemente porque están aprendiendo constantemente sobre las normas que regulan nuestra convivencia. Las relaciones espaciales se refuerzan claramente cuando el rol asignado al robot es más explícito y entendido por las personas. Las relaciones espaciales pueden verse afectadas por las características del entorno, ya sea por el espacio disponible o por los elementos dispuestos en él, así como por el número de personas que lo habitan. En general, esta disertación señala que el servicio prestado, y su comprensión del lado del usuario, es más importante que las habilidades robóticas de la plataforma robótica con el fin de mejorar las experiencias del usuario en entornos público

Designing a robot to evaluate group formations

Robots are making their way in environments inhabited by people. Whether in domestic or public crowded environments, robots should take into consideration social norms and behaviors in order to become a social robot. This dissertation focuses on the problem of how to develop a robotic platform in order to validate human-robot interaction experiences in realistic environments. More specifically, we are concerned with social interactions in human-robot groups in public scenarios, where a variety of people can converge. Our final goal is the develop of a social robot based on certain theories of group behavior and the use of space, known as spatial relationships. The intermediate goals are related with the design and development of the experiences in the wild: as minor changes as possible in the scenario, definition of social tasks, gradual development of a robotic platform as transparent as possible from the robotic side. Initially, this research introduces several preliminary studies of human-robot interaction (HRI) with the PAL Robotics’ REEM robot at the CosmoCaixa Science Museum in Barcelona. Based on certain theories about the use of space as a form of social communication or interaction, the task under study with the commercial robot is as a museum guide, both when the group was in motion (\ie when it was being guided) as well as a group in a static place. Moreover, a second HRI study with REEM robot accomplishing the task of a teacher's assistant was carried out to analyze the perception of the robot's social presence and identity. Likewise, the development of a robotic platform, known as MASHI, for the study of HRI is presented. Based on the service to be completed by the robot, improvements in the experimental robotic platform (structure, morphology, head, face, arms) were carried out in continuous cycles following the development of HRI experiences. This structure should be hold as simple as possible in order to make it `transparent' in the social HRI study. Next, the field study of human-robot social interaction with the MASHI robot with the role of exhibition guide in a cultural center is presented. Based on direct observation techniques, a study is made of the different spatial relationships that are generated when a robot interacts with a person or groups of people. Finally, a novel approach to represent the spatial relationships of HRI in a qualitative way is introduced for future experiences. In this concluding study, we analyze different spatial arrangements generated in a social scenario with a robot within the guide role. As a main conclusion, it can be stated that people follow social norms, in the form of spatial relationships, when interacting with a robot that provide a social service in a public space. Children, however, recurrently challenge these social norms, probably because they are constantly learning about the norms that regulate our coexistence. Spatial relationships are clearly reinforced when the role assigned to the robot is more explicit and understood by people. Spatial relationships can be affected by the characteristics of the environment, either by the available space or by the elements arranged in it, as well as by the number of people who inhabit it. Overall, this dissertation points out that the provided service, and its understanding from the user’s side, is more important that the robotic skills of the robotic platform in order to improve user experiences in public environments.Los robots se abren paso en entornos habitados por personas. Ya sea en entornos domésticos o públicos, los robots deben tener en cuenta ciertas normas y comportamientos sociales para convertirse en un robot social. Esta disertación se centra en el problema de cómo desarrollar una plataforma robótica para validar experiencias de interacción humano-robot en entornos realistas. Más específicamente, nos preocupamos por las interacciones sociales en grupos humano-robot en escenarios públicos, donde una gran variedad de personas puede converger. Nuestro objetivo final es el desarrollo de un robot social basado en ciertas teorías de comportamiento grupal y el uso del espacio, conocidas como relaciones espaciales. Los objetivos intermedios están relacionados con el diseño y desarrollo de las experiencias `en la naturaleza': cambios mínimos como sea posible en el escenario, definición de tareas sociales, desarrollo gradual de una plataforma robótica lo más transparente posible desde el lado robótico. Inicialmente, esta investigación presenta varios estudios preliminares de interacción humano-robot (HRI) con el robot REEM de PAL Robotics en el Museo de Ciencias CosmoCaixa de Barcelona. Basado en ciertas teorías sobre el uso del espacio como una forma de comunicación o interacción social, la tarea en este estudio con el robot comercial es como guía de museo, tanto cuando el grupo estaba en movimiento (es decir, cuando estaba siendo guiado) como cuando el grupo estaba en un lugar estático. Además, se llevó a cabo un segundo estudio de HRI con un robot REEM que realizaba la tarea de un asistente de profesor para analizar la percepción de la presencia e identidad social del robot. Asimismo, se presenta el desarrollo de una plataforma robótica, conocida como MASHI, para el estudio de la HRI. En función del servicio que debe completar el robot, las mejoras en la plataforma robótica experimental (estructura, morfología, cabeza, cara, brazos) se llevaron a cabo en ciclos continuos siguiendo el desarrollo de las experiencias de HRI. Esta estructura debe mantenerse lo más simple posible para que sea 'transparente' en el estudio de HRI social. A continuación, se presenta el estudio de campo de la interacción social humano-robot con el robot MASHI con el papel de guía de exposición en un centro cultural. Con base en técnicas de observación directa, se realiza un estudio de las diferentes relaciones espaciales que se generan cuando un robot interactúa con una persona o grupos de personas. Finalmente, se introduce un enfoque novedoso para representar las relaciones espaciales de la HRI de forma cualitativa para las experiencias futuras. En este estudio final, analizamos diferentes arreglos espaciales generados en un escenario social con un robot con el rol de guía. Como conclusión principal, se puede afirmar que las personas siguen normas sociales, en forma de relaciones espaciales, cuando interactúan con un robot que brinda un servicio social en un espacio público. Los niños, sin embargo, desafían recurrentemente estas normas sociales, probablemente porque están aprendiendo constantemente sobre las normas que regulan nuestra convivencia. Las relaciones espaciales se refuerzan claramente cuando el rol asignado al robot es más explícito y entendido por las personas. Las relaciones espaciales pueden verse afectadas por las características del entorno, ya sea por el espacio disponible o por los elementos dispuestos en él, así como por el número de personas que lo habitan. En general, esta disertación señala que el servicio prestado, y su comprensión del lado del usuario, es más importante que las habilidades robóticas de la plataforma robótica con el fin de mejorar las experiencias del usuario en entornos públicosPostprint (published version

Access to Eye-Gaze Control Technology for Children with Cerebral Palsy

Children with cerebral palsy (CP), whose disability may limit speech production and motor skills, are often considered good candidates for the use of eye-gaze technology to access communication, learning and play. At present, little is known about the skills needed to control this technology, which can make it difficult for clinicians to make decisions, or to manage expectations around progress. This is further complicated by the emergence of “teaching” software packages, claiming to improve basic skills such as cause and effect. Children with CP are known to be at a higher risk of vision disorders, including those related to functional vision – how a child functions in vision related activities. These skills (in particular fixation and gaze switching) are similar to those required to make use of eye-gaze technology, so are likely to impact on children’s performance. This thesis uses typically developing children to provide baseline information and to observe how they respond to tasks which were incrementally lowered in terms of cognitive demand. Over three rounds of experiments a pattern emerged that children aged 32 months were able to use it with only minimal instruction. The impact of teaching on performance was also investigated in this section of the study. A group of children with CP were recruited to investigate the most effective way of assessing functional vision skills in this group, with results indicating behavioural measures were most effective. A final study with children with CP used the activities above to look at the performance of this group on eye-gaze tasks. Results suggested good functional gaze control skills were related to better performance on a novel eye-gaze task. The findings suggest that some children may be at a “developmental advantage” if their functional vision and cognitive skills are more developed

Expressive language development in minimally verbal autistic children: exploring the role of speech production

Trajectories of expressive language development are highly heterogeneous in autism. I examine the hypothesis that co-morbid speech production difficulties may be a contributing factor for some minimally verbal autistic individuals. Chapters 1 and 2 provide an overview of language variation within autism, and existing intervention approaches for minimally verbal autistic children. These chapters situate this thesis within the existing literature. Chapter 3 describes a longitudinal study of expressive language in minimally verbal 3-5 year olds (n=27), with four assessment points over 12 months. Contrary to expectations, initial communicative intent, parent responsiveness and response to joint attention did not predict expressive language growth or outcome. Speech skills were significant predictors. Chapter 4 describes the design, development and feasibility testing of the BabbleBooster app, a novel, parent-meditated speech skills intervention, in which 19 families participated for 16 weeks. Acceptability feedback was positive but adherence was variable. I discuss how this could be improved in future iterations of the app and intervention protocol. Chapter 5 details how BabbleBooster’s efficacy was evaluated. For interventions with complex or rare populations, a randomized case series design is a useful alternative to an under-powered group trial. There was no evidence that BabbleBooster improved speech production scores, likely due to limited dosage. Future research using this study design could determine optimal treatment intensity and duration with an improved version of the app. Taken together, these studies underscore the contribution of speech production abilities to expressive language development in minimally verbal autistic individuals. I argue that this reflects an additional condition, and is not a consequence of core autism features. The intervention piloted here represents a first step towards developing a scalable tool for parents to support speech development in minimally verbal children, and illustrates the utility of randomized single case series for testing treatment effects in small, heterogeneous cohorts

MATHEMATISATION: SOCIAL PROCESS & DIDACTIC PRINCIPLE

The 69th CIEAEM conference was held from 15th to 19th July 2017 at Freie Universität Berlin, Germany. It successfully involved 100 participants from 20 countries all over the world. CIEAEM 69 was dedicated to Professor Christine Keitel, president of CIEAEM from 1997 to 2003, who tragically passed away one year before the conference. The programme of the conference started with a panel that revisited “Mathematics (Education) and Common Sense”, the theme of the 47th CIEAEM conference, which was held in Berlin in July 1995 and which was hosted by Christine. At the conference, researchers, teachers, educators, and students met to discuss, in a collaborative and inspiring environment, the most prominent problems, obstacles and resources in mathematics education; they also presented their latest research findings in the several conference activities: plenary and semi-plenary talks, two round tables, working groups, workshops, and poster presentations (forum of ideas). As in previous CIEAEM meetings, Working Groups constituted the beating heart of the conference, allowing the participants to fruitfully discuss in critical and constructive ways, in the true CIEAEM spirit, research studies and approaches from different perspectives on the conference theme: Mathematisation: social process &amp; didactic principle. There were four Working Groups: (A) Mathematisation as a didactic principle: mathematizing and modelling of everyday contexts; (B) Mathematisation as a didactic principle: representation and generalization within mathematics; (C) Interconnecting mathematisation as a social process and as a didactic principle; and (D) Mathematisation as a didactic principle: looking at teachers of mathematics. Each Working Group discussed nine papers, and addressed the conference theme from complementary viewpoints (see the Discussion Paper), under the guidance of the group animators. The conference schedule allowed time also to deepen the plenary talks in the dedicated “Meet the plenary speaker” sessions, and to engage participants in workshops, where actual dialogue between research and practice could be fostered. This volume contains the final versions of the 53 papers presented during the conference. We thank all the contributors and the participants to the conference, because they made it such a unique experience, in which we had the good fortune to take part. We are grateful to the International Programme Committee and the Local Organizing Committee that made possible the realization of the conference in every detail with great care. Particularly, we want to thank the Working Group animators, who organized each day the sessions in inclusive as well high-quality ways. A special thanks to all the people who contributed to the realization of the conference, and to Daria Fischer, who helped in editing this volume. As a result, the CIEAEM 69 Proceedings offer a wide overview on national and international studies on the conference theme Mathematisation: social process &amp; didactic principle. We hope that it can constitute an inspiring resource for the research community, for teachers, and for stakeholders in mathematics education. From this perspective, the possibility of free downloading offers to CIEAEM 69 participants, and also to interested people who could not take part in the Conference in Berlin, the possibility of developing a fruitful network of contacts that year after year is becoming richer and wider