Kinematic characteristics of motion in the mirror game

We present the analysis of data collected in the mirror game setting. In our set-up two players are asked to mirror each other movements (with or without a designated leader). First, we study kinematic characteristics of motion of individual players, and next we investigate how they are affected by interactions between the players. Results of the presented analysis will be used to inform the design of interactive virtual players with kinematics based on the similarity principle.Engineering and Physical Sciences Research CouncilEuropean Project AlterEgo FP7 ICT 2.9 - Cognitive Sciences and Robotic

Dynamic similarity promotes interpersonal coordination in joint-action

Human movement has been studied for decades and dynamic laws of motion that are common to all humans have been derived. Yet, every individual moves differently from everyone else (faster/slower, harder/smoother etc). We propose here an index of such variability, namely an individual motor signature (IMS) able to capture the subtle differences in the way each of us moves. We show that the IMS of a person is time-invariant and that it significantly differs from those of other individuals. This allows us to quantify the dynamic similarity, a measure of rapport between dynamics of different individuals' movements, and demonstrate that it facilitates coordination during interaction. We use our measure to confirm a key prediction of the theory of similarity that coordination between two individuals performing a joint-action task is higher if their motions share similar dynamic features. Furthermore, we use a virtual avatar driven by an interactive cognitive architecture based on feedback control theory to explore the effects of different kinematic features of the avatar motion on the coordination with human players

Development and preliminary evaluation of a novel low cost VR-based upper limb stroke rehabilitation platform using Wii technology.

Abstract Purpose: This paper proposes a novel system (using the Nintendo Wii remote) that offers customised, non-immersive, virtual reality-based, upper-limb stroke rehabilitation and reports on promising preliminary findings with stroke survivors. Method: The system novelty lies in the high accuracy of the full kinematic tracking of the upper limb movement in real-time, offering strong personal connection between the stroke survivor and a virtual character when executing therapist prescribed adjustable exercises/games. It allows the therapist to monitor patient performance and to individually calibrate the system in terms of range of movement, speed and duration. Results: The system was tested for acceptability with three stroke survivors with differing levels of disability. Participants reported an overwhelming connection with the system and avatar. A two-week, single case study with a long-term stroke survivor showed positive changes in all four outcome measures employed, with the participant reporting better wrist control and greater functional use. Activities, which were deemed too challenging or too easy were associated with lower scores of enjoyment/motivation, highlighting the need for activities to be individually calibrated. Conclusions: Given the preliminary findings, it would be beneficial to extend the case study in terms of duration and participants and to conduct an acceptability and feasibility study with community dwelling survivors. Implications for Rehabilitation Low-cost, off-the-shelf game sensors, such as the Nintendo Wii remote, are acceptable by stroke survivors as an add-on to upper limb stroke rehabilitation but have to be bespoked to provide high-fidelity and real-time kinematic tracking of the arm movement. Providing therapists with real-time and remote monitoring of the quality of the movement and not just the amount of practice, is imperative and most critical for getting a better understanding of each patient and administering the right amount and type of exercise. The ability to translate therapeutic arm movement into individually calibrated exercises and games, allows accommodation of the wide range of movement difficulties seen after stroke and the ability to adjust these activities (in terms of speed, range of movement and duration) will aid motivation and adherence - key issues in rehabilitation. With increasing pressures on resources and the move to more community-based rehabilitation, the proposed system has the potential for promoting the intensity of practice necessary for recovery in both community and acute settings.The National Health Service (NHS) London Regional Innovation Fund

Modeling Joint Improvisation between Human and Virtual Players in the Mirror Game

Joint improvisation is observed to emerge spontaneously among humans performing joint action tasks, and has been associated with high levels of movement synchrony and enhanced sense of social bonding. Exploring the underlying cognitive and neural mechanisms behind the emergence of joint improvisation is an open research challenge. This paper investigates the emergence of jointly improvised movements between two participants in the mirror game, a paradigmatic joint task example. A theoretical model based on observations and analysis of experimental data is proposed to capture the main features of their interaction. A set of experiments is carried out to test and validate the model ability to reproduce the experimental observations. Then, the model is used to drive a computer avatar able to improvise joint motion with a human participant in real time. Finally, a convergence analysis of the proposed model is carried out to confirm its ability to reproduce the emergence of joint movement between the participants

An interactive control architecture for interpersonal coordination in mirror game

In this work, an interactive control architecture based on velocity segments is developed to generate the human-like trajectories in the mirror game, a simple yet effective paradigm for studying interpersonal coordination, and the existence of velocity segments possessing a prescribed signature is theoretically guaranteed. Then an online control algorithm for the architecture is proposed to produce joint improvised motion with a human player or another virtual player while exhibiting some desired kinematic characteristics. Finally, the transition from solo motions to joint improvised motions is illuminated, and the proposed control architecture is validated by matching the experimental data

Simultaneous Robotic Manipulation and Functional Magnetic Resonance Imaging: Feasibility in Children with Autism Spectrum Disorders

An unanswered question concerning the neural basis of autism spectrum disorders (ASD) is how sensorimotor deficits in individuals with ASD are related to abnormalities of brain function. We previously described a robotic joystick and video game system that allows us to record functional magnetic resonance images (FMRI) while adult humans make goal- directed wrist motions. We anticipated several challenges in extending this approach to studying goal-directed behaviors in children with ASD and in typically developing (TYP) children. In particular we were concerned that children with autism may express increased levels of anxiety as compared to typically developing children due to the loud sounds and small enclosed space of the MRI scanner. We also were concerned that both groups of children might become restless during testing, leading to an unacceptable amount of head movement. Here we performed a pilot study evaluating the extent to which autistic and typically developing children exhibit anxiety during our experimental protocol as well as their ability to comply with task instructions. Our experimental controls were successful in minimizing group differences in drop-out due to anxiety. Kinematic performance and head motion also were similar across groups. Both groups of children engaged cortical regions (frontal, parietal, temporal, occipital) while making goal- directed movements. In addition, the ASD group exhibited task- related correlations in subcortical regions (cerebellum, thalamus), whereas correlations in the TYP group did not reach statistical significance in subcortical regions. Four distinct regions in frontal cortex showed a significant group difference such that TYP children exhibited positive correlations between the hemodynamic response and movement, whereas children with ASD exhibited negative correlations. These findings demonstrate feasibility of simultaneous application of robotic manipulation and functional imaging to study goal-directed motor behaviors in autistic and typically developing children. The findings also suggest the presence of marked changes in neural activation during a sensorimotor task requiring goal- directed movement

Inside the brain of an elite athlete: The neural processes that support high achievement in sports

Events like the World Championships in athletics and the Olympic Games raise the public profile of competitive sports. They may also leave us wondering what sets the competitors in these events apart from those of us who simply watch. Here we attempt to link neural and cognitive processes that have been found to be important for elite performance with computational and physiological theories inspired by much simpler laboratory tasks. In this way we hope to inspire neuroscientists to consider how their basic research might help to explain sporting skill at the highest levels of performance

"Sticky Hands": learning and generalization for cooperative physical interactions with a humanoid robot

"Sticky Hands" is a physical game for two people involving gentle contact with the hands. The aim is to develop relaxed and elegant motion together, achieve physical sensitivity-improving reactions, and experience an interaction at an intimate yet comfortable level for spiritual development and physical relaxation. We developed a control system for a humanoid robot allowing it to play Sticky Hands with a human partner. We present a real implementation including a physical system, robot control, and a motion learning algorithm based on a generalizable intelligent system capable itself of generalizing observed trajectories' translation, orientation, scale and velocity to new data, operating with scalable speed and storage efficiency bounds, and coping with contact trajectories that evolve over time. Our robot control is capable of physical cooperation in a force domain, using minimal sensor input. We analyze robot-human interaction and relate characteristics of our motion learning algorithm with recorded motion profiles. We discuss our results in the context of realistic motion generation and present a theoretical discussion of stylistic and affective motion generation based on, and motivating cross-disciplinary research in computer graphics, human motion production and motion perception