Haptic communication between partner dancers and swing as a finite state machine

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2005.This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.Vita.Includes bibliographical references (p. 129-138).To see two expert partners, one leading and the other following, swing dance together is to watch a remarkable two-agent communication and control system in action. Even blindfolded, the follower can decode the leader's moves from haptic cues. The leader composes the dance from the vocabulary of known moves so as to complement the music he is dancing to. Systematically addressing questions about partner dance communication is of scientific interest and could improve human-robotic interaction, and imitating the leader's choreographic skill is an engineering problem with applications beyond the dance domain. Swing dance choreography is a finite state machine, with moves that transition between a small number of poses. Two automated choreographers are presented. One uses an optimization and randomization scheme to compose dances by a sequence of shortest path problems, with edge lengths measuring the dissimilarity of dance moves to each bar of music. The other solves a two-player zero-sum game between the choreographer and a judge. Choosing moves at random from among moves that are good enough is rational under the game model.(cont.) Further, experiments presenting conflicting musical environments to two partners demonstrate that although musical expression clearly guides the leader's choice of moves, the follower need not hear the same music to properly decode the leader's signals. Dancers embody gentle interaction, in which each participant extends the capabilities of the other, and their cooperation is facilitated by a shared understanding of the motions to be performed. To demonstrate that followers use their understanding of the move vocabulary to interact better with their leaders, an experiment paired a haptic robot leader with human followers in a haptically cued dance to a swing music soundtrack. The subjects' performance differed significantly between instances when the subjects could determine which move was being led and instances when the subjects could not determine what the next move would be. Also, two-person teams that cooperated haptically to perform cyclical aiming tasks showed improvements in the Fitts' law or Schmidt's law speed-accuracy tradeoff consistent with a novel endpoint compromise hypothesis about haptic collaboration.by Sommer Elizabeth Gentry.Ph.D

Multi-Agent Systems

A multi-agent system (MAS) is a system composed of multiple interacting intelligent agents. Multi-agent systems can be used to solve problems which are difficult or impossible for an individual agent or monolithic system to solve. Agent systems are open and extensible systems that allow for the deployment of autonomous and proactive software components. Multi-agent systems have been brought up and used in several application domains

Advances in Human-Robot Interaction

Rapid advances in the field of robotics have made it possible to use robots not just in industrial automation but also in entertainment, rehabilitation, and home service. Since robots will likely affect many aspects of human existence, fundamental questions of human-robot interaction must be formulated and, if at all possible, resolved. Some of these questions are addressed in this collection of papers by leading HRI researchers

Multimodal Multisensor attention modelling

Introduction: Sustaining attention is one of the most important factors in determining successful outcomes and deep learning in students. Existing approaches to track student engagement involve periodic human observations that are subject to inter-rater reliability. Our solution uses real-time Multimodal Multisensor data labeled by objective performance outcomes to track the attention of students. Method: The study involves four students with a combined diagnosis of cerebral palsy and a learning disability who took part in a 3-month trial over 59 sessions. Multimodal Multisensor data were collected while they participated in a Continuous Performance Test (CPT). Eyegaze, electroencephalogram, body pose, and interaction data were used to create a model of student attention through objective labeling from the Continuous Performance Test outcomes. To achieve this, a type of continuous performance test is introduced, the Seek-X type. Nine features were extracted including High-Level handpicked Compound Features (HLCF). Using leave-one-out cross-validation, a series of different machine learning approaches were evaluated. Research questions: RQ1: Can we create a model of attention for PMLD/CP students using the CPT? RQ2: What are the main correlations found in the CPT outcomes and the Multimodal Multisensor data? Results: Overall, the random forest classification approach achieved the best classification results. Using random forest, 84.8% classification for attention and 65.4% accuracy for inattention were achieved. We compared these results to outcomes from different models: AdaBoost, decision tree, k-Nearest Neighbor, naïve Bayes, neural network, and support vector machine. We showed that using a multisensor approach achieved higher accuracy than using features from any reduced set of sensors. Incorporating person-specific data improved the classification outcome, compared to being participant neutral. We found that using HighLevel handpicked Compound Features (HLCF) can improve the classification accuracy in every sensor mode. Our approach is robust to both sensor fallout and occlusions. The single most important sensor feature to the classification of attention and inattention was shown to be eye-gaze. We have shown that we can accurately predict the level of attention of students with learning disabilities in a real-time approach that is not subject to inter-rater reliability, human observation, or reliant on a single mode of sensor input. In total, 2475 separate correlation tests were carried over 55 data points using Pearson’s correlation coefficient. Data points from the SDT, CPT outcomes measures, Multimodal Multisensor features, and participant characteristics were assessed longitudinally for cross-correlation significance. A strong positive correlation was found between participant ability to maintain sustained and selective attention in the CPT to their academic progress in school (d′), P < .01. Participants who showed more inhibition in tests had progressed further in their academic assessments P < .01. The Seek-X type CPT also showed specific physiological characteristics, including body movement range and eye-gaze that were significant in P scales such as ‘Reading’ and ‘Listening’ P < .05. We found that participant bias was overall liberal B″D < 0. Participants iii showed no significant bias change during the sessions, and we found no significant correlation between bias (B″D) and sensitivity (d′). Conclusion: An approach to labeling Multimodal Multisensor data to train machine-learning algorithms to track the attention of students with profound and multiple disabilities has been presented. We posit that this approach can overcome the variation in observer inter-rater reliability when using standardized scales in tracking the emotional expression of students with such profound disabilities. The accuracy of our approach increases with multiple modes of sensor input, and our method is robust to sensor occlusion and fall-out. Multiple sources of sensor input are provided, to accommodate a wide variety of users and their needs. Our model can reliably track the attention of students with profound disabilities, regardless of the sensors available. A system incorporating this model can help teachers design personalized interventions for a very heterogeneous group of students, where teachers cannot possibly attend to each of their individual needs. This approach could be used to identify those with the greatest learning challenges, to guarantee that all students are supported to reach their full potential. Keywords—Affective computing in education, affect detection, attention, continuous performance test, engagement, flow, HCI, interaction, learning disabilities, machine learning, multimodal, multisensor, physiological sensors, Signal Detection Theory, selective attention, sustained attention, student engagement

The frequency of falls in children judo training

Purpose: Falling techniques are inseparable part of youth judo training. Falling techniques are related to avoiding injuries exercises (Nauta et al., 2013). There is not good evidence about the ratio of falling during the training in children. Methods: 26 children (age 8.88±1.88) were video recorded on ten training sessions for further indirect observation and performance analysis. Results: Research protocol consisted from recording falls and falling techniques (Reguli et al., 2015) in warming up, combat games, falling techniques, throwing techniques and free fighting (randori) part of the training session. While children were taught almost exclusively forward slapping roll, backward slapping roll and sideward direct slapping fall, in other parts of training also other types of falling, as forward fall on knees, naturally occurred. Conclusions: Judo coaches should stress also on teaching unorthodox falls adding to standard judo curriculum (Koshida et al., 2014). Various falling games to teach children safe falling in different conditions should be incorporated into judo training. Further research to gain more data from groups of different age in various combat and non-combat sports is needed

Fear of crime and victimization among the elderly participating in the self-defence course

Purpose. Self-defence training could enhance seniors´ defensive skills and fitness. There is lack of evidence about fear and concerns of seniors participating in the self-defence course. Methods. 18 elderly persons (16 female, 1 male; age 66.2, SD=5.86) participated in the self-defence course lasting 8 training units (each unit 60 minutes). Standardized tool for fear of crime and victimization analysis previously used in Euro-Justis project in the Czech Republic (2011) was used in pretest and posttest. Results. We explored the highest fear of crime by participants in their residence area after dark (mean=2,77; median=3; SD=0,80), lower fear at the night in their homes (mean=2,29; median=2; SD=0,75) and in their residence area at the daytime (mean=2,00; median=2; SD=0,77) at the beginning of the course. We noticed certain decrease of fear of crime after the intervention. Participant were less afraid of crime in their residence area after dark (mean=2,38; median=2; SD=0,77), they felt lower fear of crime at the night in their homes (mean=2,00; median=2; SD=0,48) and in their residence area at the daytime (mean=1,82; median=2; SD=0,63). Conclusions. The approach to self-defence teaching for elderly should be focused not just on the motor development, but also on their emotional state, fear of crime, perception of dangerousness of diverse situations and total wellbeing. Fear of crime analysis can contribute to create tailor made structure of the self-defence course for specific groups of citizens

Mirror Affect: Interpersonal Spectatorship in Installation Art since the 1960s

This dissertation traces the genealogy of interpersonal spectatorship in contemporary installations that encourage viewers to affectively relate to one another by watching themselves seeing and acting individually or as a group. By incorporating reflective surfaces, live video feedback, or sensors in their works, contemporary artists around the world have been challenging what had come to be a binary relation between the beholder and the art object, thereby, heightening viewers' awareness of the social and spatial contexts of aesthetic experience. Starting with the 1960s there has been not only an increasingly sharp departure from the autonomy of the art object on the part of artists, but also a rejection of prevailing self-focused and private modes of art spectatorship on the part of viewers of art. Situated between theories of relational aesthetics and new media theories of interactivity, my dissertation examines the social, cultural, and technological factors that have contributed to the production of installations that act as affective interfaces between multiple viewers. I argue that contemporary artworks with mirroring properties have triggered a shift towards increasingly public and interpersonal forms of art spectatorship that are consonant with the emergence of new modes of perception and sociability shaped by enhanced surveillance, unavoidable multitasking, and online networking