A Self-Organizing Neural Model of Motor Equivalent Reaching and Tool Use by a Multijoint Arm

This paper describes a self-organizing neural model for eye-hand coordination. Called the DIRECT model, it embodies a solution of the classical motor equivalence problem. Motor equivalence computations allow humans and other animals to flexibly employ an arm with more degrees of freedom than the space in which it moves to carry out spatially defined tasks under conditions that may require novel joint configurations. During a motor babbling phase, the model endogenously generates movement commands that activate the correlated visual, spatial, and motor information that are used to learn its internal coordinate transformations. After learning occurs, the model is capable of controlling reaching movements of the arm to prescribed spatial targets using many different combinations of joints. When allowed visual feedback, the model can automatically perform, without additional learning, reaches with tools of variable lengths, with clamped joints, with distortions of visual input by a prism, and with unexpected perturbations. These compensatory computations occur within a single accurate reaching movement. No corrective movements are needed. Blind reaches using internal feedback have also been simulated. The model achieves its competence by transforming visual information about target position and end effector position in 3-D space into a body-centered spatial representation of the direction in 3-D space that the end effector must move to contact the target. The spatial direction vector is adaptively transformed into a motor direction vector, which represents the joint rotations that move the end effector in the desired spatial direction from the present arm configuration. Properties of the model are compared with psychophysical data on human reaching movements, neurophysiological data on the tuning curves of neurons in the monkey motor cortex, and alternative models of movement control.National Science Foundation (IRI 90-24877); Office of Naval Research (N00014-92-J-1309); Air Force Office of Scientific Research (F49620-92-J-0499); National Science Foundation (IRI 90-24877

Redundancy reduction in motor control

Research in machine learning and neuroscience has made remarkable progress by investigating statistical redundancy in representations of natural environments, but to date much of this work has focused on sensory information like images and sounds. This dissertation explores the notions of redundancy and efficiency in the motor domain, where several different forms of independence exist. The dissertation begins by discussing redundancy at a conceptual level and presents relevant background material. Next, three main branches of original research are described. The first branch consists of a novel control framework for integrating low-bandwidth sensory updates with model uncertainty and action selection for navigating complex, multi-task environments. The second branch of research applies existing machine learning techniques to movement information and explores the mismatch between these methods for extracting independent components and the forms of redundancy that exist in the motor domain. The third branch of work analyzes full-body, goal-directed reaching movements gathered in a novel laboratory experiment, using explicitly measured information about the goal of each movement to uncover patterns in the movement dynamics. Each branch of research explores redundancy reduction in movement from a different perspective, building up a sort of catalog of the types of information present in movements. Redundancy is discussed throughout as an an important aspect of movement in the natural world. The dissertation concludes by summarizing the contributions of these three branches of work, and discussing promising areas for future work spurred by these investigations. More detailed models of voluntary movements hold promise not only for better treatments, improved prosthetics, smoother animations, and more fluid robots, but also as an avenue for scientific insight into the very foundations of cognition.Computer Science

Effectiveness of an automatic tracking software in underwater motion analysis

Tracking of markers placed on anatomical landmarks is a common practice in sports science to perform the kinematic analysis that interests both athletes and coaches. Although different software programs have been developed to automatically track markers and/or features, none of them was specifically designed to analyze underwater motion. Hence, this study aimed to evaluate the effectiveness of a software developed for automatic tracking of underwater movements (DVP), based on the Kanade-Lucas-Tomasi feature tracker. Twenty-one video recordings of different aquatic exercises (n = 2940 markers' positions) were manually tracked to determine the markers' center coordinates. Then, the videos were automatically tracked using DVP and a commercially available software (COM). Since tracking techniques may produce false targets, an operator was instructed to stop the automatic procedure and to correct the position of the cursor when the distance between the calculated marker's coordinate and the reference one was higher than 4 pixels. The proportion of manual interventions required by the software was used as a measure of the degree of automation. Overall, manual interventions were 10.4% lower for DVP (7.4%) than for COM (17.8%). Moreover, when examining the different exercise modes separately, the percentage of manual interventions was 5.6% to 29.3% lower for DVP than for COM. Similar results were observed when analyzing the type of marker rather than the type of exercise, with 9.9% less manual interventions for DVP than for COM. In conclusion, based on these results, the developed automatic tracking software presented can be used as a valid and useful tool for underwater motion analysis. Key PointsThe availability of effective software for automatic tracking would represent a significant advance for the practical use of kinematic analysis in swimming and other aquatic sports.An important feature of automatic tracking software is to require limited human interventions and supervision, thus allowing short processing time.When tracking underwater movements, the degree of automation of the tracking procedure is influenced by the capability of the algorithm to overcome difficulties linked to the small target size, the low image quality and the presence of background clutters.The newly developed feature-tracking algorithm has shown a good automatic tracking effectiveness in underwater motion analysis with significantly smaller percentage of required manual interventions when compared to a commercial software

Learning by imitation with the STIFF-FLOP surgical robot: a biomimetic approach inspired by octopus movements

Transferring skills from a biological organism to a hyper-redundant system is a challenging task, especially when the two agents have very different structure/embodiment and evolve in different environments. In this article, we propose to address this problem by designing motion primitives in the form of probabilistic dynamical systems. We take inspiration from invertebrate systems in nature to seek for versatile representations of motion/behavior primitives in continuum robots. We take the perspective that the incredibly varied skills achieved by the octopus can guide roboticists toward the design of robust motor skill encoding schemes and present our ongoing work that aims at combining statistical machine learning, dynamical systems, and stochastic optimization to study the problem of transferring movement patterns from an octopus arm to a flexible surgical robot (STIFF-FLOP) composed of two modules with constant curvatures. The approach is tested in simulation by imitation and self-refinement of an octopus reaching motion

A machine learning approach for clinical gait analysis and classification of polymyalgia rheumatica using myoelectric sensors

This thesis was submitted for the award of Doctor of Philosophy and was awarded by Brunel University LondonThe study focuses on Polymyalgia Rheumatica (PMR), an autoimmune musculoskeletal disease primarily affecting the shoulder blade and hip muscles in older adults, particularly women aged 50 and above. The research aims to address two main challenges: the need for more clarity on the disease's pathophysiology and the challenge of identifying disease severity in patients. The study introduces a novel approach involving movement assessment, by designing a low-cost MyoTracker system, and using electromyography (EMG) features to understand the impact on patients' hip muscles. A clinical trial was conducted at Komfo Anokye Teaching Hospital in Ghana, where the study employed a qualitative research approach to monitor movement patterns. Participants were tasked to perform exercises comprising of gait, knee lifting, and knee extension with sensors attached to the hip muscles. This research unfolds in three iterations, the first investigation involved hip muscular imbalances where the significant difference between patients and healthy controls in the maximum voluntary contraction (MVC) values was recorded. The bilateral difference computed between the left and right hip in patients exhibited 15% MVC on average compared to the healthy control group's 6%, indicating substantial hip muscular imbalances. The second iteration involved a movement assessment to identify specific movement patterns in patients. Support Vector Machine (SVM) achieves 85% accuracy for gait exercises, while Decision Tree (DT) performs less efficiently at 70%. SVM also excels in knee lifting exercises (70% accuracy), outperforming DT (60%). Based on hip muscle activation, patients' movement patterns significantly differ from healthy controls. In the third iteration, deep learning techniques, specifically RNN-LSTM and Vision Transformer (ViT), classify PMR disease severity based on EMG features. The study's results carry significant clinical implications with the evidence of hip muscular imbalances aiding in designing tailored rehabilitation protocols. Importantly, this study uses a cost-effective method for determining disease severity, enabling predictions about patients with severe PMR conditions. The key contribution of this thesis is the identification of patients’ specific movement patterns and the determination of PMR severity among patients. Other contributions are the detection of hip muscular imbalance in patients and the design of rehabilitation protocols to address hip muscular imbalances and improve patients' range of motion, enhancing overall well-being. In conclusion, this comprehensive study leverages innovative approaches, from a MyoTracker system for movement assessment to deep learning models, to unravel the complexities of PMR disease. The collaboration with medical experts emphasises the potential real-world impact of this research in enhancing the treatment and recovery processes for individuals.Ghana Scholarship Secretaria