Visual, Motor and Attentional Influences on Proprioceptive Contributions to Perception of Hand Path Rectilinearity during Reaching

We examined how proprioceptive contributions to perception of hand path straightness are influenced by visual, motor and attentional sources of performance variability during horizontal planar reaching. Subjects held the handle of a robot that constrained goal-directed movements of the hand to the paths of controlled curvature. Subjects attempted to detect the presence of hand path curvature during both active (subject driven) and passive (robot driven) movements that either required active muscle force production or not. Subjects were less able to discriminate curved from straight paths when actively reaching for a target versus when the robot moved their hand through the same curved paths. This effect was especially evident during robot-driven movements requiring concurrent activation of lengthening but not shortening muscles. Subjects were less likely to report curvature and were more variable in reporting when movements appeared straight in a novel “visual channel” condition previously shown to block adaptive updating of motor commands in response to deviations from a straight-line hand path. Similarly, compromised performance was obtained when subjects simultaneously performed a distracting secondary task (key pressing with the contralateral hand). The effects compounded when these last two treatments were combined. It is concluded that environmental, intrinsic and attentional factors all impact the ability to detect deviations from a rectilinear hand path during goal-directed movement by decreasing proprioceptive contributions to limb state estimation. In contrast, response variability increased only in experimental conditions thought to impose additional attentional demands on the observer. Implications of these results for perception and other sensorimotor behaviors are discussed

Inter-Joint Coordination Deficits Revealed in the Decomposition of Endpoint Jerk During Goal-Directed Arm Movement After Stroke

It is well documented that neurological deficits after stroke can disrupt motor control processes that affect the smoothness of reaching movements. The smoothness of hand trajectories during multi-joint reaching depends on shoulder and elbow joint angular velocities and their successive derivatives as well as on the instantaneous arm configuration and its rate of change. Right-handed survivors of unilateral hemiparetic stroke and neurologically-intact control participants held the handle of a two-joint robot and made horizontal planar reaching movements. We decomposed endpoint jerk into components related to shoulder and elbow joint angular velocity, acceleration, and jerk. We observed an abnormal decomposition pattern in the most severely impaired stroke survivors consistent with deficits of inter-joint coordination. We then used numerical simulations of reaching movements to test whether the specific pattern of inter-joint coordination deficits observed experimentally could be explained by either a general increase in motor noise related to weakness or by an impaired ability to compensate for multi-joint interaction torque. Simulation results suggest that observed deficits in movement smoothness after stroke more likely reflect an impaired ability to compensate for multi-joint interaction torques rather than the mere presence of elevated motor noise

Spatial distribution of HD-EMG improves identification of task and force in patients with incomplete spinal cord injury

Background: Recent studies show that spatial distribution of High Density surface EMG maps (HD-EMG) improves the identification of tasks and their corresponding contraction levels. However, in patients with incomplete spinal cord injury (iSCI), some nerves that control muscles are damaged, leaving some muscle parts without an innervation. Therefore, HD-EMG maps in patients with iSCI are affected by the injury and they can be different for every patient. The objective of this study is to investigate the spatial distribution of intensity in HD-EMG recordings to distinguish co-activation patterns for different tasks and effort levels in patients with iSCI. These patterns are evaluated to be used for extraction of motion intention.; Method: HD-EMG was recorded in patients during four isometric tasks of the forearm at three different effort levels. A linear discriminant classifier based on intensity and spatial features of HD-EMG maps of five upper-limb muscles was used to identify the attempted tasks. Task and force identification were evaluated for each patient individually, and the reliability of the identification was tested with respect to muscle fatigue and time interval between training and identification. Results: Three feature sets were analyzed in the identification: 1) intensity of the HD-EMG map, 2) intensity and center of gravity of HD-EMG maps and 3) intensity of a single differential EMG channel (gold standard).; Results show that the combination of intensity and spatial features in classification identifies tasks and effort levels properly (Acc = 98.8 %; S = 92.5 %; P = 93.2 %; SP = 99.4 %) and outperforms significantly the other two feature sets (p < 0.05).; Conclusion: In spite of the limited motor functionality, a specific co-activation pattern for each patient exists for both intensity, and spatial distribution of myoelectric activity. The spatial distribution is less sensitive than intensity to myoelectric changes that occur due to fatigue, and other time-dependent influences.Peer ReviewedPostprint (published version

A Pilot Study of Individual Muscle Force Prediction during Elbow Flexion and Extension in the Neurorehabilitation Field

This paper proposes a neuromusculoskeletal (NMS) model to predict individual muscle force during elbow flexion and extension. Four male subjects were asked to do voluntary elbow flexion and extension. An inertial sensor and surface electromyography (sEMG) sensors were attached to subject's forearm. Joint angle calculated by fusion of acceleration and angular rate using an extended Kalman filter (EKF) and muscle activations obtained from the sEMG signals were taken as the inputs of the proposed NMS model to determine individual muscle force. The result shows that our NMS model can predict individual muscle force accurately, with the ability to reflect subject-specific joint dynamics and neural control solutions. Our method incorporates sEMG and motion data, making it possible to get a deeper understanding of neurological, physiological, and anatomical characteristics of human dynamic movement. We demonstrate the potential of the proposed NMS model for evaluating the function of upper limb movements in the field of neurorehabilitation

Development of Digital Control Systems for Wearable Mechatronic Devices: Applications in Musculoskeletal Rehabilitation of the Upper Limb

The potential for wearable mechatronic systems to assist with musculoskeletal rehabilitation of the upper limb has grown with the technology. One limiting factor to realizing the benefits of these devices as motion therapy tools is within the development of digital control solutions. Despite many device prototypes and research efforts in the surrounding fields, there are a lack of requirements, details, assessments, and comparisons of control system characteristics, components, and architectures in the literature. Pairing this with the complexity of humans, the devices, and their interactions makes it a difficult task for control system developers to determine the best solution for their desired applications. The objective of this thesis is to develop, evaluate, and compare control system solutions that are capable of tracking motion through the control of wearable mechatronic devices. Due to the immaturity of these devices, the design, implementation, and testing processes for the control systems is not well established. In order to improve the efficiency and effectiveness of these processes, control system development and evaluation tools have been proposed. The Wearable Mechatronics-Enabled Control Software framework was developed to enable the implementation and comparison of different control software solutions presented in the literature. This framework reduces the amount of restructuring and modification required to complete these development tasks. An integration testing protocol was developed to isolate different aspects of the control systems during testing. A metric suite is proposed that expands on the existing literature and allows for the measurement of more control characteristics. Together, these tools were used ii ABSTRACT iii to developed, evaluate, and compare control system solutions. Using the developed control systems, a series of experiments were performed that involved tracking elbow motion using wearable mechatronic elbow devices. The accuracy and repeatability of the motion tracking performances, the adaptability of the control models, and the resource utilization of the digital systems were measured during these experiments. Statistical analysis was performed on these metrics to compare between experimental factors. The results of the tracking performances show some of the highest accuracies for elbow motion tracking with these devices. The statistical analysis revealed many factors that significantly impact the tracking performance, such as visual feedback, motion training, constrained motion, motion models, motion inputs, actuation components, and control outputs. Furthermore, the completion of the experiments resulted in three first-time studies, such as the comparison of muscle activation models and the quantification of control system task timing and data storage needs. The successes of these experiments highlight that accurate motion tracking, using biological signals of the user, is possible, but that many more efforts are needed to obtain control solutions that are robust to variations in the motion and characteristics of the user. To guide the future development of these control systems, a national survey was conducted of therapists regarding their patient data collection and analysis methods. From the results of this survey, a series of requirements for software systems, that allow therapists to interact with the control systems of these devices, were collected. Increasing the participation of therapists in the development processes of wearable assistive devices will help to produce better requirements for developers. This will allow the customization of control systems for specific therapies and patient characteristics, which will increase the benefit and adoption rate of these devices within musculoskeletal rehabilitation programs

Human Arm simulation for interactive constrained environment design

During the conceptual and prototype design stage of an industrial product, it is crucial to take assembly/disassembly and maintenance operations in advance. A well-designed system should enable relatively easy access of operating manipulators in the constrained environment and reduce musculoskeletal disorder risks for those manual handling operations. Trajectory planning comes up as an important issue for those assembly and maintenance operations under a constrained environment, since it determines the accessibility and the other ergonomics issues, such as muscle effort and its related fatigue. In this paper, a customer-oriented interactive approach is proposed to partially solve ergonomic related issues encountered during the design stage under a constrained system for the operator's convenience. Based on a single objective optimization method, trajectory planning for different operators could be generated automatically. Meanwhile, a motion capture based method assists the operator to guide the trajectory planning interactively when either a local minimum is encountered within the single objective optimization or the operator prefers guiding the virtual human manually. Besides that, a physical engine is integrated into this approach to provide physically realistic simulation in real time manner, so that collision free path and related dynamic information could be computed to determine further muscle fatigue and accessibility of a product designComment: International Journal on Interactive Design and Manufacturing (IJIDeM) (2012) 1-12. arXiv admin note: substantial text overlap with arXiv:1012.432

Musculoskeletal biomechanics of the shoulder in functional activities

The aim of this thesis is to determine shoulder function, during specific functional tasks and relate this to key parameters associated with pathology. The long-term aim is that the results of this work will influence rehabilitating the shoulder after surgery, improving clinical assessment or preventing specific upper limb injuries. For this, initial studies are required to design and build a simulator to quantify upper limb function during a set of functional tasks, and to quantify upper limb anthropometrics and combine these with a musculoskeletal model. The first part of the thesis focuses on anthropometry. Three different methods are studied for defining anthropometrics. First, a modified regression equation data set is introduced; this can be used for calculating body segment parameters considering a subject’s body mass, height, race, gender and age. The new regressions are compared to cadaveric data from the literature and found to improve the moment of inertia calculations. Two different geometrical modelling approaches are also introduced. This found that the geometrical solid shape representing the body segments can lead to noticeable differences in the body segment parameter results. Finally a laser scanner device is developed and applied to measuring these parameters. A mannequin’s upper arm is scanned and its volume found from the 3D image is compared to the actual one giving an average difference of 3.1%.; in addition, a standard-sized object was scanned allowing the validation of the scanning method for calculating body segment parameters. Finally, these different approaches are analysed and applied to a large set of subjects. This then provides key information for the second part of the thesis. The second part then focuses on the muscle forces in functional activities. Six functional daily activities are used in this study. In addition, a driving simulator is designed in order to quantify kinematics, kinetics and external forces during steering at different conditions and postures. At the same time, a computational musculoskeletal model of upper limb is used for measuring the muscle forces during the six functional tasks. The methodology used and the results of muscle forces in functional activities are presented and analysed; from the literature it is found that the failure strengths for repairs of supraspinatus are close to the muscle forces predicted in this study (224 ± 148 N). Finally, the results of this study could help to improve ergonomics for cars, such as driving wheel and car-sits, and inform return to activity recommendations after upper limb surgery to specific muscles. Keywords: Musculoskeletal biomechanics, upper limb, musculoskeletal modelling, anthropometry, body segment parameters, geometrical modelling, regression analysis, 3D laser surface scanner, functional activities, activities of daily living, driving simulator for steering, shoulder functionality on driving, joint forces, joint stability, muscle forces.Open Acces

Model-Based Estimation of Muscle Forces Exerted During Movements

Estimation of individual muscle forces during human movement can provide insight into neural control and tissue loading and can thus contribute to improved diagnosis and management of both neurological and orthopaedic conditions. Direct measurement of muscle forces is generally not feasible in a clinical setting, and non-invasive methods based on musculoskeletal modeling should therefore be considered. The current state of the art in clinical movement analysis is that resultant joint torques can be reliably estimated from motion data and external forces (inverse dynamic analysis). Static optimization methods to transform joint torques into estimates of individual muscle forces using musculoskeletal models, have been known for several decades. To date however, none of these methods have been successfully translated into clinical practice. The main obstacles are the lack of studies reporting successful validation of muscle force estimates, and the lack of user-friendly and efficient computer software. Recent advances in forward dynamics methods have opened up new opportunities. Forward dynamic optimization can be performed such that solutions are less dependent on measured kinematics and ground reaction forces, and are consistent with additional knowledge, such as the force–length–velocity–activation relationships of the muscles, and with observed electromyography signals during movement. We conclude that clinical applications of current research should be encouraged, supported by further development of computational tools and research into new algorithms for muscle force estimation and their validation

Evaluating Convolutional Neural Networks as a Method of EEG–EMG Fusion

Wearable robotic exoskeletons have emerged as an exciting new treatment tool for disorders affecting mobility; however, the human–machine interface, used by the patient for device control, requires further improvement before robotic assistance and rehabilitation can be widely adopted. One method, made possible through advancements in machine learning technology, is the use of bioelectrical signals, such as electroencephalography (EEG) and electromyography (EMG), to classify the user\u27s actions and intentions. While classification using these signals has been demonstrated for many relevant control tasks, such as motion intention detection and gesture recognition, challenges in decoding the bioelectrical signals have caused researchers to seek methods for improving the accuracy of these models. One such method is the use of EEG–EMG fusion, creating a classification model that decodes information from both EEG and EMG signals simultaneously to increase the amount of available information. So far, EEG–EMG fusion has been implemented using traditional machine learning methods that rely on manual feature extraction; however, new machine learning methods have emerged that can automatically extract relevant information from a dataset, which may prove beneficial during EEG–EMG fusion. In this study, Convolutional Neural Network (CNN) models were developed using combined EEG–EMG inputs to determine if they have potential as a method of EEG–EMG fusion that automatically extracts relevant information from both signals simultaneously. EEG and EMG signals were recorded during elbow flexion–extension and used to develop CNN models based on time–frequency (spectrogram) and time (filtered signal) domain image inputs. The results show a mean accuracy of 80.51 ± 8.07% for a three-class output (33.33% chance level), with an F-score of 80.74%, using time–frequency domain-based models. This work demonstrates the viability of CNNs as a new method of EEG–EMG fusion and evaluates different signal representations to determine the best implementation of a combined EEG–EMG CNN. It leverages modern machine learning methods to advance EEG–EMG fusion, which will ultimately lead to improvements in the usability of wearable robotic exoskeletons