Adaptivity through alternate freeing and freezing of degrees of freedom

Starting with fewer degrees of freedom has been shown to enable a more efficient exploration of the sensorimotor space. While not necessarily leading to optimal task performance, it results in a smaller number of directions of stability, which guide the coordination of additional degrees of freedom. The developmental release of additional degrees of freedom is then expected to allow for optimal task performance and more tolerance and adaptation to environmental interaction. In this paper, we test this assumption with a small-sized humanoid robot that learns to swing under environmental perturbations. Our experiments show that a progressive release of degrees of freedom alone is not sufficient to cope with environmental perturbations. Instead, alternate freezing and freeing of the degrees of freedom is required. Such finding is consistent with observations made during transitional periods in acquisition of skills in infants

An Optimal Control Model for Human Postural Regulation

Human upright stance is inherently unstable without a balance control scheme. Many biological behaviors are likely to be optimal with respect to some performance measure that involves energy. It is reasonable to believe that the human is (unconsciously) optimizing some performance measure as he regulates his balance posture. In experimental studies, a notable feature of postural control is a small constant sway. Specifically, there is greater sway than would occur with a linear feedback control without delay. A second notable feature of the human postural control is that the response to perturbations varies with their amplitude. Small disturbances produce motion only at the ankles with the hip and knee angles unchanging. Large perturbation evoke ankle and hip angular movement only. Still larger perturbation result in movement of all three joint angles. Inspired by these features, a biomechanical model resembling human balance control is proposed. The proposed model consists of three main components which are the body dynamics, a sensory estimator for delay and disturbance, and an optimal nonlinear control scheme providing minimum required corrective response. The human body is modeled as a multiple segment inverted pendulum in the sagittal plane and controlled by ankle and hip joint torques. A series of nonlinear optimal control problems are devised as mathematical models of human postural control during quiet standing. Several performance criteria that are high even orders in the body state or functions of these states (such as joint angle, Center of Pressure COP or Center of Mass COM) and quadratic in the joint control are utilized. This objective function provides a trade-off between the allowed deviations of the position from its nominal value and the neuromuscular energy required to correct for these deviations. Note that this performance measure reduces the actuator energy used by penalizing small postural errors very lightly. By using the Model Predictive Control (MPC) technique, the discrete-time approximation to each of these problems can be converted into a nonlinear programming problem and then solved by optimization methods. The solution gives a control scheme that agrees with the main features of the joint kinematics and its coordination process. The derived model is simulated for different scenarios to validate and test the performance of the proposed postural control architecture

Understanding motor control in humans to improve rehabilitation robots

Recent reviews highlighted the limited results of robotic rehabilitation and the low quality of evidences in this field. Despite the worldwide presence of several robotic infrastructures, there is still a lack of knowledge about the capabilities of robotic training effect on the neural control of movement. To fill this gap, a step back to motor neuroscience is needed: the understanding how the brain works in the generation of movements, how it adapts to changes and how it acquires new motor skills is fundamental. This is the rationale behind my PhD project and the contents of this thesis: all the studies included in fact examined changes in motor control due to different destabilizing conditions, ranging from external perturbations, to self-generated disturbances, to pathological conditions. Data on healthy and impaired adults have been collected and quantitative and objective information about kinematics, dynamics, performance and learning were obtained for the investigation of motor control and skill learning. Results on subjects with cervical dystonia show how important assessment is: possibly adequate treatments are missing because the physiological and pathological mechanisms underlying sensorimotor control are not routinely addressed in clinical practice. These results showed how sensory function is crucial for motor control. The relevance of proprioception in motor control and learning is evident also in a second study. This study, performed on healthy subjects, showed that stiffness control is associated with worse robustness to external perturbations and worse learning, which can be attributed to the lower sensitiveness while moving or co-activating. On the other hand, we found that the combination of higher reliance on proprioception with \u201cdisturbance training\u201d is able to lead to a better learning and better robustness. This is in line with recent findings showing that variability may facilitate learning and thus can be exploited for sensorimotor recovery. Based on these results, in a third study, we asked participants to use the more robust and efficient strategy in order to investigate the control policies used to reject disturbances. We found that control is non-linear and we associated this non-linearity with intermittent control. As the name says, intermittent control is characterized by open loop intervals, in which movements are not actively controlled. We exploited the intermittent control paradigm for other two modeling studies. In these studies we have shown how robust is this model, evaluating it in two complex situations, the coordination of two joints for postural balance and the coordination of two different balancing tasks. It is an intriguing issue, to be addressed in future studies, to consider how learning affects intermittency and how this can be exploited to enhance learning or recovery. The approach, that can exploit the results of this thesis, is the computational neurorehabilitation, which mathematically models the mechanisms underlying the rehabilitation process, with the aim of optimizing the individual treatment of patients. Integrating models of sensorimotor control during robotic neurorehabilitation, might lead to robots that are fully adaptable to the level of impairment of the patient and able to change their behavior accordingly to the patient\u2019s intention. This is one of the goals for the development of rehabilitation robotics and in particular of Wristbot, our robot for wrist rehabilitation: combining proper assessment and training protocols, based on motor control paradigms, will maximize robotic rehabilitation effects

Contributions of phase resetting and interlimb coordination to the adaptive control of hindlimb obstacle avoidance during locomotion in rats: a simulation study.

Obstacle avoidance during locomotion is essential for safe, smooth locomotion. Physiological studies regarding muscle synergy have shown that the combination of a small number of basic patterns produces the large part of muscle activities during locomotion and the addition of another pattern explains muscle activities for obstacle avoidance. Furthermore, central pattern generators in the spinal cord are thought to manage the timing to produce such basic patterns. In the present study, we investigated sensory-motor coordination for obstacle avoidance by the hindlimbs of the rat using a neuromusculoskeletal model. We constructed the musculoskeletal part of the model based on empirical anatomical data of the rat and the nervous system model based on the aforementioned physiological findings of central pattern generators and muscle synergy. To verify the dynamic simulation by the constructed model, we compared the simulation results with kinematic and electromyographic data measured during actual locomotion in rats. In addition, we incorporated sensory regulation models based on physiological evidence of phase resetting and interlimb coordination and examined their functional roles in stepping over an obstacle during locomotion. Our results show that the phase regulation based on interlimb coordination contributes to stepping over a higher obstacle and that based on phase resetting contributes to quick recovery after stepping over the obstacle. These results suggest the importance of sensory regulation in generating successful obstacle avoidance during locomotion

Postural Stability Variables for Dynamic Equilibrium

Source at http://www.jnsci.org/index.php.Experiments on the maintenance of postural stability on flat stationary support surfaces (quiet standing) that show only limited modes of the potential configurations of balance stability have dominated investigations of balance in quiet upright standing. Recent studies have revealed coordination properties of the whole body in maintaining dynamic postural stability with the application of moving platform paradigms. This paper examines properties of candidate collective variables for postural control within the dynamic systems framework. Evidence is discussed in this paper for: (i) self-organization properties of dynamic postural balance; (ii) enhanced variability and entropy prior to a phase transition between center of mass and center of pressure coupling; (iii) co-existence of intermittent postural control strategies that oscillate between periodic to chaotic transitions to maintain upright postural balance. These collective findings indicate postural attractor dynamic states progressively emerge to the changing task constraints of a moving platform revealing insights into the deterministic and stochastic properties of the multiple time scales of human postural behavior

Biomechanical and neurophysiological mechanisms related to postural control and efficiency of movement: A review

Understanding postural control requires considering various mechanisms underlying a person's ability to stand, to walk, and to interact with the environment safely and efficiently. The purpose of this paper is to summarize the functional relation between biomechanical and neurophysiological perspectives related to postural control in both standing and walking based on movement efficiency. Evidence related to the biomechanical and neurophysiological mechanisms is explored as well as the role of proprioceptive input on postural and movement control.info:eu-repo/semantics/publishedVersio

Identification of the contribution of the ankle and hip joints to multi-segmental balance control

Background\ud \ud Human stance involves multiple segments, including the legs and trunk, and requires coordinated actions of both. A novel method was developed that reliably estimates the contribution of the left and right leg (i.e., the ankle and hip joints) to the balance control of individual subjects. \ud \ud Methods\ud \ud The method was evaluated using simulations of a double-inverted pendulum model and the applicability was demonstrated with an experiment with seven healthy and one Parkinsonian participant. Model simulations indicated that two perturbations are required to reliably estimate the dynamics of a double-inverted pendulum balance control system. In the experiment, two multisine perturbation signals were applied simultaneously. The balance control system dynamic behaviour of the participants was estimated by Frequency Response Functions (FRFs), which relate ankle and hip joint angles to joint torques, using a multivariate closed-loop system identification technique. \ud \ud Results\ud \ud In the model simulations, the FRFs were reliably estimated, also in the presence of realistic levels of noise. In the experiment, the participants responded consistently to the perturbations, indicated by low noise-to-signal ratios of the ankle angle (0.24), hip angle (0.28), ankle torque (0.07), and hip torque (0.33). The developed method could detect that the Parkinson patient controlled his balance asymmetrically, that is, the right ankle and hip joints produced more corrective torque. \ud \ud Conclusion\ud \ud The method allows for a reliable estimate of the multisegmental feedback mechanism that stabilizes stance, of individual participants and of separate leg

Identifying Plant and Feedback in Human Posture Control

Human upright bipedal stance is a classic example of a control system consisting of a plant (i.e., the physical body and its actuators) and feedback (i.e., neural control) operating continuously in a closed loop. Determining the mechanistic basis of behavior in a closed loop control system is problematic because experimental manipulations or deficits due to trauma/injury influence all parts of the loop. Moreover, experimental techniques to open the loop (e.g., isolate the plant) are not viable because bipedal upright stance is not possible without feedback. The goal of the proposed study is to use a technique called closed loop system identification (CLSI) to investigate properties of the plant and feedback separately. Human upright stance has typically been approximated as a single-joint inverted pendulum, simplifying not only the control of a multi-linked body but also how sensory information is processed relative to body dynamics. However, a recent study showed that a single-joint approximation is inadequate. Trunk and leg segments are in-phase at frequencies below 1 Hz of body sway and simultaneously anti-phase at frequencies above 1 Hz during quiet stance. My dissertation studies have investigated the coordination between the leg and trunk segments and how sensory information is processed relative to that coordination. For example, additional sensory information provided through visual or light touch information led to a change of the in-phase pattern but not the anti-phase pattern, indicating that the anti-phase pattern may not be neurally controlled, but more a function of biomechanical properties of a two-segment body. In a subsequent study, I probed whether an internal model of the body processes visual information relative to a single or double-linked body. The results suggested a simple control strategy that processes sensory information relative to a single-joint internal model providing further evidence that the anti-phase pattern is biomechanically driven. These studies suggest potential mechanisms but cannot rule out alternative hypotheses because the source of behavioral changes can be attributed to properties of the plant and/or feedback. Here I adopt the CLSI approach using perturbations to probe separate processes within the postural control loop. Mechanical perturbations introduce sway as an input to the feedback, which in turn generates muscle activity as an output. Visual perturbations elicit muscle activity (a motor command) as an input to the plant, which then triggers body sway as an output. Mappings of muscle activity to body sway and body sway to muscle activity are used to identify properties of the plant and feedback, respectively. The results suggest that feedback compensates for the low-pass properties of the plant, except at higher frequencies. An optimal control model minimizing the amount of muscle activation suggests that the mechanism underlying this lack of compensation may be due to an uncompensated time delay. These techniques have the potential for more precise identification of the source of deficits in the postural control loop, leading to improved rehabilitation techniques and treatment of balance deficits, which currently contributes to 40% of nursing home admissions and costs the US health care system over $20B per year

Adaptive, fast walking in a biped robot under neuronal control and learning

Human walking is a dynamic, partly self-stabilizing process relying on the interaction of the biomechanical design with its neuronal control. The coordination of this process is a very difficult problem, and it has been suggested that it involves a hierarchy of levels, where the lower ones, e.g., interactions between muscles and the spinal cord, are largely autonomous, and where higher level control (e.g., cortical) arises only pointwise, as needed. This requires an architecture of several nested, sensori–motor loops where the walking process provides feedback signals to the walker's sensory systems, which can be used to coordinate its movements. To complicate the situation, at a maximal walking speed of more than four leg-lengths per second, the cycle period available to coordinate all these loops is rather short. In this study we present a planar biped robot, which uses the design principle of nested loops to combine the self-stabilizing properties of its biomechanical design with several levels of neuronal control. Specifically, we show how to adapt control by including online learning mechanisms based on simulated synaptic plasticity. This robot can walk with a high speed (> 3.0 leg length/s), self-adapting to minor disturbances, and reacting in a robust way to abruptly induced gait changes. At the same time, it can learn walking on different terrains, requiring only few learning experiences. This study shows that the tight coupling of physical with neuronal control, guided by sensory feedback from the walking pattern itself, combined with synaptic learning may be a way forward to better understand and solve coordination problems in other complex motor tasks