Understanding motor control in humans to improve rehabilitation robots

Recent reviews highlighted the limited results of robotic rehabilitation and the low quality of evidences in this field. Despite the worldwide presence of several robotic infrastructures, there is still a lack of knowledge about the capabilities of robotic training effect on the neural control of movement. To fill this gap, a step back to motor neuroscience is needed: the understanding how the brain works in the generation of movements, how it adapts to changes and how it acquires new motor skills is fundamental. This is the rationale behind my PhD project and the contents of this thesis: all the studies included in fact examined changes in motor control due to different destabilizing conditions, ranging from external perturbations, to self-generated disturbances, to pathological conditions. Data on healthy and impaired adults have been collected and quantitative and objective information about kinematics, dynamics, performance and learning were obtained for the investigation of motor control and skill learning. Results on subjects with cervical dystonia show how important assessment is: possibly adequate treatments are missing because the physiological and pathological mechanisms underlying sensorimotor control are not routinely addressed in clinical practice. These results showed how sensory function is crucial for motor control. The relevance of proprioception in motor control and learning is evident also in a second study. This study, performed on healthy subjects, showed that stiffness control is associated with worse robustness to external perturbations and worse learning, which can be attributed to the lower sensitiveness while moving or co-activating. On the other hand, we found that the combination of higher reliance on proprioception with \u201cdisturbance training\u201d is able to lead to a better learning and better robustness. This is in line with recent findings showing that variability may facilitate learning and thus can be exploited for sensorimotor recovery. Based on these results, in a third study, we asked participants to use the more robust and efficient strategy in order to investigate the control policies used to reject disturbances. We found that control is non-linear and we associated this non-linearity with intermittent control. As the name says, intermittent control is characterized by open loop intervals, in which movements are not actively controlled. We exploited the intermittent control paradigm for other two modeling studies. In these studies we have shown how robust is this model, evaluating it in two complex situations, the coordination of two joints for postural balance and the coordination of two different balancing tasks. It is an intriguing issue, to be addressed in future studies, to consider how learning affects intermittency and how this can be exploited to enhance learning or recovery. The approach, that can exploit the results of this thesis, is the computational neurorehabilitation, which mathematically models the mechanisms underlying the rehabilitation process, with the aim of optimizing the individual treatment of patients. Integrating models of sensorimotor control during robotic neurorehabilitation, might lead to robots that are fully adaptable to the level of impairment of the patient and able to change their behavior accordingly to the patient\u2019s intention. This is one of the goals for the development of rehabilitation robotics and in particular of Wristbot, our robot for wrist rehabilitation: combining proper assessment and training protocols, based on motor control paradigms, will maximize robotic rehabilitation effects

Towards Robust Bipedal Locomotion:From Simple Models To Full-Body Compliance

Thanks to better actuator technologies and control algorithms, humanoid robots to date can perform a wide range of locomotion activities outside lab environments. These robots face various control challenges like high dimensionality, contact switches during locomotion and a floating-base nature which makes them fall all the time. A rich set of sensory inputs and a high-bandwidth actuation are often needed to ensure fast and effective reactions to unforeseen conditions, e.g., terrain variations, external pushes, slippages, unknown payloads, etc. State of the art technologies today seem to provide such valuable hardware components. However, regarding software, there is plenty of room for improvement. Locomotion planning and control problems are often treated separately in conventional humanoid control algorithms. The control challenges mentioned above are probably the main reason for such separation. Here, planning refers to the process of finding consistent open-loop trajectories, which may take arbitrarily long computations off-line. Control, on the other hand, should be done very fast online to ensure stability. In this thesis, we want to link planning and control problems again and enable for online trajectory modification in a meaningful way. First, we propose a new way of describing robot geometries like molecules which breaks the complexity of conventional models. We use this technique and derive a planning algorithm that is fast enough to be used online for multi-contact motion planning. Similarly, we derive 3LP, a simplified linear three-mass model for bipedal walking, which offers orders of magnitude faster computations than full mechanical models. Next, we focus more on walking and use the 3LP model to formulate online control algorithms based on the foot-stepping strategy. The method is based on model predictive control, however, we also propose a faster controller with time-projection that demonstrates a close performance without numerical optimizations. We also deploy an efficient implementation of inverse dynamics together with advanced sensor fusion and actuator control algorithms to ensure a precise and compliant tracking of the simplified 3LP trajectories. Extensive simulations and hardware experiments on COMAN robot demonstrate effectiveness and strengths of our method. This thesis goes beyond humanoid walking applications. We further use the developed modeling tools to analyze and understand principles of human locomotion. Our 3LP model can describe the exchange of energy between human limbs in walking to some extent. We use this property to propose a metabolic-cost model of human walking which successfully describes trends in various conditions. The intrinsic power of the 3LP model to generate walking gaits in all these conditions makes it a handy solution for walking control and gait analysis, despite being yet a simplified model. To fill the reality gap, finally, we propose a kinematic conversion method that takes 3LP trajectories as input and generates more human-like postures. Using this method, the 3LP model, and the time-projecting controller, we introduce a graphical user interface in the end to simulate periodic and transient human-like walking conditions. We hope to use this combination in future to produce faster and more human-like walking gaits, possibly with more capable humanoid robots

Aerial Human-Comfortable Collision-free Navigation in Dense Environments

With current overuse of the road transportation system and planned increase in traffic, inno- vative solutions that overcome environmental and financial cost of the current system should be assessed. A promising idea is the use of the third dimension for personal transportation. Therefore, the European project myCopter, funded under the 7th framework, aimed at en- abling the technologies for Personal Aerial Transportation Systems as breakthrough in 21st century transportation systems. This project was the starting point of this thesis. When multiple vehicles share a common part of the sky, the biggest challenge is the man- agement of the risk of collision. While optimal collision-free navigation strategies have been proposed for autonomous robots, trajectories and accelerations for Personal Aerial Vehicles (PAVs) should also take into account human comfort for their passengers, which has rarely been the focus of these studies. Comfort of the trajectories is a key factor in order for this new transportation mean to be accepted and adopted by everyday users. Existing strategies used to maximize human-comfort of trajectories are based on path planning strategies, which compute beforehand the whole trajectory, implementing comfort as an optimization criteria. Personal Aerial Transportation Systems will have a high density of vehicles, where the time to react to potential threats might decrease to a few seconds only. This might be insufficient to compute a new trajectory each time using these path planning strategies. Therefore, in this thesis, a reactive decentralized strategy is proposed, maximizing the comfort of the trajectories for humans traveling in a Personal Aerial Vehicle. To prove the feasibility of collision avoidance strategies, it is not sufficient anymore to validate them only in simulation, but, in addition, real-time tests in a realistic outdoor environment should be performed. Nowadays, single drones can be effectively controlled by a single operator on the ground. The challenge relies instead on an efficient management of a whole swarm of drone. In this thesis, a framework to perform outdoor drone experiment was developed in order to validate the proposed collision avoidance strategy. On the one hand, an autopilot framework was developed, tailored for multi-drone experiments, allowing fast and easy deployment and maintenance of a swarm of drones. On the other hand, a ground control interface is proposed in order to monitor, control and maintain safety in a flight with a swarm of drones. Using the autopilot framework together with the ground control interface, the proposed collision avoidance strategy was validated using 10 quadrotors flying autonomously outdoor in a challenging scenario

Neuro-fuzzy modelling and control of robotic manipulators

The work reported in this thesis aims to design and develop a new neuro-fuzzy control system for robotic manipulators using Machine Learning Techniques, Fuzzy Logic Controllers, and Fuzzy Neural Networks. The main idea is to integrate these intelligent techniques to develop an adaptive position controller for robotic manipulators. This will finally lead to utilising one or two coordinated manipulators to perform upper-limb rehabilitation. The main target is to benefit from these intelligent techniques in a systematic way that leads to an efficient control and coordination system. The suggested control system possesses self-learning features so that it can maintain acceptable performance in the presence of uncertain loads. Simulation and modelling stages were performed using dynamical virtual reality programs to demonstrate the ideas of the control and coordination techniques. The first part of the thesis focuses on the development of neuro-fuzzy models that meet the above requirement of mimicking both kinematics and dynamics behaviour of the manipulator. For this purpose, an initial stage for data collection from the motion of the manipulator along random trajectories was performed. These data were then compacted with the help of inductive learning techniques into two sets of if-then rules that form approximation for both of the inverse kinematics and inverse dynamics of the manipulator. These rules were then used in fuzzy neural networks with differentiation characteristics to achieve online tuning of the network adjustable parameters. The second part of the thesis introduces the proposed adaptive neuro-fuzzy joint-based controller. To achieve this target, a feedback Fuzzy-Proportional-Integral-Derivative incremental controller was developed. This controller was then applied as a joint servo-controller for each robot link in addition to the main neuro-fuzzy feedforward controller used to compensate for the dynamics interactions between robot links. A feedback error learning scheme was applied to tune the feedforward neuro-fuzzy controller online using the error back-propagation algorithm. The third part of the thesis presents a neuro-fuzzy Cartesian internal model control system for robotic manipulators. The neuro-fuzzy inverse kinematics model of the manipulator was used in addition to the joint-based controller proposed and the forward mathematical model of the manipulator in an adaptive internal model controller structure. Feedback-error learning scheme was extended to tune both of the joint-based neuro-fuzzy controller and the neuro-fuzzy internal model controller online. The fourth part of the thesis suggests a simple fuzzy hysteresis coordination scheme for two position-controlled robot manipulators. The coordination scheme is based on maintaining certain kinematic relationships between the two manipulators using reference motion synchronisation without explicitly involving the hybrid position/force control or modifying the existing controller structure for either of the manipulators. The key to the success of the new method is to ensure that each manipulator is capable of tracking its own desired trajectory using its own position controller, while synchronizing its motion with the other manipulator motion so that the differential position error between the two manipulators is reduced to zero or kept within acceptable limits. A simplified test-bench emulating upper-limb rehabilitation was used to test the proposed coordination technique experimentally

Bio-Inspired Robotics

Modern robotic technologies have enabled robots to operate in a variety of unstructured and dynamically-changing environments, in addition to traditional structured environments. Robots have, thus, become an important element in our everyday lives. One key approach to develop such intelligent and autonomous robots is to draw inspiration from biological systems. Biological structure, mechanisms, and underlying principles have the potential to provide new ideas to support the improvement of conventional robotic designs and control. Such biological principles usually originate from animal or even plant models, for robots, which can sense, think, walk, swim, crawl, jump or even fly. Thus, it is believed that these bio-inspired methods are becoming increasingly important in the face of complex applications. Bio-inspired robotics is leading to the study of innovative structures and computing with sensory–motor coordination and learning to achieve intelligence, flexibility, stability, and adaptation for emergent robotic applications, such as manipulation, learning, and control. This Special Issue invites original papers of innovative ideas and concepts, new discoveries and improvements, and novel applications and business models relevant to the selected topics of ``Bio-Inspired Robotics''. Bio-Inspired Robotics is a broad topic and an ongoing expanding field. This Special Issue collates 30 papers that address some of the important challenges and opportunities in this broad and expanding field