An integrated intelligent nonlinear control method for a pneumatic artificial muscle

This paper proposes an advanced position-tracking control approach, referred to as an integrated intelligent nonlinear controller, for a pneumatic artificial muscle (PAM) system. Due to the existence of uncertain, unknown, and nonlinear terms in the system dynamics, it is difficult to derive an exact mathematical model with robust control performance. To overcome this problem, the main contributions of this paper are as follows. To actively represent the behavior of the PAM system using a grey-box model, neural networks are employed as equivalent internal dynamics of the system model and optimized online by a Lyapunov-based method. To realize the control objective by effectively compensating for the estimation error, an advanced robust controller is developed from the integration of the designed networks, and improvement of the sliding mode and backstepping techniques. The convergences of both the developed model and the closed-loop control system are guaranteed by Lyapunov functions. As a result, the overall control approach is capable of ensuring the system's performance with fast response, high accuracy, and robustness. Real-time experiments are carried out in a PAM system under different conditions to validate the effectiveness of the proposed method

EVA Glove Research Team

The goal of the basic research portion of the extravehicular activity (EVA) glove research program is to gain a greater understanding of the kinematics of the hand, the characteristics of the pressurized EVA glove, and the interaction of the two. Examination of the literature showed that there existed no acceptable, non-invasive method of obtaining accurate biomechanical data on the hand. For this reason a project was initiated to develop magnetic resonance imaging as a tool for biomechanical data acquisition and visualization. Literature reviews also revealed a lack of practical modeling methods for fabric structures, so a basic science research program was also initiated in this area

Adaptive control of compliant robots with Reservoir Computing

In modern society, robots are increasingly used to handle dangerous, repetitive and/or heavy tasks with high precision. Because of the nature of the tasks, either being dangerous, high precision or simply repetitive, robots are usually constructed with high torque motors and sturdy materials, that makes them dangerous for humans to handle. In a car-manufacturing company, for example, a large cage is placed around the robot’s workspace that prevents humans from entering its vicinity. In the last few decades, efforts have been made to improve human-robot interaction. Often the movement of robots is characterized as not being smooth and clearly dividable into sub-movements. This makes their movement rather unpredictable for humans. So, there exists an opportunity to improve the motion generation of robots to enhance human-robot interaction. One interesting research direction is that of imitation learning. Here, human motions are recorded and demonstrated to the robot. Although the robot is able to reproduce such movements, it cannot be generalized to other situations. Therefore, a dynamical system approach is proposed where the recorded motions are embedded into the dynamics of the system. Shaping these nonlinear dynamics, according to recorded motions, allows for dynamical system to generalize beyond demonstration. As a result, the robot can generate motions of other situations not included in the recorded human demonstrations. In this dissertation, a Reservoir Computing approach is used to create a dynamical system in which such demonstrations are embedded. Reservoir Computing systems are Recurrent Neural Network-based approaches that are efficiently trained by considering only the training of the readout connections and retaining all other connections of such a network unchanged given their initial randomly chosen values. Although they have been used to embed periodic motions before, they were extended to embed discrete motions, or both. This work describes how such a motion pattern-generating system is built, investigates the nature of the underlying dynamics and evaluates their robustness in the face of perturbations. Additionally, a dynamical system approach to obstacle avoidance is proposed that is based on vector fields in the presence of repellers. This technique can be used to extend the motion abilities of the robot without need for changing the trained Motion Pattern Generator (MPG). Therefore, this approach can be applied in real-time on any system that generates a certain movement trajectory. Assume that the MPG system is implemented on an industrial robotic arm, similar to the ones used in a car factory. Even though the obstacle avoidance strategy presented is able to modify the generated motion of the robot’s gripper in such a way that it avoids obstacles, it does not guarantee that other parts of the robot cannot collide with a human. To prevent this, engineers have started to use advanced control algorithms that measure the amount of torque that is applied on the robot. This allows the robot to be aware of external perturbations. However, it turns out that, even with fast control loops, the adaptation to compensate for a sudden perturbation, is too slow to prevent high interaction forces. To reduce such forces, researchers started to use mechanical elements that are passively compliant (e.g., springs) and light-weight flexible materials to construct robots. Although such compliant robots are much safer and inherently energy efficient to use, their control becomes much harder. Most control approaches use model information about the robot (e.g., weight distribution and shape). However, when constructing a compliant robot it is hard to determine the dynamics of these materials. Therefore, a model-free adaptive control framework is proposed that assumes no prior knowledge about the robot. By interacting with the robot it learns an inverse robot model that is used as controller. The more it interacts, the better the control be- comes. Appropriately, this framework is called Inverse Modeling Adaptive (IMA) control framework. I have evaluated the IMA controller’s tracking ability on sev- eral tasks, investigating its model independence and stability. Furthermore, I have shown its fast learning ability and comparable performance to taskspecific designed controllers. Given both the MPG and IMA controllers, it is possible to improve the inter- actability of a compliant robot in a human-friendly environment. When the robot is to perform human-like motions for a large set of tasks, we need to demonstrate motion examples of all these tasks. However, biological research concerning the motion generation of animals and humans revealed that a limited set of motion patterns, called motion primitives, are modulated and combined to generate advanced motor/motion skills that humans and animals exhibit. Inspired by these interesting findings, I investigate if a single motion primitive indeed can be modulated to achieve a desired motion behavior. By some elementary experiments, where an MPG is controlled by an IMA controller, a proof of concept is presented. Furthermore, a general hierarchy is introduced that describes how a robot can be controlled in a biology-inspired manner. I also investigated how motion primitives can be combined to produce a desired motion. However, I was unable to get more advanced implementations to work. The results of some simple experiments are presented in the appendix. Another approach I investigated assumes that the primitives themselves are undefined. Instead, only a high-level description is given, which describes that every primitive on average should contribute equally, while still allowing for a single primitive to specialize in a part of the motion generation. Without defining the behavior of a primitive, only a set of untrained IMA controllers is used of which each will represent a single primitive. As a result of the high-level heuristic description, the task space is tiled into sub-regions in an unsupervised manner. Resulting in controllers that indeed represent a part of the motion generation. I have applied this Modular Architecture with Control Primitives (MACOP) on an inverse kinematic learning task and investigated the emerged primitives. Thanks to the tiling of the task space, it becomes possible to control redundant systems, because redundant solutions can be spread over several control primitives. Within each sub region of the task space, a specific control primitive is more accurate than in other regions allowing for the task complexity to be distributed over several less complex tasks. Finally, I extend the use of an IMA-controller, which is tracking controller, to the control of under-actuated systems. By using a sample-based planning algorithm it becomes possible to explore the system dynamics in which a path to a desired state can be planned. Afterwards, MACOP is used to incorporate feedback and to learn the necessary control commands corresponding to the planned state space trajectory, even if it contains errors. As a result, the under-actuated control of a cart pole system was achieved. Furthermore, I presented the concept of a simulation based control framework that allows the learning of the system dynamics, planning and feedback control iteratively and simultaneously

Medical robots for MRI guided diagnosis and therapy

Magnetic Resonance Imaging (MRI) provides the capability of imaging tissue with fine resolution and superior soft tissue contrast, when compared with conventional ultrasound and CT imaging, which makes it an important tool for clinicians to perform more accurate diagnosis and image guided therapy. Medical robotic devices combining the high resolution anatomical images with real-time navigation, are ideal for precise and repeatable interventions. Despite these advantages, the MR environment imposes constraints on mechatronic devices operating within it. This thesis presents a study on the design and development of robotic systems for particular MR interventions, in which the issue of testing the MR compatibility of mechatronic components, actuation control, kinematics and workspace analysis, and mechanical and electrical design of the robot have been investigated. Two types of robotic systems have therefore been developed and evaluated along the above aspects. (i) A device for MR guided transrectal prostate biopsy: The system was designed from components which are proven to be MR compatible, actuated by pneumatic motors and ultrasonic motors, and tracked by optical position sensors and ducial markers. Clinical trials have been performed with the device on three patients, and the results reported have demonstrated its capability to perform needle positioning under MR guidance, with a procedure time of around 40mins and with no compromised image quality, which achieved our system speci cations. (ii) Limb positioning devices to facilitate the magic angle effect for diagnosis of tendinous injuries: Two systems were designed particularly for lower and upper limb positioning, which are actuated and tracked by the similar methods as the first device. A group of volunteers were recruited to conduct tests to verify the functionality of the systems. The results demonstrate the clear enhancement of the image quality with an increase in signal intensity up to 24 times in the tendon tissue caused by the magic angle effect, showing the feasibility of the proposed devices to be applied in clinical diagnosis

Remembering Forward: Neural Correlates of Memory and Prediction in Human Motor Adaptation

We used functional MR imaging (FMRI), a robotic manipulandum and systems identification techniques to examine neural correlates of predictive compensation for spring-like loads during goal-directed wrist movements in neurologically-intact humans. Although load changed unpredictably from one trial to the next, subjects nevertheless used sensorimotor memories from recent movements to predict and compensate upcoming loads. Prediction enabled subjects to adapt performance so that the task was accomplished with minimum effort. Population analyses of functional images revealed a distributed, bilateral network of cortical and subcortical activity supporting predictive load compensation during visual target capture. Cortical regions – including prefrontal, parietal and hippocampal cortices – exhibited trial-by-trial fluctuations in BOLD signal consistent with the storage and recall of sensorimotor memories or “states” important for spatial working memory. Bilateral activations in associative regions of the striatum demonstrated temporal correlation with the magnitude of kinematic performance error (a signal that could drive reward-optimizing reinforcement learning and the prospective scaling of previously learned motor programs). BOLD signal correlations with load prediction were observed in the cerebellar cortex and red nuclei (consistent with the idea that these structures generate adaptive fusimotor signals facilitating cancelation of expected proprioceptive feedback, as required for conditional feedback adjustments to ongoing motor commands and feedback error learning). Analysis of single subject images revealed that predictive activity was at least as likely to be observed in more than one of these neural systems as in just one. We conclude therefore that motor adaptation is mediated by predictive compensations supported by multiple, distributed, cortical and subcortical structures

Synthesis of LQR Controller Based on BAT Algorithm for Furuta Pendulum Stabilization

In this study, a controller design method based on the LQR method and BAT algorithm is presented for the Furuta pendulum stabilization system. Determine the LQR controller, it is often based on the designer's experience or using trial and error to find the Q, R matrices. The BAT search algorithm is based on the characteristics of the bat population in the wild. However, there are advantages to finding multivariate objective functions. The BAT algorithm has an improvement for the LQR controller to optimize the linear square function with fast response time, low energy consumption, overshoot, and a small number of oscillations. Swarm optimization algorithms have advantages in finding global extrema of multivariate functions. Therefore, with a large number of elements of the Q and R matrices, they can also be quickly found and these matrices still satisfy the Riccati equation. The controller with optimal parameters is verified through simulation results with different scenarios. The performance of the proposed controller is compared with a conventional LQR controller and implemented on a real system

Brain encoding of saltatory velocity-scaled somatosensory array in glabrous hand among neurotypical adults

Neurons in human somatosensory cortex are somatotopically organized, with sensation from the lower limbs mediated by neurons near the midline of the brain, whereas sensations from the upper body, hands and orofacial surfaces are mediated by neurons located more laterally in a sequential map. Neurons in Brodmann\u27s area (BA) 3b are exquisitely sensitive to tactile stimulation of these skin surfaces. Moreover, the location, velocity and direction of tactile stimuli on the skin\u27s surface are discriminable features of somatosensory processing, however their role in fine motor control and passive detection are poorly understood in health, and as a neurotherapeutic agent in sensorimotor rehabilitation. To better understand the representation and processing of dynamic saltatory tactile arrays in the human somatosensory cortex, high resolution functional magnetic resonance (fMRI) is utilized to delineate neural networks involved in processing these complex somatosensory events to the glabrous surface of the hand. The principal goal of this dissertation is to map the relation between a dynamic saltatory pneumatic stimulus array delivered at 3 different velocities on the glabrous hand and the evoked blood-oxygen level-dependent (BOLD) brain response, hypothesized to involve a network consisting of primary and secondary somatosensory cortices (S1 and S2), insular cortex, posterior parietal cortex (PPC), and cerebellar nuclei. A random-balanced block design with fMRI will be used to record the BOLD response in healthy right-handed adults. Development of precise stimulus velocities, rapid rise-fall transitions, salient amplitude, is expected to optimize the BOLD response. Advisor: Steven M. Barlo