Modeling of equilibrium point trajectory control in human arm movements

The underlying concept of the Equilibrium Point Hypothesis (EPH) is that the CNS provides a virtual trajectory of joint motion, representing spacing and timing, with actual movement dynamics being produced by interactions of limb inertia, muscle viscosity and speed/position feedback from muscle spindles. To counter criticisms of the EPH, investigators have proposed the use of complex virtual trajectories, non-linear damping, stiffness and time varying stiffness to the EPH model. While these features allow the EPH to adequately produce human joint velocities, they conflict with the EPH’s premise of simple pre-planned monotonic control of movement trajectory. As a result, this study proposed an EPH based method, which provides a simpler mechanism in motor control without conflict with the core advantages of the original approach. This work has proposed relative damping as an addition to the EPH model to predict the single and two joint arm movements. This addition results in simulated data that not only closely match experimental angle data, but also match the experimental joint torques. In addition, it is suggested that this modified model can be used to predict the multi-joint angular trajectories with fast and normal velocities, without the need for time varying or non-linear stiffness and damping, but with simple monotonic virtual trajectories. In the following study, this relative damping model has been further enhanced with an EMG-based determination of the virtual trajectory and with physiologically realistic neuromuscular delays. The results of unobstructed voluntary movement studies suggest that the EPH models use realistic impedance values and produce desired joint trajectories and joint torques in unperturbed voluntary arm movement. A subsequent study of obstructed voluntary arm movement extended the relative damping concept, and incorporated the influential factors of the mechanical behavior of the neural, muscular and skeletal system in the control and coordination of arm posture and movement. A significant problem of the study is how this information should be used to modify control signals to achieve desired performance. This study used an EPH model to examine changes of controlling signals for arm movements in the context of adding perturbation/load in the form of forces/torques. The mechanical properties and reflex actions of muscles of the elbow joint were examined. Brief unexpected torque/force pulses of identical magnitude and time duration were introduced at different stages of the movement in a random order by a pre-programmed 3 degree of freedom (DOF) robotic arm (MOOG FCS HapticMaster). The results show that the subjects may maintain the same control parameters (virtual trajectory, stiffness and damping) regardless of added perturbations that cause substantial changes in EMG activity and kinematics

Cerebral spasticity modeled as disorded equilibrium point control

Spasticity is a highly complex phenomenon, which has not been defined in precise and quantifiable terms. Although the muscle stretch reflex is thought to play an important role in spasticity generation, the pathophysiologic basis of spasticity is not completely understood. A valid measure of spasticity is one that is chosen within the context of a theory describing the physiological mechanisms underlying the control of posture and movement in healthy individuals and possible impairments of these mechanisms leading to motor disorders. This research’s goal was to determine the role of stretch reflex threshold in the regulation of impaired motor control through the exploration of the following research questions: Can experimental measures be produced leading to the development of a model of spasticity that can be interpreted within the framework of a general theory of motor control? Can the underlying motor control framework provide unique parameters capable of describing both normal and altered/abnormal movement? Can the model be robust enough to explain active as well as passive movement? The research method outlined in this dissertation takes the novel approach of incorporating the equilibrium point hypothesis into a trajectory-based analysis of pendulum knee motion. The Equilibrium Point Hypothesis (EPH) of motor control theorizes that the central nervous system (CNS) provides a virtual trajectory of joint motion, representing space and time. A forward dynamic model has been developed that can reproduce kinematic data through the using optimized model parameters. The incorporation of the equilibrium point hypothesis in forward model was not only recognition that examination of the entire trajectory of the limb, rather than just the first amplitude of swing, was necessary, but also, that movement can be characterized by the simple extraction of three parameters: a relative damping coefficient, relative stiffness coefficient and mathematical function which can act as an approximation CNS the virtual trajectory described in the EPH. This research produced a model of passive motion with the ability to produce parameter values that not only differentiate subjects with spasticity from subjects with no clinical signs of spasticity but that can separate subjects based on severity of spastic condition. Research which began as an endeavor to model the passive motion of the pendulum knee test, led to the development of a unifying model of motor control that is robust enough to describe both active and passive movements

Characterizing motor control signals in the spinal cord

The main goal of this project is to develop a rodent model to study the central command signals generated in the brain and spinal cord for the control of motor function in the forearms. The nature of the central command signal has been debated for many decades with only limited progress. This thesis presents a project that investigated this problem using novel techniques. Rats are instrumented to record the control signals in their spinal cord while they are performing lever press task they are trained in. A haptic interface and wireless neural data amplifier system simultaneously collects dynamic and neural data. Isometric force is predicted from force signal using a combination of time-frequency analysis, Principle component analysis and linear filters. Neural-force mapping obtained at one location are subsequently applied to isometric data recorded at other locations. Prediction errors exhibited negative relationship with the isometric position at upper half of movement range. This suggests the presence of restorative forces which are consistent with positional feedback at spinal level. The animal also appears to become unstable in the lower half of their movement ranges, likely caused by a transition from bipedal to quadruped posture. The presence of local feedback and ability for animals to plan postures that are unstable in absence of external forces suggest that descending signal is a reference trajectory planned using internal models. This has important consequences in design of neuroprosthetic actuators: Inverse dynamic models of patient limbs and local positional feedbacks can improve their performance

구조로봇을 위한 강건한 계층적 동작 계획 및 제어

학위논문(박사) -- 서울대학교대학원 : 공과대학 기계항공공학부, 2021.8. 박종우.Over the last several years, robotics has experienced a striking development, and a new generation of robots has emerged that shows great promise in being able to accomplish complex tasks associated with human behavior. Nowadays the objectives of the robots are no longer restricted to the automaton in the industrial process but are changing into explorers for hazardous, harsh, uncooperative, and extreme environments. As these robots usually operate in dynamic and unstructured environments, they should be robust, adaptive, and reactive under various changing operation conditions. We propose online hierarchical optimization-based planning and control methodologies for a rescue robot to execute a given mission in such a highly unstructured environment. A large number of degrees of freedom is provided to robots in order to achieve diverse kinematic and dynamic tasks. However, accomplishing such multiple objectives renders on-line reactive motion planning and control problems more difficult to solve due to the incompatible tasks. To address this problem, we exploit a hierarchical structure to precisely resolve conflicts by creating a priority in which every task is achieved as much as possible according to the levels. In particular, we concentrate on the reasoning about the task regularization to ensure the convergence and robustness of a solution in the face of singularity. As robotic systems with real-time motion planners or controllers often execute unrehearsed missions, a desired task cannot always be driven to a singularity free configuration. We develop a generic solver for regularized hierarchical quadratic programming without resorting to any off-the-shelf QP solver to take advantage of the null-space projections for computational efficiency. Therefore, the underlying principles are thoroughly investigated. The robust optimal solution is obtained under both equality and inequality tasks or constraints while addressing all problems resulting from the regularization. Especially as a singular value decomposition centric approach is leveraged, all hierarchical solutions and Lagrange multipliers for properly handling the inequality constraints are analytically acquired in a recursive procedure. The proposed algorithm works fast enough to be used as a practical means of real-time control system, so that it can be used for online motion planning, motion control, and interaction force control in a single hierarchical optimization. Core system design concepts of the rescue robot are presented. The goals of the robot are to safely extract a patient and to dispose a dangerous object instead of humans. The upper body is designed humanoid in form with replaceable modularized dual arms. The lower body is featured with a hybrid tracked and legged mobile platform to simultaneously acquire versatile manipulability and all-terrain mobility. Thus, the robot can successfully execute a driving task, dangerous object manipulation, and casualty extraction missions by changing the pose and modularized equipments in an optimized manner. Throughout the dissertation, all proposed methods are validated through extensive numerical simulations and experimental tests. We highlight precisely how the rescue robot can execute a casualty extraction and a dangerous object disposal mission both in indoor and outdoor environments that none of the existing robots has performed.최근에 등장한 새로운 세대의 로봇은 기존에는 인간만이 할 수 있었던 복잡한 일을 로봇 또한 수행할 수 있음을 보여주었다. 특히 DARPA Robotics Challenge를 통해 이러한 사실을 잘 확인할 수 있으며, 이 로봇들은 공장과 같은 정형화된 환경에서 자동화된 일을 반복적으로 수행하던 임무에서 더 나아가 극한의 환경에서 인간을 대신하여 위험한 임무를 수행할 수 있는 방향으로 발전하고 있다. 그래서 사람들은 재난환경에서 안전하고 시의 적절하게 대응할 수 있는 여러 가지 대안 중에서 실현 가능성이 높은 대처 방안으로 로봇을 생각하게 되었다. 하지만 이러한 로봇은 동적으로 변화하는 비정형 환경에서 임무를 수행할 수 있어야 하기 때문에 불확실성에 대해 강건해야하고, 다양한 환경 조건에서 능동적으로 반응을 할 수 있어야 한다. 본 학위논문에서는 로봇이 비정형 환경에서 강건하면서도 적응적으로 동작할 수 있는 실시간 최적화 기반의 동작 계획 및 제어 방법과 구조 로봇의 설계 개념을 제안하고자 한다. 인간은 많은 자유도를 가지고 있으며, 하나의 전신 동작을 생성할 때 다양한 기구학 혹은 동역학적 특성을 가지는 세부 동작 혹은 작업을 정의하고, 이를 효과적으로 종합할 수 있다. 그리고 학습을 통해 각 동작 요소들을 최적화할 뿐만 아니라 상황 에 따라 각 동작 요소에 우선순위를 부여하여 이를 효과적으로 결합하거나 분리하여 실시간으로 최적의 동작을 생성하고 제어한다. 즉, 상황에 따라 중요한 동작요소를 우선적으로 수행하고 우선순위가 낮은 동작요소는 부분 혹은 전체적으로 포기하기도 하면서 매우 유연하게 전체 동작을 생성하고 최적화 한다. 인간과 같이 다자유도를 보유한 로봇 또한 기구학과 동역학적 특성을 가지는 다양한 세부 동작 혹은 작업을 작업공간(task space) 혹은 관절공간(configuration space)에서 정의할 수 있으며, 우선순위에 따라 이를 효과적으로 결합하여 전체 동작을 생 성하고 제어할 수 있다. 서로 양립하기 어려운 로봇의 동작 문제를 해결하기 위해 동작들 사이에 우선순위를 부여하여 계층을 생성하고, 이에 따라 로봇의 전신 동작을 구현하는 방법은 오랫동안 연구가 진행되어 왔다. 이러한 계층적 최적화를 이용하면 우선순위가 높은 동작부터 순차적으로 실행하지만, 우선순위가 낮은 동작요소들도 가능한 만족시키는 최적의 해를 찾을 수 있다. 하지만 관절의 구동 범위와 같은 부등식의 조건이 포함된 계층적 최적화 문제에서 특이점에 대한 강건성까지 확보할 수 있는 방법에 대해서는 아직까지 많은 부분이 밝 혀진 바가 없다. 따라서 본 학위논문에서는 등식과 부등식으로 표현되는 구속조건 혹은 동작요소를 계층적 최적화에 동시에 포함시키고, 특이점이 존재하더라도 강건성과 수렴성을 보장하는 관절공간에서의 최적해를 확보하는데 집중한다. 왜나하면 비정형 임무를 수행하는 로봇은 사전에 계획된 동작을 수행하는 것이 아닌 변화하는 환경조건에 따라 실시간으로 동작을 계획하고 제어해야 하기 때문에 특이점이 없는 자세로 로봇을 항상 제어하기가 어렵다. 그리고 이렇게 특이점을 회피하는 방향으로 로봇을 제어하는 것은 로봇의 운용성을 심각하게 저해시킬 수 있다. 특이점 근방에서의 해의 강건성이 보장되지 않으면 로봇 관절에 과도한 속도 혹은 토크가 발생하여 로봇의 임무 수행이 불가능하거나 환경과 로봇의 손상을 초래할 수 있으며, 나아가 로봇과 함께 임무를 수행하는 사람에게 상해를 가할 수도 있다. 특이점에 대한 강건성을 확보하기 위해 우선순위 기반의 계층적 최적화와 정규화 (regularization)를 통합하여 정규화된 계층적 최적화 (RHQP: Regularized Hierarchical Quadratic Program) 문제를 다룬다. 부등식이 포함된 계층적 최적화에 정규화를 동시에 고려함으로써 야기되는 많은 문제점들을 해결하고 해의 최적성과 강건성을 확보할 수 있는 방법을 제안한다. 특히 외부의 최적화 프로그램을 사용하지 않고 수치적 최적화 (numerical optimization) 이론과 우선순위에 기반을 두는 여유자유도 로봇의 해석 기법을 이용하여 계산의 효율성을 극대화할 수 있는 이차 프로그램(quadratic programming)을 제안한다. 또한 이와 동시에 정규화된 계층적 최적화 문제의 이론적 구조를 철저하게 분석한다. 특히 특이값 분해 (singular value decomposition)를 통해 최적해와 부등식 조건을 처리하는데 필요한 라그랑지 승수를 재귀적인 방법으로 해석적 형태로 구함으로써 계산의 효율성을 증대시키고 동시에 부등식의 조건을 오류 없이 정확하게 처리할 수 있도록 하였다. 그리고 정규화된 계층적 최적화를 힘제어까지 확장하여 환경과 로봇의 안전한 상호작용을 보장하여 로봇이 적절한 힘으로 환경과 접촉할 수 있도록 하였다. 불확실성이 존재하는 비정형 환경에서 비정형 임무를 수행할 수 있는 구조로봇의 핵심 설계 개념을 제시한다. 비정형 환경에서의 조작 성능과 이동 성능을 동시에 확보할 수 있는 형상으로 로봇을 설계하여 구조 로봇으로 하여금 최종 목적으로 설정된 인간을 대신하여 부상자를 구조하고 위험물을 처리하는 임무를 효과적으로 수행할 수 있도록 한다. 구조 로봇에 필요한 매니퓰레이터는 부상자 구조 임무와 위험물 처리 임무에 따라 교체 가능한 모듈형으로 설계하여 각각의 임무에 따라 최적화된 매니퓰 레이터를 장착하여 임무를 수행할 수 있다. 하체는 트랙과 관절이 결합된 하이브리드 형태를 취하고 있으며, 주행 임무와 조작임무에 따라 형상을 변경할 수 있다. 형상 변경과 모듈화된 매니퓰레이터를 통해서조작 성능과 험한 지형에서 이동할 수 있는 주행 성능을 동시에 확보하였다. 최종적으로 구조로봇의 설계와 실시간 계층적 제어를 이용하여 비정형 실내외 환경에서 구조로봇이 주행임무, 위험물 조작임무, 부상자 구조 임무를 성공적으로 수 행할 수 있음을 해석과 실험을 통하여 입증함으로써 본 학위논문에서 제안한 설계와 정규화된 계층적 최적화 기반의 제어 전략의 유용성을 검증하였다.1 Introduction 1 1.1 Motivations 1 1.2 Related Works and Research Problems for Hierarchical Control 3 1.2.1 Classical Approaches 3 1.2.2 State-of-the-Art Strategies 4 1.2.3 Research Problems 7 1.3 Robust Rescue Robots 9 1.4 Research Goals 12 1.5 Contributions of ThisThesis 13 1.5.1 Robust Hierarchical Task-Priority Control 13 1.5.2 Design Concepts of Robust Rescue Robot 16 1.5.3 Hierarchical Motion and ForceControl 17 1.6 Dissertation Preview 18 2 Preliminaries for Task-Priority Control Framework 21 2.1 Introduction 21 2.2 Task-Priority Inverse Kinematics 23 2.3 Recursive Formulation of Null Space Projector 28 2.4 Conclusion 31 3 Robust Hierarchical Task-Priority Control 33 3.1 Introduction 33 3.1.1 Motivations 35 3.1.2 Objectives 36 3.2 Task Function Approach 37 3.3 Regularized Hierarchical Optimization with Equality Tasks 41 3.3.1 Regularized Hierarchical Optimization 41 3.3.2 Optimal Solution 45 3.3.3 Task Error and Hierarchical Matrix Decomposition 49 3.3.4 Illustrative Examples for Regularized Hierarchical Optimization 56 3.4 Regularized Hierarchical Optimization with Inequality Constraints 60 3.4.1 Lagrange Multipliers 61 3.4.2 Modified Active Set Method 66 3.4.3 Illustrative Examples of Modified Active Set Method 70 3.4.4 Examples for Hierarchical Optimization with Inequality Constraint 72 3.5 DLS-HQP Algorithm 79 3.6 Concluding Remarks 80 4 Rescue Robot Design and Experimental Results 83 4.1 Introduction 83 4.2 Rescue Robot Design 85 4.2.1 System Design 86 4.2.2 Variable Configuration Mobile Platform 92 4.2.3 Dual Arm Manipulators 95 4.2.4 Software Architecture 97 4.3 Performance Verification for Hierarchical Motion Control 99 4.3.1 Real-Time Motion Generation 99 4.3.2 Task Specifications 103 4.3.3 Singularity Robust Task Priority 106 4.3.4 Inequality Constraint Handling and Computation Time 111 4.4 Singularity Robustness and Inequality Handling for Rescue Mission 117 4.5 Field Tests 122 4.6 Concluding Remarks 126 5 Hierarchical Motion and Force Control 129 5.1 Introduction 129 5.2 Operational Space Control 132 5.3 Acceleration-Based Hierarchical Motion Control 134 5.4 Force Control 137 5.4.1 Force Control with Inner Position Loop 141 5.4.2 Force Control with Inner Velocity Loop 144 5.5 Motion and Force Control 145 5.6 Numerical Results for Acceleration-Based Motion and Force Control 148 5.6.1 Task Specifications 150 5.6.2 Force Control Performance 151 5.6.3 Singularity Robustness and Inequality Constraint Handling 155 5.7 Velocity Resolved Motion and Force Control 160 5.7.1 Velocity-Based Motion and Force Control 161 5.7.2 Experimental Results 163 5.8 Concluding Remarks 167 6 Conclusion 169 6.1 Summary 169 6.2 Concluding Remarks 173 A Appendix 175 A.1 Introduction to PID Control 175 A.2 Inverse Optimal Control 176 A.3 Experimental Results and Conclusion 181 Bibliography 183 Abstract 207박

Shear-promoted drug encapsulation into red blood cells: a CFD model and μ-PIV analysis

The present work focuses on the main parameters that influence shear-promoted encapsulation of drugs into erythrocytes. A CFD model was built to investigate the fluid dynamics of a suspension of particles flowing in a commercial micro channel. Micro Particle Image Velocimetry (μ-PIV) allowed to take into account for the real properties of the red blood cell (RBC), thus having a deeper understanding of the process. Coupling these results with an analytical diffusion model, suitable working conditions were defined for different values of haematocrit

Impact of Ear Occlusion on In-Ear Sounds Generated by Intra-oral Behaviors

We conducted a case study with one volunteer and a recording setup to detect sounds induced by the actions: jaw clenching, tooth grinding, reading, eating, and drinking. The setup consisted of two in-ear microphones, where the left ear was semi-occluded with a commercially available earpiece and the right ear was occluded with a mouldable silicon ear piece. Investigations in the time and frequency domains demonstrated that for behaviors such as eating, tooth grinding, and reading, sounds could be recorded with both sensors. For jaw clenching, however, occluding the ear with a mouldable piece was necessary to enable its detection. This can be attributed to the fact that the mouldable ear piece sealed the ear canal and isolated it from the environment, resulting in a detectable change in pressure. In conclusion, our work suggests that detecting behaviors such as eating, grinding, reading with a semi-occluded ear is possible, whereas, behaviors such as clenching require the complete occlusion of the ear if the activity should be easily detectable. Nevertheless, the latter approach may limit real-world applicability because it hinders the hearing capabilities.</p

Biomechatronics: Harmonizing Mechatronic Systems with Human Beings

This eBook provides a comprehensive treatise on modern biomechatronic systems centred around human applications. A particular emphasis is given to exoskeleton designs for assistance and training with advanced interfaces in human-machine interaction. Some of these designs are validated with experimental results which the reader will find very informative as building-blocks for designing such systems. This eBook will be ideally suited to those researching in biomechatronic area with bio-feedback applications or those who are involved in high-end research on manmachine interfaces. This may also serve as a textbook for biomechatronic design at post-graduate level

Humanoid Robots

For many years, the human being has been trying, in all ways, to recreate the complex mechanisms that form the human body. Such task is extremely complicated and the results are not totally satisfactory. However, with increasing technological advances based on theoretical and experimental researches, man gets, in a way, to copy or to imitate some systems of the human body. These researches not only intended to create humanoid robots, great part of them constituting autonomous systems, but also, in some way, to offer a higher knowledge of the systems that form the human body, objectifying possible applications in the technology of rehabilitation of human beings, gathering in a whole studies related not only to Robotics, but also to Biomechanics, Biomimmetics, Cybernetics, among other areas. This book presents a series of researches inspired by this ideal, carried through by various researchers worldwide, looking for to analyze and to discuss diverse subjects related to humanoid robots. The presented contributions explore aspects about robotic hands, learning, language, vision and locomotion

From stimulus to response: Analyses of electrophysiological and behavioral indicators of sensorimotor interaction processes in linear movements to kinesthetically and visually defined spatial locations

Based on the results suggesting that the time between stimulus and response may have critical influence on the involved mechanisms, we conducted a series of behavioral and EEG experiments, in which we investigated the role of stimulus-response delays in sensorimotor processes in the kinesthetic and the visual modality. In the first two behavioral experiments we tested the effects of verbal-cognitive and motor interfering activity on the retention of relevant information in a motor matching task. The blindfolded subjects were asked to move a handle with their right hand until a stop and then back and to reproduce the given stop position by another movement. After the first backward movement a verbal judgment of the target distance was required in one condition of the first experiment. Analyzing constant and variable errors we obtained that the verbal judgments interfered with the motor reproduction only, when the retention interval was long (8 sec). Instead of verbal distance estimations we asked the subjects to perform an additional movement with their right or left hand during the retention interval in the second experiment. The type of the interpolated movement proved to be important during both delay conditions (0 and 8 sec). Following these results a further experiment was carried out, in which reproduction of terminal locations vs. movement distances was required. Using a similar test arrangement as in the two previous experiments, we compared the performance in both reproduction conditions. The subjects moved the right hand until the stop and back, being however stopped before they reached the initial start position. From this new point they had to move the handle as far as the first movement was or until the memorized stop position. The results indicated rather different characteristics of kinematic parameters of reproduction movements dependent of whether distances or locations were reproduced and suggested that the distance condition was associated with the dominance of dynamic control variables, while static aspects prevailed, when the terminal location had to be reproduced. We used a simple task by asking the subjects to reproduce the position of the stop and by varying the delay in milliseconds and in the seconds range in the last two behavioral experiments. Similarly to the distance reproduction condition of the previous experiment we obtained the untypical deceleration strategies in the short delay conditions indicating the use of rather dynamic information sources and an obvious successive deviation from this pattern, when the delay was extended to more than one second. Moreover, a “range effect” indicating an influence of target-context was not detectible in the short delay conditions, but was evident in the range of seconds. The general task used in a first EEG-study was the same, as in the last two experiments. The blindfolded subjects moved their right hand until they were stopped and then back and tried to reproduce the position of the stop by another movement. Three delay conditions were implemented. The reproduction was required immediately, about one second and about five seconds after the first backward movement. The EEG data was analyzed in respect of the evoked activity during defined processing epochs. Several methodical procedures were applied to the ERPs aiming to investigate the differences across the delay and the distance conditions. In respect to the delay manipulation, we identified voltage-amplitude modulations in many selected time-windows starting from the end of the first backward movement. One characteristic feature of these effects seemed to be composed of differences of hemispheric dominance. When the delay was short, negative activity over premotor and motor areas was stronger over the left than over the right hemisphere and contrariwise, stronger over the right that over the left hemisphere, when the delay was long. In the middle delay condition no pronounced laterality effects were obtained. The ERPs of the delay phase seemed to suggest further that neuronal networks participating in the retention of kinesthetic information and / or motor preparation were distinct dependent on delay condition. In order to test the validity of the results and to reduce the data-complexity to some extent, another EEG-Study was conducted. We asked the subjects to memorize spatial locations of visual stimuli arranged in the same way as the stop positions used previously. The ERP results strongly suggested that motor planning relied on qualitatively distinct processes dependent on delay duration. Not only different dynamics of evoked activity were obtained, but also distance effects occurred at different sites dependent on delay condition. In summary, the bulk of evidence seems to delineate several distinct sensorimotor mechanisms, which are involved differently dependent on the time of response