Goal Set Inverse Optimal Control and Iterative Re-planning for Predicting Human Reaching Motions in Shared Workspaces

To enable safe and efficient human-robot collaboration in shared workspaces it is important for the robot to predict how a human will move when performing a task. While predicting human motion for tasks not known a priori is very challenging, we argue that single-arm reaching motions for known tasks in collaborative settings (which are especially relevant for manufacturing) are indeed predictable. Two hypotheses underlie our approach for predicting such motions: First, that the trajectory the human performs is optimal with respect to an unknown cost function, and second, that human adaptation to their partner's motion can be captured well through iterative re-planning with the above cost function. The key to our approach is thus to learn a cost function which "explains" the motion of the human. To do this, we gather example trajectories from pairs of participants performing a collaborative assembly task using motion capture. We then use Inverse Optimal Control to learn a cost function from these trajectories. Finally, we predict reaching motions from the human's current configuration to a task-space goal region by iteratively re-planning a trajectory using the learned cost function. Our planning algorithm is based on the trajectory optimizer STOMP, it plans for a 23 DoF human kinematic model and accounts for the presence of a moving collaborator and obstacles in the environment. Our results suggest that in most cases, our method outperforms baseline methods when predicting motions. We also show that our method outperforms baselines for predicting human motion when a human and a robot share the workspace.Comment: 12 pages, Accepted for publication IEEE Transaction on Robotics 201

Dynamics simulation of human box delivering task

Thesis (M.S.) University of Alaska Fairbanks, 2018The dynamic optimization of a box delivery motion is a complex task. The key component is to achieve an optimized motion associated with the box weight, delivering speed, and location. This thesis addresses one solution for determining the optimal delivery of a box. The delivering task is divided into five subtasks: lifting, transition step, carrying, transition step, and unloading. Each task is simulated independently with appropriate boundary conditions so that they can be stitched together to render a complete delivering task. Each task is formulated as an optimization problem. The design variables are joint angle profiles. For lifting and carrying task, the objective function is the dynamic effort. The unloading task is a byproduct of the lifting task, but done in reverse, starting with holding the box and ending with it at its final position. In contrast, for transition task, the objective function is the combination of dynamic effort and joint discomfort. The various joint parameters are analyzed consisting of joint torque, joint angles, and ground reactive forces. A viable optimization motion is generated from the simulation results. It is also empirically validated. This research holds significance for professions containing heavy box lifting and delivering tasks and would like to reduce the chance of injury.Chapter 1 Introduction -- Chapter 2 Skeletal Human Modeling -- Chapter 3 Kinematics and Dynamics -- Chapter 4 Lifting Simulation -- Chapter 5 Carrying Simulation -- Chapter 6 Delivering Simulation -- Chapter 7 Conclusion and Future Research -- Reference

Configuration control of seven-degree-of-freedom arms

A seven degree of freedom robot arm with a six degree of freedom end effector is controlled by a processor employing a 6 by 7 Jacobian matrix for defining location and orientation of the end effector in terms of the rotation angles of the joints, a 1 (or more) by 7 Jacobian matrix for defining 1 (or more) user specified kinematic functions constraining location or movement of selected portions of the arm in terms of the joint angles, the processor combining the two Jacobian matrices to produce an augmented 7 (or more) by 7 Jacobian matrix, the processor effecting control by computing in accordance with forward kinematics from the augmented 7 by 7 Jacobian matrix and from the seven joint angles of the arm a set of seven desired joint angles for transmittal to the joint servo loops of the arm. One of the kinematic functions constraints the orientation of the elbow plane of the arm. Another one of the kinematic functions minimizes a sum of gravitational torques on the joints. Still another kinematic function constrains the location of the arm to perform collision avoidance. Generically, one kinematic function minimizes a sum of selected mechanical parameters of at least some of the joints associated with weighting coefficients which may be changed during arm movement. The mechanical parameters may be velocity errors or gravity torques associated with individual joints

Planning and Real Time Control of a Minimally Invasive Robotic Surgery System

This paper introduces the planning and control software of a teleoperating robotic system for minimally invasive surgery. It addresses the problem of how to organize a complex system with 41 degrees of freedom including robot setup planning, force feedback control and nullspace handling with three robotic arms. The planning software is separated into sequentially executed planning and registration procedures. An optimal setup is first planned in virtual reality and then adapted to variations in the operating room. The real time control system is composed of hierarchical layers. The design is flexible and expandable without losing performance. Structure, functionality and implementation of planning and control are described. The robotic system provides the surgeon with an intuitive hand-eye-coordination and force feedback in teleoperation for both hands

Simulation, modelling and development of the metris RCA

In partnership with Metris UK we discuss the utilisation of modelling and simulation methods in the development of a revolutionary 7-axis Robot CMM Arm (RCA). An offline virtual model is described, facilitating pre-emptive collision avoidance and assessment of optimal placement of the RCA relative to scan specimens. Workspace accessibility of the RCA is examined under a range of geometrical assumptions and we discuss the effects of arbitrary offsets resulting from manufacturing tolerances. Degeneracy is identified in the number of ways a given pose may be attained and it is demonstrated how a simplified model may be exploited to solve the inverse kinematics problem of finding the “correct” set of joint angles. We demonstrate how the seventh axis may be utilised to avoid obstacles or otherwise awkward poses, giving the unit greater dexterity than traditional CMMs. The results of finite element analysis and static force modelling on the RCA are presented which provide an estimate of the forces exerted on the internal measurement arm in a range of poses

Inter-Joint Coordination Deficits Revealed in the Decomposition of Endpoint Jerk During Goal-Directed Arm Movement After Stroke

It is well documented that neurological deficits after stroke can disrupt motor control processes that affect the smoothness of reaching movements. The smoothness of hand trajectories during multi-joint reaching depends on shoulder and elbow joint angular velocities and their successive derivatives as well as on the instantaneous arm configuration and its rate of change. Right-handed survivors of unilateral hemiparetic stroke and neurologically-intact control participants held the handle of a two-joint robot and made horizontal planar reaching movements. We decomposed endpoint jerk into components related to shoulder and elbow joint angular velocity, acceleration, and jerk. We observed an abnormal decomposition pattern in the most severely impaired stroke survivors consistent with deficits of inter-joint coordination. We then used numerical simulations of reaching movements to test whether the specific pattern of inter-joint coordination deficits observed experimentally could be explained by either a general increase in motor noise related to weakness or by an impaired ability to compensate for multi-joint interaction torque. Simulation results suggest that observed deficits in movement smoothness after stroke more likely reflect an impaired ability to compensate for multi-joint interaction torques rather than the mere presence of elevated motor noise

Near Real-Time Data Labeling Using a Depth Sensor for EMG Based Prosthetic Arms

Recognizing sEMG (Surface Electromyography) signals belonging to a particular action (e.g., lateral arm raise) automatically is a challenging task as EMG signals themselves have a lot of variation even for the same action due to several factors. To overcome this issue, there should be a proper separation which indicates similar patterns repetitively for a particular action in raw signals. A repetitive pattern is not always matched because the same action can be carried out with different time duration. Thus, a depth sensor (Kinect) was used for pattern identification where three joint angles were recording continuously which is clearly separable for a particular action while recording sEMG signals. To Segment out a repetitive pattern in angle data, MDTW (Moving Dynamic Time Warping) approach is introduced. This technique is allowed to retrieve suspected motion of interest from raw signals. MDTW based on DTW algorithm, but it will be moving through the whole dataset in a pre-defined manner which is capable of picking up almost all the suspected segments inside a given dataset an optimal way. Elevated bicep curl and lateral arm raise movements are taken as motions of interest to show how the proposed technique can be employed to achieve auto identification and labelling. The full implementation is available at https://github.com/GPrathap/OpenBCIPytho