Achieving human-like dexterity in robotic hands : inspiration from human hand biomechanics and neuromuscular control

The human hand's unique biomechanical structure and neuromuscular control combine to produce amazing dexterous capabilities in a way that is still not fully understood. The Anatomically Correct Testbed (ACT) hand is a robotic system that is designed as a physical simulation of the human hand, and can help us examine and potentially uncover the roles of biomechanics and neural control in achieving dexterity. In this dissertation, I utilize the ACT hand and other robotic systems to explore the underlying sources of human hand dexterity, with the goal of understanding the fundamental differences between robotic and human hands in terms of (i) mechanical joint/tendon structure and (ii) control strategies. To begin, I develop comprehensive mechanical models that describe the musculoskeletal and tendon mechanics of the fingers and thumb of the human hand. Then, I work to isolate the contributions of biomechanical structure and neuromuscular control toward human dexterity. I have developed and implemented control strategies for achieving fine object manipulation first with the robotic hand of a space humanoid, Robonaut 2, and then with the ACT hand. I examined the unique control challenges, including uncontrollable joints and the requirement of accurate internal models, that arise due to the human hand's complex musculotendon structure and the potential advantages offered by the human hand's design, such as passive joint coupling to facilitate grasp shape adaptation and force production capabilities that are ideally suited for common manipulation tasks. Finally, inspired by the neuromuscular control strategies of the human hand, I have developed a novel hierarchical control strategy for the ACT hand and experimentally demonstrated improved grasp stability and manipulation capabilities compared to conventional robotic control laws. Through an in-depth exploration of human hand biomechanics and neuromuscular control, theoretical control analysis of robotic and human hands, and experimental demonstration of fine object manipulation, this work uncovers crucial insights into the sources of human hand dexterity that have the potential to drive innovative design and control strategies and bring robotic and prosthetic hands closer to human levels of dexterity.Mechanical Engineerin

Towards A Paperless Choral Classroom

Our group recommended the best ways to integrate new technologies into the annual Eastern American Choral Directors Association Conference. We worked with Robert Duff, President of the EACDA, to create these recommendations based on his vision and direction for the conference. We researched video conferencing tools, live streaming methods, music cataloging, and tech booth designs for our proposal. We presented our comparisons of these different tools to be used in future Choral Director Conferences

Coordinated multi-arm motion planning: Reaching for moving objects in the face of uncertainty (RSS 2016 Best Student Paper Award)

Coordinated control strategies for multi-robot systems are necessary for tasks that cannot be executed by a single robot. This encompasses tasks where the workspace of the robot is too small or where the load is too heavy for one robot to handle. Using multiple robots makes the task feasible by extending the workspace and/or increase the payload of the overall robotic system. In this paper, we consider two instances of such task: a co-worker scenario in which a human hands over a large object to a robot; intercepting a large flying object. The problem is made difficult as the pick-up/intercept motions must take place while the object is in motion and because the object's motion is not deterministic. The challenge is then to adapt the motion of the robotic arms in coordination with one another and with the object. Determining the pick-up/intercept point is done by taking into account the workspace of the multi-arm system and is continuously recomputed to adapt to change in the object's trajectory. We propose a dynamical systems (DS) based control law to generate autonomous and synchronized motions for a multi-arm robot system in the task of reaching for a moving object. We show theoretically that the resulting DS coordinates the motion of the robots with each other and with the object, while the system remains stable. We validate our approach on a dual-arm robotic system and demonstrate that it can re-synchronize and adapt the motion of each arm in synchrony in a fraction of seconds, even when the motion of the object is fast and not accurately predictable

Cognitive Reasoning for Compliant Robot Manipulation

Physically compliant contact is a major element for many tasks in everyday environments. A universal service robot that is utilized to collect leaves in a park, polish a workpiece, or clean solar panels requires the cognition and manipulation capabilities to facilitate such compliant interaction. Evolution equipped humans with advanced mental abilities to envision physical contact situations and their resulting outcome, dexterous motor skills to perform the actions accordingly, as well as a sense of quality to rate the outcome of the task. In order to achieve human-like performance, a robot must provide the necessary methods to represent, plan, execute, and interpret compliant manipulation tasks. This dissertation covers those four steps of reasoning in the concept of intelligent physical compliance. The contributions advance the capabilities of service robots by combining artificial intelligence reasoning methods and control strategies for compliant manipulation. A classification of manipulation tasks is conducted to identify the central research questions of the addressed topic. Novel representations are derived to describe the properties of physical interaction. Special attention is given to wiping tasks which are predominant in everyday environments. It is investigated how symbolic task descriptions can be translated into meaningful robot commands. A particle distribution model is used to plan goal-oriented wiping actions and predict the quality according to the anticipated result. The planned tool motions are converted into the joint space of the humanoid robot Rollin' Justin to perform the tasks in the real world. In order to execute the motions in a physically compliant fashion, a hierarchical whole-body impedance controller is integrated into the framework. The controller is automatically parameterized with respect to the requirements of the particular task. Haptic feedback is utilized to infer contact and interpret the performance semantically. Finally, the robot is able to compensate for possible disturbances as it plans additional recovery motions while effectively closing the cognitive control loop. Among others, the developed concept is applied in an actual space robotics mission, in which an astronaut aboard the International Space Station (ISS) commands Rollin' Justin to maintain a Martian solar panel farm in a mock-up environment. This application demonstrates the far-reaching impact of the proposed approach and the associated opportunities that emerge with the availability of cognition-enabled service robots

Coordinated multi-arm motion planning: Reaching for moving objects in the face of uncertainty

Sina Mirrazavi Salehian S, Figueroa N, Billard A. Coordinated multi-arm motion planning: Reaching for moving objects in the face of uncertainty. In: Proceedings of Robotics: Science and Systems. AnnArbor, Michigan; 2016

Design Principles for a Family of Direct-Drive Legged Robots

This letter introduces Minitaur, a dynamically running and leaping quadruped, which represents a novel class of direct-drive (DD) legged robots. We present a methodology that achieves the well-known benefits of DD robot design (transparency, mechanical robustness/efficiency, high-actuation bandwidth, and increased specific power), affording highly energetic behaviors across our family of machines despite severe limitations in specific force. We quantify DD drivetrain benefits using a variety of metrics, compare our machines\u27 performance to previously reported legged platforms, and speculate on the potential broad-reaching value of “transparency” for legged locomotion. For more information: Kod*lab

Methods for Hand-Eye Coordination of a serial Robot from partial Observations

Precise object manipulation by a robot requires precise knowledge of the position of the robot endeffector relative to the object. By the so-called eye-to-hand coordination, both the position of the object and the position of the robot relative to the camera are determined. In practice, usually the position of the robot base to camera is calibrated in advanced and the position of the robot endeffector relative to the base is calculated by forward kinematics with joint angle confgurations. For the robots working in the human environment, they are constructed with lightweight in order to increase security, which achieves lower stiffness than industrial robots. Thus, the reached position of robot-effector deviates from its commanded position. The work of this thsis is to develop a method based on the image processing to minimize deviations and thus to estimate the real position of the robot endeffector in real time. Thus, the robot end-effector can be guaranteed to precisely grip the target object

A tool for the evaluation of human lower arm injury: approach, experimental validation and application to safe robotics

This paper treats the systematic injury analysis of lower arm robot–human impacts. For this purpose, a passive mechanical lower arm (PMLA) was developed that mimics the human impact response and is suitable for systematic impact testing and prediction of mild contusions and lacerations. A mathematical model of the passive human lower arm is adopted to the control of the PMLA. Its biofidelity is verified by a number of comparative impact experiments with the PMLA and a human volunteer. The respective dynamic impact responses show very good consistency and support the fact that the developed device may serve as a human substitute in safety analysis for the described conditions. The collision tests were performed with two different robots: the DLR Lightweight Robot III (LWR-III) and the EPSON PS3L industrial robot. The data acquired in the PMLA impact experiments were used to encapsulate the results in a robot independent safety curve, taking into account robot's reflected inertia, velocity and impact geometry. Safety curves define the velocity boundaries on robot motions based on the instantaneous manipulator dynamics and possible human injury due to unforeseen impacts. Copyright © Cambridge University Press 201

Compliant control of Uni/ Multi- robotic arms with dynamical systems

Accomplishment of many interactive tasks hinges on the compliance of humans. Humans demonstrate an impressive capability of complying their behavior and more particularly their motions with the environment in everyday life. In humans, compliance emerges from different facets. For example, many daily activities involve reaching for grabbing tasks, where compliance appears in a form of coordination. Humans comply their handsâ motions with each other and with that of the object not only to establish a stable contact and to control the impact force but also to overcome sensorimotor imprecisions. Even though compliance has been studied from different aspects in humans, it is primarily related to impedance control in robotics. In this thesis, we leverage the properties of autonomous dynamical systems (DS) for immediate re-planning and introduce active complaint motion generators for controlling robots in three different scenarios, where compliance does not necessarily mean impedance and hence it is not directly related to control in the force/velocity domain. In the first part of the thesis, we propose an active compliant strategy for catching objects in flight, which is less sensitive to the timely control of the interception. The soft catching strategy consists in having the robot following the object for a short period of time. This leaves more time for the fingers to close on the object at the interception and offers more robustness than a âhardâ catching method in which the hand waits for the object at the chosen interception point. We show theoretically that the resulting DS will intercept the object at the intercept point, at the right time with the desired velocity direction. Stability and convergence of the approach are assessed through Lyapunov stability theory. In the second part, we propose a unified compliant control architecture for coordinately reaching for grabbing a moving object by a multi-arm robotic system. Due to the complexity of the task and of the system, each arm complies not only with the objectâs motion but also with the motion of other arms, in both task and joint spaces. At the task-space level, we propose a unified dynamical system that endows the multi-arm system with both synchronous and asynchronous behaviors and with the capability of smoothly transitioning between the two modes. At the joint space level, the compliance between the arms is achieved by introducing a centralized inverse kinematics (IK) solver under self-collision avoidance constraints; formulated as a quadratic programming problem (QP) and solved in real-time. In the last part, we propose a compliant dynamical system for stably transitioning from free motions to contacts. In this part, by modulating the robot's velocity in three regions, we show theoretically and empirically that the robot can (I) stably touch the contact surface (II) at a desired location, and (III) leave the surface or stop on the surface at a desired point