Prototypical Arm Motions from Human Demonstration for Upper-Limb Prosthetic Device Control

Controlling a complex upper limb prosthesis, akin to a healthy arm, is still an open challenge due to the inadequate number of inputs available to amputees. Designs have therefore largely focused on a limited number of controllable degrees of freedom, developing a complex hand and grasp functionality rather than the wrist. This thesis investigates joint coordination based on human demonstrations that aims to vastly simplify the controls of wrist, elbow-wrist, and shoulder-elbow wrist devices.The wide range of motions performed by the human arm during daily tasks makes it desirable to find representative subsets to reduce the dimensionality of these movements for a variety of applications, including the design and control of robotic and prosthetic devices. Here I present the results of an extensive human subjects study and two methods that were used to obtain representative categories of arm use that span naturalistic motions during activities of daily living. First, I sought to identify sets of prototypical upper-limb motions that are functions of a single variable, allowing, for instance, an entire prosthetic or robotic arm to be controlled with a single input from a user, along with a means to select between motions for different tasks. Second, I decouple the orientation from the location of the hand and analyze the hand location in three ways and orientation in three reference frames. Both of these analyses are an application of data driven approaches that reduce the wide range of hand and arm use to a smaller representative set. Together these provide insight into our arm usage in daily life and inform an implementation in prosthetic or robotic devices without the need for additional hardware. To demonstrate the control efficacy of prototypical arm motions in upper-limb prosthetic devices, I developed an immersive virtual reality environment where able-bodied participants tested out different devices and controls. I coined prototypical arm motion control as trajectory control, and I found that as device complexity increased from 3 DOF wrist to 4 DOF elbow-wrist and 7 DOF shoulder-elbow-wrist, it enables users to complete tasks faster with a more intuitive interface without additional body compensation, while featuring better movement cosmesis when compared to standard controls

Tenodesis Grasp Emulator: Kinematic Assessment of Wrist-Driven Orthotic Control

Wrist-driven orthotics have been designed to assist people with C6-7 spinal cord injury, however, the kinematic constraint imposed by such a control strategy can impede mobility and lead to abnormal body motion. This study characterizes body compensation using the novel Tenodesis Grasp Emulator, an adaptor orthotic that allows for the investigation of tenodesis grasping in subjects with unimpaired hand function. Subjects perform a series of grasp-and-release tasks in order to compare normal (test control) and constrained wrist-driven modes, showing significant compensation as a result of the constraint. A motor-augmented mode is also compared against traditional wrist-driven operation, to explore the potential role of hybrid human-robot control. We find that both the passive wrist-driven and motor-augmented modes fulfill different roles throughout various tasks tested. Thus, we conclude that a flexible control scheme that can alter intervention based on the task at hand holds the potential to reduce compensation in future work.Comment: 7 pages, 11 figures, submitted to International Conference on Robotics and Automation (ICRA) 2022. Video Supplement: https://youtu.be/NIgKg5R3Ro

Behavioral correlates of semi-zygodactyly in Ospreys (Pandion haliaetus) based on analysis of internet images

Ospreys are renowned for their fishing abilities, which have largely been attributed to their specialized talon morphology and semi-zygodactyly−the ability to rotate the fourth toe to accompany the first toe in opposition of toes II and III. Anecdotal observations indicate that zygodactyly in Ospreys is associated with prey capture, although to our knowledge this has not been rigorously tested. As a first pass toward understanding the functional significance of semi-zygodactyly in Ospreys, we scoured the internet for images of Osprey feet in a variety of circumstances. From these we cross-tabulated the number of times each of three toe configurations (anisodactylous, zygodactylous, and an intermediate condition between these) was associated with different grasping scenarios (e.g., grasping prey or perched), contact conditions (e.g., fish, other objects, or substrate), object sizes (relative to foot size), and grasping behaviors (e.g., using one or both feet). Our analysis confirms an association between zygodactyly and grasping behavior; the odds that an osprey exhibited zygodactyly while grasping objects in flight were 5.7 times greater than whilst perched. Furthermore, the odds of zygodactyly during single-foot grasps were 4.1 times greater when pictured grasping fish compared to other objects. These results suggest a functional association between predatory behavior and zygodactyly and has implications for the selective role of predatory performance in the evolution of zygodactyly more generally

Behavioral correlates of semi-zygodactyly in Ospreys (Pandion haliaetus) based on analysis of internet images

Ospreys are renowned for their fishing abilities, which have largely been attributed to their specialized talon morphology and semi-zygodactyly-the ability to rotate the fourth toe to accompany the first toe in opposition of toes II and III. Anecdotal observations indicate that zygodactyly in Ospreys is associated with prey capture, although to our knowledge this has not been rigorously tested. As a first pass toward understanding the functional significance of semi-zygodactyly in Ospreys, we scoured the internet for images of Osprey feet in a variety of circumstances. From these we cross-tabulated the number of times each of three toe configurations (anisodactylous, zygodactylous, and an intermediate condition between these) was associated with different grasping scenarios (e.g., grasping prey or perched), contact conditions (e.g., fish, other objects, or substrate), object sizes (relative to foot size), and grasping behaviors (e.g., using one or both feet). Our analysis confirms an association between zygodactyly and grasping behavior; the odds that an osprey exhibited zygodactyly while grasping objects in flight were 5.7 times greater than whilst perched. Furthermore, the odds of zygodactyly during single-foot grasps were 4.1 times greater when pictured grasping fish compared to other objects. These results suggest a functional association between predatory behavior and zygodactyly and has implications for the selective role of predatory performance in the evolution of zygodactyly more generally

Fast In-Hand Slip Control on Unfeatured Objects With Programmable Tactile Sensing

Accurate dynamic object manipulation in a robotic hand remains a difficult task, especially when frictional slip is involved. Prior solutions involve extensive data collection to train complex models to control the hand that do not necessarily generalize to other slip circumstances. Our approach focuses on direct slip sensing using a tactile sensor with a capacitive array, coupled with a programmable system on a chip, capable of mode switching and sampling rate adjustment. We characterize the sensor's capacity to sense slip features at higher speeds and introduce a novel methodology for estimating motions. Low-level sensor reprogramming that couples multiple taxels improves slip avoidance and reaction time during rapid slip onset events. The technology also tracks dominant surface vibration frequencies resulting from stick-slip cycles, estimating speed and acceleration of smooth flat surfaces. Using a parallel-jaw robotic gripper, we demonstrate dynamic repositioning of objects lacking trackable surface features within the hand. The goal of this investigation is to support faster reasoning and reflexes for dynamic dexterous robots that experience directional in-hand slip

Transradial Amputee Reaching: Compensatory Motion Quantification Versus Unaffected Individuals Including Bracing

Joint absence in people with upper-limb-difference leads to compensatory motions. Such compensation has long been a topic of study, but typically only for a single object/user layout, which is unlikely to spatially generalize. We seek to understand how motion varies over a planar workspace for different target orientations and wrist mobility conditions. We therefore present a study that records arm and torso pose during grasping of 49 equally spaced cylindrical targets. Furthermore, we seek to validate the research practice of using wrist-immobilizing bypass sockets on able-bodied participants to simulate prostheses without wrists. Participants were 2 transradial amputees and 7 able-bodied individuals who conducted the study with and without wrist braces, generating 2450 trajectories. Heat-maps illustrate variation over the workspace in Mean Joint Angle, Range of Joint Motion and Distance Travelled by Body Segment. Results indicate that greater wrist restriction primarily exacerbated shoulder internal rotation and elbow flexion, not the trunk. We observed that bypass sockets do not fully simulate amputee behavior. Furthermore, amputee reaching with their intact limb is different to the reaching motion of normative participants, implying that transradial limb-difference affects both sides of the body. Differences in participant behavior were also observed between horizontal and vertical target orientations

A Wearable Testbed for Studying Variable Transmission in Body-Powered Prosthetic Gripping

For those with upper limb absence, body-powered prostheses continue to be popular for many activities despite being an old technology; these devices can provide both inherent haptic feedback and mechanical robustness. Yet, they can also result in strain and fatigue. Body-powered prosthetic graspers typically consist of a simple lever providing a relatively constant transmission ratio between the input forces from the user's shoulder harness and the grip force of their prosthetic prehensor. In the field of robotic hand design, new continuously varying transmissions demonstrate particular promise in generating a wide range of grasping speeds without sacrificing grip strength. These benefits, if applied to shoulder-driven prosthetic grippers, have the potential to both reduce shoulder exertion and fatigue. This work presents the integration of a continuously variable transmission into a body-powered, voluntary close prosthetic testbed. We introduce the design and validate its performance in a benchtop experiment. We compare constant transmission conditions with a force-dependent, continually varying condition. The device is mounted on a prosthetic emulator for a preliminary wearable demonstration