Autonomy Infused Teleoperation with Application to BCI Manipulation

Robot teleoperation systems face a common set of challenges including latency, low-dimensional user commands, and asymmetric control inputs. User control with Brain-Computer Interfaces (BCIs) exacerbates these problems through especially noisy and erratic low-dimensional motion commands due to the difficulty in decoding neural activity. We introduce a general framework to address these challenges through a combination of computer vision, user intent inference, and arbitration between the human input and autonomous control schemes. Adjustable levels of assistance allow the system to balance the operator's capabilities and feelings of comfort and control while compensating for a task's difficulty. We present experimental results demonstrating significant performance improvement using the shared-control assistance framework on adapted rehabilitation benchmarks with two subjects implanted with intracortical brain-computer interfaces controlling a seven degree-of-freedom robotic manipulator as a prosthetic. Our results further indicate that shared assistance mitigates perceived user difficulty and even enables successful performance on previously infeasible tasks. We showcase the extensibility of our architecture with applications to quality-of-life tasks such as opening a door, pouring liquids from containers, and manipulation with novel objects in densely cluttered environments

Accuracy and repeatability of wrist joint angles in boxing using an electromagnetic tracking system

© 2019, The Author(s). The hand-wrist region is reported as the most common injury site in boxing. Boxers are at risk due to the amount of wrist motions when impacting training equipment or their opponents, yet we know relatively little about these motions. This paper describes a new method for quantifying wrist motion in boxing using an electromagnetic tracking system. Surrogate testing procedure utilising a polyamide hand and forearm shape, and in vivo testing procedure utilising 29 elite boxers, were used to assess the accuracy and repeatability of the system. 2D kinematic analysis was used to calculate wrist angles using photogrammetry, whilst the data from the electromagnetic tracking system was processed with visual 3D software. The electromagnetic tracking system agreed with the video-based system (paired t tests) in both the surrogate ( 0.9). In the punch testing, for both repeated jab and hook shots, the electromagnetic tracking system showed good reliability (ICCs > 0.8) and substantial reliability (ICCs > 0.6) for flexion–extension and radial-ulnar deviation angles, respectively. The results indicate that wrist kinematics during punching activities can be measured using an electromagnetic tracking system

Myoelectric forearm prostheses: State of the art from a user-centered perspective

User acceptance of myoelectric forearm prostheses is currently low. Awkward control, lack of feedback, and difficult training are cited as primary reasons. Recently, researchers have focused on exploiting the new possibilities offered by advancements in prosthetic technology. Alternatively, researchers could focus on prosthesis acceptance by developing functional requirements based on activities users are likely to perform. In this article, we describe the process of determining such requirements and then the application of these requirements to evaluating the state of the art in myoelectric forearm prosthesis research. As part of a needs assessment, a workshop was organized involving clinicians (representing end users), academics, and engineers. The resulting needs included an increased number of functions, lower reaction and execution times, and intuitiveness of both control and feedback systems. Reviewing the state of the art of research in the main prosthetic subsystems (electromyographic [EMG] sensing, control, and feedback) showed that modern research prototypes only partly fulfill the requirements. We found that focus should be on validating EMG-sensing results with patients, improving simultaneous control of wrist movements and grasps, deriving optimal parameters for force and position feedback, and taking into account the psychophysical aspects of feedback, such as intensity perception and spatial acuity

Fatigue evaluation in maintenance and assembly operations by digital human simulation

Virtual human techniques have been used a lot in industrial design in order to consider human factors and ergonomics as early as possible. The physical status (the physical capacity of virtual human) has been mostly treated as invariable in the current available human simulation tools, while indeed the physical capacity varies along time in an operation and the change of the physical capacity depends on the history of the work as well. Virtual Human Status is proposed in this paper in order to assess the difficulty of manual handling operations, especially from the physical perspective. The decrease of the physical capacity before and after an operation is used as an index to indicate the work difficulty. The reduction of physical strength is simulated in a theoretical approach on the basis of a fatigue model in which fatigue resistances of different muscle groups were regressed from 24 existing maximum endurance time (MET) models. A framework based on digital human modeling technique is established to realize the comparison of physical status. An assembly case in airplane assembly is simulated and analyzed under the framework. The endurance time and the decrease of the joint moment strengths are simulated. The experimental result in simulated operations under laboratory conditions confirms the feasibility of the theoretical approach

Data-Driven Approach to Simulating Realistic Human Joint Constraints

Modeling realistic human joint limits is important for applications involving physical human-robot interaction. However, setting appropriate human joint limits is challenging because it is pose-dependent: the range of joint motion varies depending on the positions of other bones. The paper introduces a new technique to accurately simulate human joint limits in physics simulation. We propose to learn an implicit equation to represent the boundary of valid human joint configurations from real human data. The function in the implicit equation is represented by a fully connected neural network whose gradients can be efficiently computed via back-propagation. Using gradients, we can efficiently enforce realistic human joint limits through constraint forces in a physics engine or as constraints in an optimization problem.Comment: To appear at ICRA 2018; 6 pages, 9 figures; for associated video, see https://youtu.be/wzkoE7wCbu

Tractor cabin ergonomics analyses by means of Kinect motion capture technology

Kinect is the de facto standard for real-time depth sensing and motion capture cameras. The sensor is here proposed for exploiting body tracking during driving operations. The motion capture system was developed taking advantage of the Microsoft software development kit (SDK), and implemented for real-time monitoring of body movements of a beginner and an expert tractor drivers, on different tracks (straight and with curves) and with different driving conditions (manual and assisted steering). Tests show how analyses can be done not only in terms of absolute movements, but also in terms of relative shifts, allowing for quantification of angular displacements or rotations

Framework for Dynamic Evaluation of Muscle Fatigue in Manual Handling Work

Muscle fatigue is defined as the point at which the muscle is no longer able to sustain the required force or work output level. The overexertion of muscle force and muscle fatigue can induce acute pain and chronic pain in human body. When muscle fatigue is accumulated, the functional disability can be resulted as musculoskeletal disorders (MSD). There are several posture exposure analysis methods useful for rating the MSD risks, but they are mainly based on static postures. Even in some fatigue evaluation methods, muscle fatigue evaluation is only available for static postures, but not suitable for dynamic working process. Meanwhile, some existing muscle fatigue models based on physiological models cannot be easily used in industrial ergonomic evaluations. The external dynamic load is definitely the most important factor resulting muscle fatigue, thus we propose a new fatigue model under a framework for evaluating fatigue in dynamic working processes. Under this framework, virtual reality system is taken to generate virtual working environment, which can be interacted with the work with haptic interfaces and optical motion capture system. The motion information and load information are collected and further processed to evaluate the overall work load of the worker based on dynamic muscle fatigue models and other work evaluation criterions and to give new information to characterize the penibility of the task in design process.Comment: International Conference On Industrial Technology, Chengdu : Chine (2008

Validation of ankle strength measurements by means of a hand-held dynamometer in adult healthy subjects

Uniaxial Hand-Held Dynamometer (HHD) is a low-cost device widely adopted in clinical practice to measure muscle force. HHD measurements depend on operator’s ability and joint movements. The aim of the work is to validate the use of a commercial HHD in both dorsiflexion and plantarflexion ankle strength measurements quantifying the effects of HHD misplacements and unwanted foot’s movements on the measurements. We used an optoelectronic system and a multicomponent load cell to quantify the sources of error in the manual assessment of the ankle strength due to both the operator’s ability to hold still the HHD and the transversal components of the exerted force that are usually neglected in clinical routine. Results showed that foot’s movements and angular misplacements of HHD on sagittal and horizontal planes were relevant sources of inaccuracy on the strength assessment. Moreover, ankle dorsiflexion and plantarflexion force measurements presented an inaccuracy less than 2% and higher than 10%, respectively. In conclusion, the manual use of a uniaxial HHD is not recommend ed for the assessment of ankle plantarflexion strength; on the contrary, it can be allowed asking the operator to pay strong attention to the HHD positioning in ankle dorsiflexion strength measurements

Feedback Control of an Exoskeleton for Paraplegics: Toward Robustly Stable Hands-free Dynamic Walking

This manuscript presents control of a high-DOF fully actuated lower-limb exoskeleton for paraplegic individuals. The key novelty is the ability for the user to walk without the use of crutches or other external means of stabilization. We harness the power of modern optimization techniques and supervised machine learning to develop a smooth feedback control policy that provides robust velocity regulation and perturbation rejection. Preliminary evaluation of the stability and robustness of the proposed approach is demonstrated through the Gazebo simulation environment. In addition, preliminary experimental results with (complete) paraplegic individuals are included for the previous version of the controller.Comment: Submitted to IEEE Control System Magazine. This version addresses reviewers' concerns about the robustness of the algorithm and the motivation for using such exoskeleton

Mechanical Design and Kinematic Modeling of a Cable-Driven Arm Exoskeleton Incorporating Inaccurate Human Limb Anthropomorphic Parameters

Compared with conventional exoskeletons with rigid links, cable-driven upper-limb exoskeletons are light weight and have simple structures. However, cable-driven exoskeletons rely heavily on the human skeletal system for support. Kinematic modeling and control thus becomes very challenging due to inaccurate anthropomorphic parameters and flexible attachments. In this paper, the mechanical design of a cable-driven arm rehabilitation exoskeleton is proposed to accommodate human limbs of different sizes and shapes. A novel arm cuff able to adapt to the contours of human upper limbs is designed. This has given rise to an exoskeleton which reduces the uncertainties caused by instabilities between the exoskeleton and the human arm. A kinematic model of the exoskeleton is further developed by considering the inaccuracies of human-arm skeleton kinematics and attachment errors of the exoskeleton. A parameter identification method is used to improve the accuracy of the kinematic model. The developed kinematic model is finally tested with a primary experiment with an exoskeleton prototype