Overcoming barriers and increasing independence: service robots for elderly and disabled people

This paper discusses the potential for service robots to overcome barriers and increase independence of elderly and disabled people. It includes a brief overview of the existing uses of service robots by disabled and elderly people and advances in technology which will make new uses possible and provides suggestions for some of these new applications. The paper also considers the design and other conditions to be met for user acceptance. It also discusses the complementarity of assistive service robots and personal assistance and considers the types of applications and users for which service robots are and are not suitable

Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges

In recent years, new research has brought the field of EEG-based Brain-Computer Interfacing (BCI) out of its infancy and into a phase of relative maturity through many demonstrated prototypes such as brain-controlled wheelchairs, keyboards, and computer games. With this proof-of-concept phase in the past, the time is now ripe to focus on the development of practical BCI technologies that can be brought out of the lab and into real-world applications. In particular, we focus on the prospect of improving the lives of countless disabled individuals through a combination of BCI technology with existing assistive technologies (AT). In pursuit of more practical BCIs for use outside of the lab, in this paper, we identify four application areas where disabled individuals could greatly benefit from advancements in BCI technology, namely,“Communication and Control”, “Motor Substitution”, “Entertainment”, and “Motor Recovery”. We review the current state of the art and possible future developments, while discussing the main research issues in these four areas. In particular, we expect the most progress in the development of technologies such as hybrid BCI architectures, user-machine adaptation algorithms, the exploitation of users’ mental states for BCI reliability and confidence measures, the incorporation of principles in human-computer interaction (HCI) to improve BCI usability, and the development of novel BCI technology including better EEG devices

Technology-assisted training of arm-hand skills in stroke: concepts on reacquisition of motor control and therapist guidelines for rehabilitation technology design

<p>Abstract</p> <p>Background</p> <p>It is the purpose of this article to identify and review criteria that rehabilitation technology should meet in order to offer arm-hand training to stroke patients, based on recent principles of motor learning.</p> <p>Methods</p> <p>A literature search was conducted in PubMed, MEDLINE, CINAHL, and EMBASE (1997–2007).</p> <p>Results</p> <p>One hundred and eighty seven scientific papers/book references were identified as being relevant. Rehabilitation approaches for upper limb training after stroke show to have shifted in the last decade from being analytical towards being focussed on environmentally contextual skill training (task-oriented training). Training programmes for enhancing motor skills use patient and goal-tailored exercise schedules and individual feedback on exercise performance. Therapist criteria for upper limb rehabilitation technology are suggested which are used to evaluate the strengths and weaknesses of a number of current technological systems.</p> <p>Conclusion</p> <p>This review shows that technology for supporting upper limb training after stroke needs to align with the evolution in rehabilitation training approaches of the last decade. A major challenge for related technological developments is to provide engaging patient-tailored task oriented arm-hand training in natural environments with patient-tailored feedback to support (re) learning of motor skills.</p

Maximizing the Effects of Passive Training on Visuomotor Adaptation By Incorporating Other Motor Learning Strategies

Passive training has been shown to be an effective rehabilitation approach for stroke survivors, especially for those who suffer from severe control loss or complete paralysis. However, the effectiveness of the treatments that utilize passive assist training is still low. The goal of this dissertation was to develop a training condition that can maximize the effects of passive training on motor learning by combining its effect with other motor learning strategies. To achieve this goal, two specific aims were pursued: one aim was to determine the effects of passive training on learning a visuomotor adaptation task; and the other aim was to determine the effects of passive training in combination with other strategies on learning a visuomotor adaptation task. Experimental results indicated that passive training has a positive effect on visuomotor learning. Furthermore, it was confirmed that a training condition consisting of action observation and passive training leads to significant performance gains beyond what either intervention alone can do. This suggests that passive training could elicit motor representational changes, inducing instance-reliant learning process (use-dependent plasticity) that encodes motor instances associated with specific effectors and task conditions. The findings from this study show great potential for developing specific rehabilitation protocols that utilize passive training and action observation together for severely impaired stroke patients in the future

Technology-supported training of arm-hand skills in stroke

Impaired arm-hand performance is a serious consequence of stroke that is associated with reduced self-efficacy and poor quality of life. Task-oriented arm training is a therapy approach that is known to improve skilled arm-hand performance, even in chronic stages after stroke. At the start of this project, little knowledge had been consolidated regarding taskoriented arm training characteristics, especially in the field of technology-supported rehabilitation. The feasibility and effects of technology-supported client-centred task-oriented training on skilled arm-hand performance had not been investigated but to a very limited degree. Reviewing literature on rehabilitation and motor learning in stroke led to the identification of therapy oriented criteria for rehabilitation technology aiming to influence skilled arm-hand performance (chapter 2). Most rehabilitation systems reported in literature to date are robotic systems that are aimed at providing an engaging exercise environment and feedback on motor performance. Both, feedback and engaging exercises are important for motivating patients to perform a high number of exercise repetitions and prolonged training, which are important factors for motor learning. The review also found that current rehabilitation technology is focussed mainly on providing treatment at a function level, thereby improving joint range of motion, muscle strength and parameters such as movement speed and smoothness of movement during analytical movements. However, related research has found no effects of robot-supported training at the activity level. The review concluded that a challenge exists for upper extremity rehabilitation technology in stroke patients to also provide more patienttailored task-oriented arm-hand training in natural environments to support the learning of skilled arm-hand performance. Besides mapping the strengths of different technological solutions, the use of outcome measures and training protocols needs to become more standardized across similar interventions, in order to help determine which training solutions are most suitable for specific patient categories. Chapter 4 contributes towards such a standardization of outcome measurement. A concept is introduced which may guide the clinician/researcher to choose outcome measures for evaluating specific and generalized training effects. As an initial operationalization of this concept, 28 test batteries that have been used in 16 task-oriented training interventions were rated as to whether measurement components were measured by the test. Future research is suggested that elaborates the concept with information on the relative weighing of components in each test, with more test batteries (which may lead to additional components) and by adding more test properties into the concept (e.g. psychometric properties of the tests, possible floor- or ceiling effects). Task-oriented training is one of the training approaches that has been shown to be beneficial for skilled arm-hand performance after stroke. Important mechanisms for motor learning that are identified are patient motivation for such training, and the learning of efficient goaloriented movement strategies and task-specific problem solving. In this thesis we operationalize task-oriented training in terms of 15 components (chapter 3). A systematic review that included 16 randomized controlled trials using task-oriented training in stroke patients, evaluated the effects of these training components on skilled arm-hand performance. The number of training components used in an intervention aimed at improving arm-hand performance after stroke was not associated with the post-treatment effect size. Distributed practice and feedback were associated with the largest post-intervention effect sizes. Random practice and use of clear functional training goals were associated with the largest follow-up effect sizes. It may be that training components that optimize the storage of learned motor performance in the long-term memory are associated with larger treatment effects. Unfortunately, feedback, random practice and distributed practice were reported in very few of the included randomized controlled trials (in only 6,3 and 1 out of the 17 studies respectively). Client-centred training, i.e. training on exercises that support goals that are selected by the patients themselves, improves patient motivation for training. Motivation in turn has proven to positively influence motor learning in stroke patients, as attention during training is heightened and storage of information in the long-term memory improves. Chapter 5 reports on an interview of 40 stroke patients, investigating into training preferences. A list of 46 skills, ranked according to descending training preference scores, was provided that can be used for implementation of exercises in rehabilitation technology, in order for technologysupported training to be client-centred. Chapter 6 introduces T-TOAT, a technology supported task-oriented arm training method that was developed together with colleagues at Adelante (Hoensbroek, NL). T-TOAT enables the implementation of exercises that support task-oriented training in rehabilitation technology. The training method is applicable for different technological systems, e.g. robot and sensor systems, or in combination with functional electrical stimulation, etc. To enable the use of TTOAT for training with the Haptic Master Robot (MOOG-FCS, NL), special software named Haptic TOAT was developed in Adelante together with colleagues at the Centre of Technology in Care of Zuyd University (chapter 6). The software enables the recording of the patient’s movement trajectories, given task constraints and patient possibilities, using the Haptic Master as a recording device. A purpose-made gimbal was attached to the endeffector, leaving the hand free for the use and manipulating objects. The recorded movement can be replayed in a passive mode or in an active mode (active, active-assisted or activeresisted). Haptic feedback is provided when the patient deviates from the recorded movement trajectory, as the patient receives the sensation of bouncing into a wall, as well as feeling a spring that pulls him/her back to the recorded path. The diameter of the tunnel around the recorded trajectory (distance to the wall), and the spring force can be adjusted for each patient. An ongoing clinical trial in which chronic stroke patients train with Haptic-TOAT examines whether Haptic Master provides additional value compared to supporting the same exercises by video-instruction only. Together with Philips Research Europe (Eindhoven,Aachen), the T-TOAT method has been implemented in a sensor based prototype, called Philips Stroke Rehabilitation Exerciser. This system included movement tracking sensors and an exercise board interacting with real life objects. A very strong feature of the system is that feedback is provided to patients (real-time and after exercise performance), based on a comparison of the patient’s exercise performance to individual targets set by the therapist. Chapter 7 reports on a clinical trial investigating arm-hand treatment outcome and patient motivation for technology-supported task-oriented training in chronic stroke patients. It was found that 8 weeks of T-TOAT training improved arm-hand performance in chronic stroke patients significantly on Fugl-Meyer, Action Research Arm Test, and Motor Activity Log. An improvement was found in health-related quality of life. Training effects lasted at least 6 months post-training. Participants reported feeling intrinsically motivated and competent to use the system. The results of this study showed that T-TOAT is feasible. Despite the small number of stroke patients tested (n=9), significant and clinically relevant improvements in skilled arm-hand performance were found. In conclusion, this thesis has made several contributions. It motivated the need for clientcentred task-oriented training, which it has operationalized in terms of 15 components. Four of these 15 components were identified as most beneficial for the patient. A prioritized inventory of arm-hand training preferences of stroke patients was compiled by means of an interview study of 40 subacute and chronic stroke patients. T-TOAT, a method for technology-supported, client-centred, task-oriented training, was conceived and implemented in two target technologies (Haptic Master and Philips Stroke Rehabilitation Exerciser). Its feasibility was demonstrated in a clinical trial showing substantial and durable benefits for the stroke patients. Finally, the thesis contributes towards the standardization of outcome measures which is necessary for charting progress and guiding future developments of technology-supported stroke rehabilitation. Methodological considerations were discussed and several suggestions for future research were presented. The variety of treatment approaches and the various ways of support and challenge that are offered by existing rehabilitation technologies hold a large potential for offering a variety of extra training opportunities to stroke patients that may improve their arm-hand performance. Such solutions will be of increasing importance, to alleviate therapists and reduce economic pressure on the health care system, as the stroke incidence is increasing rapidly over the coming decades

Expert-in-the-Loop Multilateral Telerobotics for Haptics-Enabled Motor Function and Skills Development

Among medical robotics applications are Robotics-Assisted Mirror Rehabilitation Therapy (RAMRT) and Minimally-Invasive Surgical Training (RAMIST) that extensively rely on motor function development. Haptics-enabled expert-in-the-loop motor function development for such applications is made possible through multilateral telerobotic frameworks. While several studies have validated the benefits of haptic interaction with an expert in motor learning, contradictory results have also been reported. This emphasizes the need for further in-depth studies on the nature of human motor learning through haptic guidance and interaction. The objective of this study was to design and evaluate expert-in-the-loop multilateral telerobotic frameworks with stable and human-safe control loops that enable adaptive “hand-over-hand” haptic guidance for RAMRT and RAMIST. The first prerequisite for such frameworks is active involvement of the patient or trainee, which requires the closed-loop system to remain stable in the presence of an adaptable time-varying dominance factor. To this end, a wave-variable controller is proposed in this study for conventional trilateral teleoperation systems such that system stability is guaranteed in the presence of a time-varying dominance factor and communication delay. Similar to other wave-variable approaches, the controller is initially developed for the Velocity-force Domain (VD) based on the well-known passivity assumption on the human arm in VD. The controller can be applied straightforwardly to the Position-force Domain (PD), eliminating position-error accumulation and position drift, provided that passivity of the human arm in PD is addressed. However, the latter has been ignored in the literature. Therefore, in this study, passivity of the human arm in PD is investigated using mathematical analysis, experimentation as well as user studies involving 12 participants and 48 trials. The results, in conjunction with the proposed wave-variables, can be used to guarantee closed-loop PD stability of the supervised trilateral teleoperation system in its classical format. The classic dual-user teleoperation architecture does not, however, fully satisfy the requirements for properly imparting motor function (skills) in RAMRT (RAMIST). Consequently, the next part of this study focuses on designing novel supervised trilateral frameworks for providing motor learning in RAMRT and RAMIST, each customized according to the requirements of the application. The framework proposed for RAMRT includes the following features: a) therapist-in-the-loop mirror therapy; b) haptic feedback to the therapist from the patient side; c) assist-as-needed therapy realized through an adaptive Guidance Virtual Fixture (GVF); and d) real-time task-independent and patient-specific motor-function assessment. Closed-loop stability of the proposed framework is investigated using a combination of the Circle Criterion and the Small-Gain Theorem. The stability analysis addresses the instabilities caused by: a) communication delays between the therapist and the patient, facilitating haptics-enabled tele- or in-home rehabilitation; and b) the integration of the time-varying nonlinear GVF element into the delayed system. The platform is experimentally evaluated on a trilateral rehabilitation setup consisting of two Quanser rehabilitation robots and one Quanser HD2 robot. The framework proposed for RAMIST includes the following features: a) haptics-enabled expert-in-the-loop surgical training; b) adaptive expertise-oriented training, realized through a Fuzzy Interface System, which actively engages the trainees while providing them with appropriate skills-oriented levels of training; and c) task-independent skills assessment. Closed-loop stability of the architecture is analyzed using the Circle Criterion in the presence and absence of haptic feedback of tool-tissue interactions. In addition to the time-varying elements of the system, the stability analysis approach also addresses communication delays, facilitating tele-surgical training. The platform is implemented on a dual-console surgical setup consisting of the classic da Vinci surgical system (Intuitive Surgical, Inc., Sunnyvale, CA), integrated with the da Vinci Research Kit (dVRK) motor controllers, and the dV-Trainer master console (Mimic Technology Inc., Seattle, WA). In order to save on the expert\u27s (therapist\u27s) time, dual-console architectures can also be expanded to accommodate simultaneous training (rehabilitation) for multiple trainees (patients). As the first step in doing this, the last part of this thesis focuses on the development of a multi-master/single-slave telerobotic framework, along with controller design and closed-loop stability analysis in the presence of communication delays. Various parts of this study are supported with a number of experimental implementations and evaluations. The outcomes of this research include multilateral telerobotic testbeds for further studies on the nature of human motor learning and retention through haptic guidance and interaction. They also enable investigation of the impact of communication time delays on supervised haptics-enabled motor function improvement through tele-rehabilitation and mentoring

The re-education of upper limb movement post stroke using iterative learning control mediated by electrical stimulation

An inability to perform tasks involving reaching is a common problem following stroke. Evidence supports the use of robotic therapy and electrical stimulation (ES) to reduce upper limb impairments following stroke, but current systems may not encourage maximal voluntary contribution from the participant. This study developed and tested iterative learning control (ILC) algorithms mediated by ES, using a purpose designed robotic workstation, for upper limb rehabilitation post stroke. Surface electromyography (EMG) which may be related to impaired performance and function was used to investigate seven shoulder and elbow muscle activation patterns in eight neurologically intact and five chronic stroke participants during nine tracking tasks. The participants’ forearm was supported using a hinged arm-holder, which constrained their hand to move in a two dimensional horizontal plane.Outcome measures taken prior to and after an intervention consisted of the Fugl-Meyer Assessment (FMA) and the Action Research Arm Test (ARAT), isometric force and error tracking. The intervention for stroke participants consisted of eighteen sessions in which a similar range of tracking tasks were performed with the addition of responsive electrical stimulation to their triceps muscle. A question set was developed to understand participants’ perceptions of the ILC system. Statistically significant improvements were measured (p?0.05) in: FMA motor score, unassisted tracking, and in isometric force. Statistically significant differences in muscle activation patterns were observed between stroke and neurologically intact participants for timing, amplitude and coactivation patterns. After the intervention significant changes were observed in many of these towards neurologically intact ranges. The robot–assisted therapy was well accepted and tolerated by the stroke participants. This study has demonstrated the feasibility of using ILC mediated by ES for upper limb stroke rehabilitation in the treatment of stroke patients with upper limb hemiplegia

Kinematic changes following robotic-assisted upper extremity rehabilitation in children with hemiplegia : dosage effects on movement time

Indiana University-Purdue University Indianapolis (IUPUI)Background: Rehabilitation Robotics (RR) has become a more widely used and better understood treatment intervention and research tool in the last 15 years. Traditional research involves pre and post-test outcomes, making it difficult to analyze changes in behavior during the treatment process. Harnessing kinematics captured throughout each treatment allows motor learning to be quantified and questions of application and dosing to be answered. Objective: The aims of this secondary analysis were: (i) to investigate the impact of treatment presentation during RR on upper extremity movement time (mt) in children with hemiplegic cerebral palsy (CP) and (ii) to investigate the impact of training structure (dose and intensity) on mt in children with CP participating in RR. Methods: Subjects completed 16 intervention sessions of RR (2 x week; 8 weeks) with a total of 1,024 repetitions of movement per session and three assessments: pre, post and 6 month f/u. During each assessment and intervention, subjects completed “one-way record” assessments tracking performance on a planar task without robotic assistance. Kinematics from these records were extracted to assess subject performance over the course of and within sessions. Results: For all participants, a significant decrease in mt was found at post-test and follow-up. No significant differences were found in mt for age, severity or group placement. A significant interaction was found between treatment day, block and group (p = .033). Significant mt differences were found between the three blocks of intervention within individual days (p = .001). Specifically, significant differences were found over the last block of treatment (p = .032) and between successive treatment days (p = .001). Conclusion: The results indicate that for children with CP participating in RR, the number of repetitions per session is important. We hypothesized that children’s performance would plateau during a treatment day as attention waned, the opposite proved to be true. Despite the high-number of repetitions and associated cognitive demand, subjects’ performance actually trended upwards throughout the 1,024 repetitions suggesting that children were able to tolerate and learn from a high volume of repetitions