Recognition of elementary arm movements using orientation of a tri-axial accelerometer located near the wrist

In this paper we present a method for recognising three fundamental movements of the human arm (reach and retrieve, lift cup to mouth, rotation of the arm) by determining the orientation of a tri-axial accelerometer located near the wrist. Our objective is to detect the occurrence of such movements performed with the impaired arm of a stroke patient during normal daily activities as a means to assess their rehabilitation. The method relies on accurately mapping transitions of predefined, standard orientations of the accelerometer to corresponding elementary arm movements. To evaluate the technique, kinematic data was collected from four healthy subjects and four stroke patients as they performed a number of activities involved in a representative activity of daily living, 'making-a-cup-of-tea'. Our experimental results show that the proposed method can independently recognise all three of the elementary upper limb movements investigated with accuracies in the range 91–99% for healthy subjects and 70–85% for stroke patients

Coupled Human-machine Tele-manipulation

AbstractRobots are primarily deployed for tasks which are dirty, dull, or dangerous. While the former two are already highly automated, many dangerous tasks such as explosive ordnance disposal or inspection in hazardous environments are predominantly done via tele-operation. Usually, such tasks require the manipulation of objects in a way that cannot be done reliably with automated systems. In this paper, we present a method to tele-operate the manipulator of a robot by transferring the operator's arm movement. The movement is recorded with inertial measurement units which can be sewn into clothing and need no external infrastructure like cameras or motion capture systems. The lack of intermediate user interfaces (e.g. joysticks) makes this control method very intuitive and easy to learn. We demonstrate this with two different NIST manipulation tests and as part of an integrated system for the ELROB robot competition

Measurement of Upper Limb Range of Motion Using Wearable Sensors: A Systematic Review.

Background: Wearable sensors are portable measurement tools that are becoming increasingly popular for the measurement of joint angle in the upper limb. With many brands emerging on the market, each with variations in hardware and protocols, evidence to inform selection and application is needed. Therefore, the objectives of this review were related to the use of wearable sensors to calculate upper limb joint angle. We aimed to describe (i) the characteristics of commercial and custom wearable sensors, (ii) the populations for whom researchers have adopted wearable sensors, and (iii) their established psychometric properties. Methods: A systematic review of literature was undertaken using the following data bases: MEDLINE, EMBASE, CINAHL, Web of Science, SPORTDiscus, IEEE, and Scopus. Studies were eligible if they met the following criteria: (i) involved humans and/or robotic devices, (ii) involved the application or simulation of wearable sensors on the upper limb, and (iii) calculated a joint angle. Results: Of 2191 records identified, 66 met the inclusion criteria. Eight studies compared wearable sensors to a robotic device and 22 studies compared to a motion analysis system. Commercial (n = 13) and custom (n = 7) wearable sensors were identified, each with variations in placement, calibration methods, and fusion algorithms, which were demonstrated to influence accuracy. Conclusion: Wearable sensors have potential as viable instruments for measurement of joint angle in the upper limb during active movement. Currently, customised application (i.e. calibration and angle calculation methods) is required to achieve sufficient accuracy (error < 5°). Additional research and standardisation is required to guide clinical application

Motion-based remote control device for interaction with multimedia content

This dissertation describes the development and implementation of techniques to enhance the accuracy of low-complexity lters, making them suitable for remote control devices in consumer electronics. The evolution veri ed in the last years, on multimedia contents, available for consumers in Smart TVs and set-top-boxes, is not raising the expected interest from users, and one of the pointed reasons for this nding is the user interface. Although most current pointing devices rely on relative rotation increments, absolute orientation allows for a more intuitive use and interaction. This possibility is explored in this work as well as the interaction with multimedia contents through gestures. Classical accurate fusion algorithms are computationally intensive, therefore their implementation in low-energy consumption devices is a challenging task. To tackle this problem, a performance study was carried, comparing a relevant set of professional commercial of-the-shelf units, with the developed low-complexity lters in state-of-the-art Magnetic, Angular Rate, Gravity (MARG) sensors. Part of the performance evaluation tests are carried out under harsh conditions to observe the algorithms response in a nontrivial environment. The results demonstrate that the implementation of low-complexity lters using low-cost sensors, can provide an acceptable accuracy in comparison with the more complex units/ lters. These results pave the way for faster adoption of absolute orientation-based pointing devices in interactive multimedia applications, which includes hand-held, battery-operated devices

Across-subject calibration of an instrumented glove to measure hand movement for clinical purposes

Motion capture of all degrees of freedom of the hand collected during performance of daily living activities remains challenging. Instrumented gloves are an attractive option because of their higher ease of use. However, subject-specific calibration of gloves is lengthy and has limitations for individuals with disabilities. Here, a calibration procedure is presented, consisting in the recording of just a simple hand position so as to allow capture of the kinematics of 16 hand joints during daily life activities even in case of severe injured hands. ‘across-subject gains’ were obtained by averaging the gains obtained from a detailed subject-specific calibration involving 44 registrations that was repeated three times on multiple days to 6 subjects. In additional 4 subjects, joint angles that resulted from applying the ‘across-subject calibration’ or the subject-specific calibration were compared. Global errors associated with the ‘across-subject calibration’ relative to the detailed, subject-specific protocol were small (bias: 0.49°; precision: 4.45°) and comparable to those that resulted from repeating the detailed protocol with the same subject on multiple days (0.36°; 3.50°). Furthermore, in one subject, performance of the ‘across-subject calibration’ was directly compared to another fast calibration method, expressed relative to a videogrammetric protocol as a gold-standard, yielding better results.This work was supported by the Ministerio de Economía y Competitividad [project number DPI2014-52095-P]; Universitat Jaume I [project number P1-1B2013-33], [project number P1-1B2014-10]; NIH [grant number NIH R01EB011615]. We thank Marta Mora, PhD, for her collaboration in coding for data glove acquisition, and the graduate student Sheyla Mestre Vicente for her collaboration in data collection. Authors thank also Union de Mutuas for their support in clinical guidanc

A functional calibration protocol for ankle plantar-dorsiflexion estimate using magnetic and inertial measurement units: Repeatability and reliability assessment

The ankle joint complex presents a tangled functional anatomy, which understanding is fundamental to effectively estimate its kinematics on the sagittal plane. Protocols based on the use of magnetic and inertial measurement units (MIMUs) currently do not take in due account this factor. To this aim, a joint coordinate system for the ankle joint complex is proposed, along with a protocol to perform its anatomical calibration using MIMUs, consisting in a combination of anatomical functional calibrations of the tibiotalar axis and static acquisitions. Protocol repeatability and reliability were tested according to the metrics proposed in Schwartz et al. (2004) involving three different operators performing the protocol three times on ten participants, undergoing instrumented gait analysis through both stereophotogrammetry and MIMUs. Instrumental reliability was evaluated comparing the MIMU-derived kinematic traces with the stereophotogrammetric ones, obtained with the same protocol, through the linear fit method. A total of 270 gait cycles were considered. Results showed that the protocol was repeatable and reliable for what concerned the operators (0.4 +/- 0.4 deg and 0.8 +/- 0.5 deg, respectively). Instrumental reliability analysis showed a mean RMSD of 3.0 +/- 1.3 deg, a mean offset of 9.4 +/- 8.4 deg and a mean linear relationship strength of R2 = 0.88 +/- 0.08. With due caution, the protocol can be considered both repeatable and reliable. Further studies should pay attention to the other ankle degrees of freedom as well as on the angular convention to compute them

Using magneto-inertial-measurement-units to track upper-limb movement during rehabilitation

Functional Electrical Stimulation (FES) can be used to support upper-limb rehabilitation after a stroke. A key aspect of FES control and also patient monitoring is the automatic tracking of upper-limb motion during intensive and functional practise of upper-limb tasks. To achieve this in a home environment, simple on-body sensors are required. A promising approach is to use Magnetic and Inertial Measurement Units (MIMUs), but they provide body-segment orientations rather than anatomical joint angles, the latter being more meaningful. To solve this problem the sensor orientation data must be interpreted anatomically, which requires that for each body-segment the orientation of its sensor coordinate frame is known with respect to its anatomical coordinate frame. Therefore, appropriate calibration must be performed to obtain the relationship between each sensor frame and its corresponding body-segment anatomical frame.While many papers have been published on anatomical calibration methods for MIMUs, there has been no comprehensive comparison of the alternative approaches to establish their relative merits. For FES supported upper-limb therapy, the need is for simple and fast donning and calibration, whilst achieving acceptable accuracy and repeatability with regards to the calculated joint kinematics. Therefore, the main objective of the PhD research was to undertake such a comparison and make recommendations for donning and calibration for the purposes of upper-limb FES.To address this problem the PhD work included:1. Undertaking a comprehensive and critical comparison of alternative anatomical calibration methods for MIMUs in terms of accuracy, speed, and simplicity.2. Finding the most appropriate anatomical calibration methods for use in upper-limb FES applications with stroke patients.3. Determining the best methods for processing MIMU outputs to provide anatomically meaningful upper-limb kinematic data.4. Experimentally assessing these methods against a gold standard (a VICON optical motion capture system).The results demonstrate that there is considerable variation between the alternative sensor defined anatomical frames and, hence, confirm the need for comprehensive comparisons. The comparisons reported in this thesis have led to tentative recommendations. Nevertheless, the methods reported are a sound foundation for future work to provide stronger recommendations, with more formal measures of confidence

Quaternionic Attitude Estimation with Inertial Measuring Unit for Robotic and Human Body Motion Tracking using Sequential Monte Carlo Methods with Hyper-Dimensional Spherical Distributions

This dissertation examined the inertial tracking technology for robotics and human tracking applications. This is a multi-discipline research that builds on the embedded system engineering, Bayesian estimation theory, software engineering, directional statistics, and biomedical engineering. A discussion of the orientation tracking representations and fundamentals of attitude estimation are presented briefly to outline the some of the issues in each approach. In addition, a discussion regarding to inertial tracking sensors gives an insight to the basic science and limitations in each of the sensing components. An initial experiment was conducted with existing inertial tracker to study the feasibility of using this technology in human motion tracking. Several areas of improvement were made based on the results and analyses from the experiment. As the performance of the system relies on multiple factors from different disciplines, the only viable solution is to optimize the performance in each area. Hence, a top-down approach was used in developing this system. The implementations of the new generation of hardware system design and firmware structure are presented in this dissertation. The calibration of the system, which is one of the most important factors to minimize the estimation error to the system, is also discussed in details. A practical approach using sequential Monte Carlo method with hyper-dimensional statistical geometry is taken to develop the algorithm for recursive estimation with quaternions. An analysis conducted from a simulation study provides insights to the capability of the new algorithms. An extensive testing and experiments was conducted with robotic manipulator and free hand human motion to demonstrate the improvements with the new generation of inertial tracker and the accuracy and stability of the algorithm. In addition, the tracking unit is used to demonstrate the potential in multiple biomedical applications including kinematics tracking and diagnosis instrumentation. The inertial tracking technologies presented in this dissertation is aimed to use specifically for human motion tracking. The goal is to integrate this technology into the next generation of medical diagnostic system