Improved Leg Tracking Considering Gait Phase and Spline-Based Interpolation during Turning Motion in Walk Tests

Falling is a common problem in the growing elderly population, and fall-risk assessment systems are needed for community-based fall prevention programs. In particular, the timed up and go test (TUG) is the clinical test most often used to evaluate elderly individual ambulatory ability in many clinical institutions or local communities. This study presents an improved leg tracking method using a laser range sensor (LRS) for a gait measurement system to evaluate the motor function in walk tests, such as the TUG. The system tracks both legs and measures the trajectory of both legs. However, both legs might be close to each other, and one leg might be hidden from the sensor. This is especially the case during the turning motion in the TUG, where the time that a leg is hidden from the LRS is longer than that during straight walking and the moving direction rapidly changes. These situations are likely to lead to false tracking and deteriorate the measurement accuracy of the leg positions. To solve these problems, a novel data association considering gait phase and a Catmull–Rom spline-based interpolation during the occlusion are proposed. From the experimental results with young people, we confirm that the proposed methods can reduce the chances of false tracking. In addition, we verify the measurement accuracy of the leg trajectory compared to a three-dimensional motion analysis system (VICON)

Gait Measurement System for the Multi-Target Stepping Task Using a Laser Range Sensor

For the prevention of falling in the elderly, gait training has been proposed using tasks such as the multi-target stepping task (MTST), in which participants step on assigned colored targets. This study presents a gait measurement system using a laser range sensor for the MTST to evaluate the risk of falling. The system tracks both legs and measures general walking parameters such as stride length and walking speed. Additionally, it judges whether the participant steps on the assigned colored targets and detects cross steps to evaluate cognitive function. However, situations in which one leg is hidden from the sensor or the legs are close occur and are likely to lead to losing track of the legs or false tracking. To solve these problems, we propose a novel leg detection method with five observed leg patterns and global nearest neighbor-based data association with a variable validation region based on the state of each leg. In addition, methods to judge target steps and detect cross steps based on leg trajectory are proposed. From the experimental results with the elderly, it is confirmed that the proposed system can improve leg-tracking performance, judge target steps and detect cross steps with high accuracy

Simultaneous Dual-Arm Motion Planning for Minimizing Operation Time

Dual-arm robots are expected to perform work in a dynamic environment. One of the most basic tasks that a dual-arm robot does is pick-and-place work. However, this work is more complicated when there are several objects in the robot’s workspace. Additionally, it is likely to take a long time to finish the work as the number of objects increases. Therefore, we propose a method using a combination of two approaches to achieve efficient pick-and-place performance by a dual-arm robot to minimize its operation time. First, we use mixed integer linear programming (MILP) for the pick-and-place work to determine which arm should move an object and in which order these objects should be moved while considering the dual-arm robot’s operation range. Second, we plan the path using the rapidly exploring random tree so that the arms do not collide, enabling the robot to perform efficient pick-and-place work based on the MILP planning solution. The effectiveness of the proposed method is confirmed by simulations and experiments using an actual dual-arm robot

Driving Control of a Powered Wheelchair Considering Uncertainty of Gaze Input in an Unknown Environment

This paper describes the motion control system for a powered wheelchair using eye gaze in an unknown environment. Recently, new Human-Computer Interfaces (HCIs) that have replaced joysticks have been developed for a person with a disability of the upper body. In this paper, movement of the eyes is used as an HCI. The wheelchair control system proposed in this study aims to achieve an operation such that a passenger gazes towards the direction he or she wants to move in the unknown environment. Implementation of such an operating method facilitates easy and accurate movement of the wheelchair even in complicated environments comprising passages on the same side. This paper presents a system based on gaze detection and environment recognition that are integrated by the fuzzy set theory in real time. In the fuzzy set theory, we achieve the movement to the passage which a passenger gazes towards among some passages by integrating the information of some passages and gaze. Moreover, we design it with consideration of uncertain gaze input by using the value of gaze detection accuracy. Moreover, we achieve obstacle avoidance by integrating the information of obstacles. This motion control system can support safe and smooth movement of the wheelchair by automatically calculating its direction of motion and velocity, to avoid obstacles and move in the gaze direction of the passenger. The effectiveness of the proposed system is demonstrated through experiments in a real environment

Improved Leg Tracking Considering Gait Phase and Spline-Based Interpolation during Turning Motion in Walk Tests

Falling is a common problem in the growing elderly population, and fall-risk assessment systems are needed for community-based fall prevention programs. In particular, the timed up and go test (TUG) is the clinical test most often used to evaluate elderly individual ambulatory ability in many clinical institutions or local communities. This study presents an improved leg tracking method using a laser range sensor (LRS) for a gait measurement system to evaluate the motor function in walk tests, such as the TUG. The system tracks both legs and measures the trajectory of both legs. However, both legs might be close to each other, and one leg might be hidden from the sensor. This is especially the case during the turning motion in the TUG, where the time that a leg is hidden from the LRS is longer than that during straight walking and the moving direction rapidly changes. These situations are likely to lead to false tracking and deteriorate the measurement accuracy of the leg positions. To solve these problems, a novel data association considering gait phase and a Catmull–Rom spline-based interpolation during the occlusion are proposed. From the experimental results with young people, we confirm   that the proposed methods can reduce the chances of false tracking. In addition, we verify the measurement accuracy of the leg trajectory compared to a three-dimensional motion analysis system (VICON)

Markerless Knee Joint Position Measurement Using Depth Data during Stair Walking

Climbing and descending stairs are demanding daily activities, and the monitoring of them may reveal the presence of musculoskeletal diseases at an early stage. A markerless system is needed to monitor such stair walking activity without mentally or physically disturbing the subject. Microsoft Kinect v2 has been used for gait monitoring, as it provides a markerless skeleton tracking function. However, few studies have used this device for stair walking monitoring, and the accuracy of its skeleton tracking function during stair walking has not been evaluated. Moreover, skeleton tracking is not likely to be suitable for estimating body joints during stair walking, as the form of the body is different from what it is when it walks on level surfaces. In this study, a new method of estimating the 3D position of the knee joint was devised that uses the depth data of Kinect v2. The accuracy of this method was compared with that of the skeleton tracking function of Kinect v2 by simultaneously measuring subjects with a 3D motion capture system. The depth data method was found to be more accurate than skeleton tracking. The mean error of the 3D Euclidian distance of the depth data method was 43.2 ± 27.5 mm, while that of the skeleton tracking was 50.4 ± 23.9 mm. This method indicates the possibility of stair walking monitoring for the early discovery of musculoskeletal diseases

Association between mild cognitive impairment and trajectory-based spatial parameters during timed up and go test using a laser range sensor

Abstract Background The Timed Up and Go (TUG) test may be a useful tool to detect not only mobility impairment but also possible cognitive impairment. In this cross-sectional study, we used the TUG test to investigate the associations between trajectory-based spatial parameters measured by laser range sensor (LRS) and cognitive impairment in community-dwelling older adults. Methods The participants were 63 community-dwelling older adults (mean age, 73.0 ± 6.3 years). The trajectory-based spatial parameters during the TUG test were measured using an LRS. In each forward and backward phase, we calculated the minimum distance from the marker, the maximum distance from the x-axis (center line), the length of the trajectories, and the area of region surrounded by the trajectory of the center of gravity and the x-axis (center line). We measured mild cognitive impairment using the Mini-Mental State Examination score (26/27 was the cut-off score for defining mild cognitive impairment). Results Compared with participants with normal cognitive function, those with mild cognitive impairment exhibited the following trajectory-based spatial parameters: short minimum distance from the marker (p = 0.044), narrow area of center of gravity in the forward phase (p = 0.012), and a large forward/whole phase ratio of the area of the center of gravity (p = 0.026) during the TUG test. In multivariate logistic regression analyses, a short minimum distance from the marker (odds ratio [OR]: 0.82, 95% confidence interval [CI]: 0.69–0.98), narrow area of the center of gravity in the forward phase (OR: 0.01, 95% CI: 0.00–0.36), and large forward/whole phase ratio of the area of the center of gravity (OR: 0.94, 95% CI: 0.88–0.99) were independently associated with mild cognitive impairment. Conclusions In conclusion, our results indicate that some of the trajectory-based spatial parameters measured by LRS during the TUG test were independently associated with cognitive impairment in older adults. In particular, older adults with cognitive impairment exhibit shorter minimum distances from the marker and asymmetrical trajectories during the TUG test

Gait Measurement System for the Multi-Target Stepping Task Using a Laser Range Sensor

For the prevention of falling in the elderly, gait training has been proposed using tasks such as the multi-target stepping task (MTST), in which participants step on assigned colored targets. This study presents a gait measurement system using a laser range sensor for the MTST to evaluate the risk of falling. The system tracks both legs and measures general walking parameters such as stride length and walking speed. Additionally, it judges whether the participant steps on the assigned colored targets and detects cross steps to evaluate cognitive function. However, situations in which one leg is hidden from the sensor or the legs are close occur and are likely to lead to losing track of the legs or false tracking. To solve these problems, we propose a novel leg detection method with five observed leg patterns and global nearest neighbor-based data association with a variable validation region based on the state of each leg. In addition, methods to judge target steps and detect cross steps based on leg trajectory are proposed. From the experimental results with the elderly, it is confirmed that the proposed system can improve leg-tracking performance, judge target steps and detect cross steps with high accuracy