Fusing inertial sensor data in an extended kalman filter for 3D camera tracking

Due to copyright restrictions, the access to the full text of this article is only available via subscription.In a setup where camera measurements are used to estimate 3D egomotion in an extended Kalman filter (EKF) framework, it is well-known that inertial sensors (i.e., accelerometers and gyroscopes) are especially useful when the camera undergoes fast motion. Inertial sensor data can be fused at the EKF with the camera measurements in either the correction stage (as measurement inputs) or the prediction stage (as control inputs). In general, only one type of inertial sensor is employed in the EKF in the literature, or when both are employed they are both fused in the same stage. In this paper, we provide an extensive performance comparison of every possible combination of fusing accelerometer and gyroscope data as control or measurement inputs using the same data set collected at different motion speeds. In particular, we compare the performances of different approaches based on 3D pose errors, in addition to camera reprojection errors commonly found in the literature, which provides further insight into the strengths and weaknesses of different approaches. We show using both simulated and real data that it is always better to fuse both sensors in the measurement stage and that in particular, accelerometer helps more with the 3D position tracking accuracy, whereas gyroscope helps more with the 3D orientation tracking accuracy. We also propose a simulated data generation method, which is beneficial for the design and validation of tracking algorithms involving both camera and inertial measurement unit measurements in general.TÜBİTA

Smart Localization Using a New Sensor Association Framework for Outdoor Augmented Reality Systems

Augmented Reality (AR) aims at enhancing our the real world, by adding fictitious elements that are not perceptible naturally such as: computer-generated images, virtual objects, texts, symbols, graphics, sounds, and smells. The quality of the real/virtual registration depends mainly on the accuracy of the 3D camera pose estimation. In this paper, we present an original real-time localization system for outdoor AR which combines three heterogeneous sensors: a camera, a GPS, and an inertial sensor. The proposed system is subdivided into two modules: the main module is vision based; it estimates the user’s location using a markerless tracking method. When the visual tracking fails, the system switches automatically to the secondary localization module composed of the GPS and the inertial sensor

Low Cost Inertial Sensors for the Motion Track-ing and Orientation Estimation of Human Upper Limbs in Neurological Rehabilitation

This paper presents the feasibility of utilizing low cost inertial sensors such as those found in Sony Move, Nintendo Wii (Wii Remote with Wii MotionPlus) and smartphones for upper limb motion mon-itoring in neurorehabilitation. Kalman and complementary filters based on data fusion are used to estimate sensor 3D orientation. Furthermore, a two-segment kinematic model was developed to estimate limb segment position tracking. Performance has been compared with a high-accuracy measurement system using the Xsens MTx. The experimental results show that Sony Move, Wii and smartphones can be used for measuring upper limb orientation, while Sony Move and smartphones can also be used for specific applications of upper limb segment joint orientation and position tracking during neurorehabilitation. Sony Move’s accuracy is within 1.5° for Roll and Pitch and 2.5° for Yaw and position tracking to within 0.5 cm over a 10 cm movement. This accuracy in measurement is thought to be adequate for upper limb orientation and position tracking. Low cost inertial sensors can be used for the accurate assessment/measurement of upper limb movement of patients with neurological disorders and also makes it a low cost replacement for upper limb motion measurements. The low cost inertial sensing systems were shown to be able to accurately measure upper limb joint orienta-tion and position during neurorehabilitation

Vision-Aided Inertial Navigation

This document discloses, among other things, a system and method for implementing an algorithm to determine pose, velocity, acceleration or other navigation information using feature tracking data. The algorithm has computational complexity that is linear with the number of features tracked