Estimating Epipolar Geometry With The Use of a Camera Mounted Orientation Sensor

Context: Image processing and computer vision are rapidly becoming more and more commonplace, and the amount of information about a scene, such as 3D geometry, that can be obtained from an image, or multiple images of the scene is steadily increasing due to increasing resolutions and availability of imaging sensors, and an active research community. In parallel, advances in hardware design and manufacturing are allowing for devices such as gyroscopes, accelerometers and magnetometers and GPS receivers to be included alongside imaging devices at a consumer level. Aims: This work aims to investigate the use of orientation sensors in the field of computer vision as sources of data to aid with image processing and the determination of a scene’s geometry, in particular, the epipolar geometry of a pair of images - and devises a hybrid methodology from two sets of previous works in order to exploit the information available from orientation sensors alongside data gathered from image processing techniques. Method: A readily available consumer-level orientation sensor was used alongside a digital camera to capture images of a set of scenes and record the orientation of the camera. The fundamental matrix of these pairs of images was calculated using a variety of techniques - both incorporating data from the orientation sensor and excluding its use Results: Some methodologies could not produce an acceptable result for the Fundamental Matrix on certain image pairs, however, a method described in the literature that used an orientation sensor always produced a result - however in cases where the hybrid or purely computer vision methods also produced a result - this was found to be the least accurate. Conclusion: Results from this work show that the use of an orientation sensor to capture information alongside an imaging device can be used to improve both the accuracy and reliability of calculations of the scene’s geometry - however noise from the orientation sensor can limit this accuracy and further research would be needed to determine the magnitude of this problem and methods of mitigation

Compensation of Magnetic Disturbances Improves Inertial and Magnetic Sensing of Human Body Segment Orientation

This paper describes a complementary Kalman filter design to estimate orientation of human body segments by fusing gyroscope, accelerometer, and magnetometer signals from miniature sensors. Ferromagnetic materials or other magnetic fields near the sensor module disturb the local earth magnetic field and, therefore, the orientation estimation, which impedes many (ambulatory) applications. In the filter, the gyroscope bias error, orientation error, and magnetic disturbance error are estimated. The filter was tested under quasi-static and dynamic conditions with ferromagnetic materials close to the sensor module. The quasi-static experiments implied static positions and rotations around the three axes. In the dynamic experiments, three-dimensional rotations were performed near a metal tool case. The orientation estimated by the filter was compared with the orientation obtained with an optical reference system Vicon. Results show accurate and drift-free orientation estimates. The compensation results in a significant difference (p<0.01) between the orientation estimates with compensation of magnetic disturbances in comparison to no compensation or only gyroscopes. The average static error was 1.4/spl deg/ (standard deviation 0.4) in the magnetically disturbed experiments. The dynamic error was 2.6/spl deg/ root means square

Estimating Human Movement Using Accelerometers

Tato práce je zaměřena na analýzu lidského pohybu, zejména měření úhlu kolena, co je důležité především při procesu rehabilitace u pacientů s protézy kolenního kloubu nebo po operaci. Pro měření IMU - inerciální měřící jednotky od firmy Xsens jsou použité, přičemž pouze data z 3-osého akcelerometru a gyroskopu jsou zahrnuty. Vhodné umístění jednotek je vybráno, jakož i metody pro kalibraci a následný výpočet úhlu ze zaznamenaných dat. Tyhle metody jsou implementovány a experimentálně ověřeny. Experimenty ukazují, že výsledky jsou docela přesné, a toto řešení je použitelné při analýze pacientů například provedením monitorování chůze.This work is aimed at analysis of human movement, especially measurement of knee angle, which is important data for monitoring in process of rehabilitation on patients with knee arthroplasty or after surgery. For measurement IMUs - Inertial Measurement Units from Xsens are used, while only data from 3-axis accelerometer and gyroscope are gathered. Appropriate unit position is chosen, as well as methods for calibration and angle calculation from stored measured data. These methods are implemented and experimentally validated. Experiments shows, that results are pretty accurate and this solution is useful in analysis of patients for example by doing gait analysis.

Magnetic Local Positioning System with Supplemental Magnetometer-Accelerometer Data Fusion

Geo-location and tracking technology, once confined to the industrial and military sectors, have been widely proliferated to the consumer world since early in the twenty-first century. The commoditization of Global Positioning System (GPS) and inertial measurement integrated circuits has made this possible, with devices small enough to fit in a cellular phone. However, GPS technology is not without its drawbacks: Its power use is high, and it can fail in smaller, obstructed spaces. Magnetic positioning, which exploits the magnetic field coupling between a set of transmitter beacon coils and a set of receiver coils, is an often overlooked, complementary technology that does not suffer from these problems. Magnetic positioning is strong where GPS is weak; however, it has some weaknesses of its own. Namely, it is subject to distortions due to metal objects in its immediate vicinity. In much of the prior art, these distortions are ignored or either statically measured and then corrected. This work presents a novel technique to dynamically correct for distorted fields. Specifically, a tri-axial magnetometer and a tri-axial accelerometer are integrated with the magnetic positioning system using a complementary Kalman filter. The end result resembles a tightly-coupled integrated GPS/inertial navigation system. The results achieved by this integrated magnetic positioning system prove the viability of the approach. The results are demonstrated in a real-world environment, where both strong, localized distortions and spatially broad distortions are corrected. In addition to the integrated magnetic position system, this work presents a novel scheme for calibrating the magnetic receiver; this technique is termed application domain calibration. In many real-world situations, low-level measurement and calibration will not be possible; therefore, this new technique uses the same set of demodulated and down-mixed data that is used by the magnetic positioning algorithms

Validation of Non-Restrictive Inertial Gait Analysis of Individuals with Incomplete Spinal Cord Injury in Clinical Settings

Inertial Measurement Units (IMUs) have gained popularity in gait analysis and human motion tracking, and they provide certain advantages over stationary line-of-sight-dependent Optical Motion Capture (OMC) systems. IMUs appear as an appropriate alternative solution to reduce dependency on bulky, room-based hardware and facilitate the analysis of walking patterns in clinical settings and daily life activities. However, most inertial gait analysis methods are unpractical in clinical settings due to the necessity of precise sensor placement, the need for well-performed calibration movements and poses, and due to distorted magnetometer data in indoor environments as well as nearby ferromagnetic material and electronic devices. To address these limitations, recent literature has proposed methods for self-calibrating magnetometer-free inertial motion tracking, and acceptable performance has been achieved in mechanical joints and in individuals without neurological disorders. However, the performance of such methods has not been validated in clinical settings for individuals with neurological disorders, specifically individuals with incomplete Spinal Cord Injury (iSCI). In the present study, we used recently proposed inertial motion-tracking methods, which avoid magnetometer data and leverage kinematic constraints for anatomical calibration. We used these methods to determine the range of motion of the Flexion/Extension (F/E) hip and Abduction/Adduction (A/A) angles, the F/E knee angles, and the Dorsi/Plantar (D/P) flexion ankle joint angles during walking. Data (IMU and OMC) of five individuals with no neurological disorders (control group) and five participants with iSCI walking for two minutes on a treadmill in a self-paced mode were analyzed. For validation purposes, the OMC system was considered as a reference. The mean absolute difference (MAD) between calculated range of motion of joint angles was 5.00°, 5.02°, 5.26°, and 3.72° for hip F/E, hip A/A, knee F/E, and ankle D/P flexion angles, respectively. In addition, relative stance, swing, double support phases, and cadence were calculated and validated. The MAD for the relative gait phases (stance, swing, and double support) was 1.7%, and the average cadence error was 0.09 steps/min. The MAD values for RoM and relative gait phases can be considered as clinically acceptable. Therefore, we conclude that the proposed methodology is promising, enabling non-restrictive inertial gait analysis in clinical settings

Doctor of Philosophy

dissertationMotion capture has applications in many fields. A need has arisen for motion capture systems that are low-cost, mobile, and intuitive. An attitude heading reference system (AHRS) calculates the global orientation of a rigid body by synthesizing the output from an array of sensors. A complete motion capture system utilizing gyroscopes, accelerometers, and magnetometers attached to the main body segments of a human is proposed. This is accomplished by providind a low-cost calibration procedure for micro electro-mechanical system (MEMS) gyroscopes, accelerometers, and magnetometers in order to create a custom AHRS unit. The accuracy of reproducing global orientations using these AHRS units is analyzed for individual modules as well as redundant groups of AHRS nodes for increased accuracy. In order to make the system intuitive, a localization procedure for finding the locations of all AHRS units attached to the body is proposed. Sensors were successfully calibrated to an accuracy sufficient for AHRS development. The accuracy of the AHRS units was verified and led to a functioning motion capture system. The localization procedure was verified with volunteer subjects and successfully finds the location of all attached AHRS units

Methods and good practice guidelines for human joint kinematics estimation through magnetic and inertial wearable sensors

According to the World Health Organization, the ability to move is recognized as a key factor for the human well-being. From the wearable Magnetic and Inertial Measurement Units (MIMUs) signals it is possible to extract several digital mobility outcomes including the joint kinematics. To this end, it is first required to estimate the orientation of the MIMUs by means of a sensor fusion algorithm (SFA). After that, the relative orientation is computed and then decomposed to obtain the joint angles. However, the MIMUs do not provide a direct output of the physical quantity of interest which can be only determined after an ad hoc processing of their signals. It follows that the joint angle accuracy mostly depends on multiple factors. The first one is the magnitude of the MIMU measurements errors and up to date there is still a lack of methods for their characterization. A second crucial factor is the choice of the SFA to use. Despite the abundance of formulations in the literature, no-well established conclusions about their accuracy have been reached yet. The last factor is the biomechanical model used to compute the joint angles. In this context, unconstrained methods offer a simple way to decompose the relative orientation using the Euler angles but suffer from the inherent issues related to the SFA. In contrast, constrained approaches aim at increasing the robustness of the estimates by adopting models in which an objective function is minimized through the definition of physiological constraints. This thesis proposed the methods to accurately estimate the human joint kinematics starting from the MIMU signals. Three main contributions were provided. The first consisted in the design of a comprehensive battery of tests to completely characterize the sources of errors affecting the quality of the measurements. These tests rely on simple hypotheses based on the sensor working principles and do not require expensive equipment. Nine parameters were defined to quantify the signal accuracy improvements (if any) of 24 MIMUs before and after the refinement of their calibration coefficients. The second contribution was focused on the SFAs. Ten among the most popular SFAs were compared under different experimental conditions including different MIMU models and rotation rate magnitudes. To perform a “fair” comparison it was necessary to set the optimal parameter values for each SFA. The most important finding was that all the errors fall within a range from 3.8 deg to 7.1 deg thus making it impossible to draw any conclusions about the best performing SFA since no statistically significant differences were found. In addition, the orientation accuracy was heavily influenced by the experimental variables. After that, a novel method was designed to estimate the suboptimal parameter values of a given SFA without relying on any orientation reference. The maximum difference between the errors obtained using optimal and suboptimal parameter values amounted to 3.7 deg and to 0.6 deg on average. The last contribution consisted in the design of an unconstrained and a constrained methods for estimating the joint kinematics without considering the magnetometer to avoid the ferromagnetic disturbances. The unconstrained method was employed in a telerehabilitation platform in which the joint angles were estimated in real time. Errors collected during the execution of a full-body protocol were lower than 5 deg (considered the acceptability threshold). However, this method may be inaccurate after few minutes since no solutions can be taken to mitigate the drift error. To overcome this limitation a constrained method was developed based on a robotic model of the upper limb to set appropriate constraints. Errors relative to a continuous robot motion for twenty minutes were lower than 3 deg at most suggesting the feasibility of employing these solutions in the rehabilitation programs to properly plan the treatment and to accurately evaluate the outcomes