Single camera pose estimation using Bayesian filtering and Kinect motion priors

Traditional approaches to upper body pose estimation using monocular vision rely on complex body models and a large variety of geometric constraints. We argue that this is not ideal and somewhat inelegant as it results in large processing burdens, and instead attempt to incorporate these constraints through priors obtained directly from training data. A prior distribution covering the probability of a human pose occurring is used to incorporate likely human poses. This distribution is obtained offline, by fitting a Gaussian mixture model to a large dataset of recorded human body poses, tracked using a Kinect sensor. We combine this prior information with a random walk transition model to obtain an upper body model, suitable for use within a recursive Bayesian filtering framework. Our model can be viewed as a mixture of discrete Ornstein-Uhlenbeck processes, in that states behave as random walks, but drift towards a set of typically observed poses. This model is combined with measurements of the human head and hand positions, using recursive Bayesian estimation to incorporate temporal information. Measurements are obtained using face detection and a simple skin colour hand detector, trained using the detected face. The suggested model is designed with analytical tractability in mind and we show that the pose tracking can be Rao-Blackwellised using the mixture Kalman filter, allowing for computational efficiency while still incorporating bio-mechanical properties of the upper body. In addition, the use of the proposed upper body model allows reliable three-dimensional pose estimates to be obtained indirectly for a number of joints that are often difficult to detect using traditional object recognition strategies. Comparisons with Kinect sensor results and the state of the art in 2D pose estimation highlight the efficacy of the proposed approach.Comment: 25 pages, Technical report, related to Burke and Lasenby, AMDO 2014 conference paper. Code sample: https://github.com/mgb45/SignerBodyPose Video: https://www.youtube.com/watch?v=dJMTSo7-uF

An Indoor Navigation System Using a Sensor Fusion Scheme on Android Platform

With the development of wireless communication networks, smart phones have become a necessity for people’s daily lives, and they meet not only the needs of basic functions for users such as sending a message or making a phone call, but also the users’ demands for entertainment, surfing the Internet and socializing. Navigation functions have been commonly utilized, however the navigation function is often based on GPS (Global Positioning System) in outdoor environments, whereas a number of applications need to navigate indoors. This paper presents a system to achieve high accurate indoor navigation based on Android platform. To do this, we design a sensor fusion scheme for our system. We divide the system into three main modules: distance measurement module, orientation detection module and position update module. We use an efficient way to estimate the stride length and use step sensor to count steps in distance measurement module. For orientation detection module, in order to get the optimal result of orientation, we then introduce Kalman filter to de-noise the data collected from different sensors. In the last module, we combine the data from the previous modules and calculate the current location. Results of experiments show that our system works well and has high accuracy in indoor situations

Motion patterns of subviral particles: Digital tracking, image data processing and analysis

At the Institute of Virology, Philipps-University, Marburg, Germany, currently research on the understanding of the transport mechanisms of Ebola- and Marburgvirus nucleocapsids is carried out. This research demands a profound knowledge about the various motion characteristics of the nucleocapids. The analysis of large amounts of samples by conventional manual evaluation is a laborious task and does not always lead to reproducible and comparable results. In a cooperation between the Institute of Virology, Marburg, and the Institute for Biomedical Engineering, University of Applied Sciences, Giessen, Germany, algorithms are developed and programmed that enable an automatic tracking of subviral particles in fluorescence microscopic image sequences. The algorithms form an interface between the biologic and the algorithmic domain. Furthermore, methods to automatically parameterize and classify subviral particle motions are created. Geometric and mathematical approaches, like curvature-, fractal dimension- and mean squared displacement-determination are applied. Statistical methods are used to compare the measured subviral particle motion parameters between different biological samples. In this thesis, the biological, mathematical and algorithmic basics are described and the state of the art methods of other research groups are presented and compared. The algorithms to track, parameterize, classify and statistically analyze subviral particle tracks are presented in the Methods section. All methods are evaluated with simulated data and/or compared to data validated by a virologist. The methods are applied to a set of real fluorescence microscopic image sequences of Marburgvirus infected live-cells. The Results chapter shows that subviral particle motion can be successfully analyzed using the presented tracking and analysis methods. Furthermore, differences between the subviral particle motions in the analyzed groups could be detected. However, further optimization with manually evaluated data can improve the results. The methods developed in this project enhance the knowledge about nucleocapsid transport and may be valuable for the development of effective antiviral agents to cure Ebola- and Marburgvirus diseases. The thesis concludes with a chapter Discussion and Conclusions

Robust Multi-sensor Data Fusion for Practical Unmanned Surface Vehicles (USVs) Navigation

The development of practical Unmanned Surface Vehicles (USVs) are attracting increasing attention driven by their assorted military and commercial application potential. However, addressing the uncertainties presented in practical navigational sensor measurements of an USV in maritime environment remain the main challenge of the development. This research aims to develop a multi-sensor data fusion system to autonomously provide an USV reliable navigational information on its own positions and headings as well as to detect dynamic target ships in the surrounding environment in a holistic fashion. A multi-sensor data fusion algorithm based on Unscented Kalman Filter (UKF) has been developed to generate more accurate estimations of USV’s navigational data considering practical environmental disturbances. A novel covariance matching adaptive estimation algorithm has been proposed to deal with the issues caused by unknown and varying sensor noise in practice to improve system robustness. Certain measures have been designed to determine the system reliability numerically, to recover USV trajectory during short term sensor signal loss, and to autonomously detect and discard permanently malfunctioned sensors, and thereby enabling potential sensor faults tolerance. The performance of the algorithms have been assessed by carrying out theoretical simulations as well as using experimental data collected from a real-world USV projected collaborated with Plymouth University. To increase the degree of autonomy of USVs in perceiving surrounding environments, target detection and prediction algorithms using an Automatic Identification System (AIS) in conjunction with a marine radar have been proposed to provide full detections of multiple dynamic targets in a wider coverage range, remedying the narrow detection range and sensor uncertainties of the AIS. The detection algorithms have been validated in simulations using practical environments with water current effects. The performance of developed multi-senor data fusion system in providing reliable navigational data and perceiving surrounding environment for USV navigation have been comprehensively demonstrated

Multi-source Information Fusion Technology and Its Engineering Application

With the continuous development of information technology in recent years, information fusion technology, which originated from military applications, plays an important role in various fields. In addition, the rapidly increasing amount of data and the changing lifestyles of people in the information age are affecting the development of information fusion technology. More experts and scholars have focused their attention on the research of image or audio and video fusion or distributed fusion technology. This article summarizes the origin and development of information fusion technology and typical algorithms, as well as the future development trends and challenges of information fusion technology

Extracting fetal heart beats from maternal abdominal recordings: Selection of the optimal principal components

This study presents a systematic comparison of different approaches to the automated selection of the principal components (PC) which optimise the detection of maternal and fetal heart beats from non-invasive maternal abdominal recordings. A public database of 75 4-channel non-invasive maternal abdominal recordings was used for training the algorithm. Four methods were developed and assessed to determine the optimal PC: (1) power spectral distribution, (2) root mean square, (3) sample entropy, and (4) QRS template. The sensitivity of the performance of the algorithm to large-amplitude noise removal (by wavelet de-noising) and maternal beat cancellation methods were also assessed. The accuracy of maternal and fetal beat detection was assessed against reference annotations and quantified using the detection accuracy score F1 [2*PPV*Se / (PPV + Se)], sensitivity (Se), and positive predictive value (PPV). The best performing implementation was assessed on a test dataset of 100 recordings and the agreement between the computed and the reference fetal heart rate (fHR) and fetal RR (fRR) time series quantified. The best performance for detecting maternal beats (F1 99.3%, Se 99.0%, PPV 99.7%) was obtained when using the QRS template method to select the optimal maternal PC and applying wavelet de-noising. The best performance for detecting fetal beats (F1 89.8%, Se 89.3%, PPV 90.5%) was obtained when the optimal fetal PC was selected using the sample entropy method and utilising a fixed-length time window for the cancellation of the maternal beats. The performance on the test dataset was 142.7 beats2/min2 for fHR and 19.9 ms for fRR, ranking respectively 14 and 17 (out of 29) when compared to the other algorithms presented at the Physionet Challenge 2013

Multi-sensor data fusion techniques for RPAS detect, track and avoid

Accurate and robust tracking of objects is of growing interest amongst the computer vision scientific community. The ability of a multi-sensor system to detect and track objects, and accurately predict their future trajectory is critical in the context of mission- and safety-critical applications. Remotely Piloted Aircraft System (RPAS) are currently not equipped to routinely access all classes of airspace since certified Detect-and-Avoid (DAA) systems are yet to be developed. Such capabilities can be achieved by incorporating both cooperative and non-cooperative DAA functions, as well as providing enhanced communications, navigation and surveillance (CNS) services. DAA is highly dependent on the performance of CNS systems for Detection, Tacking and avoiding (DTA) tasks and maneuvers. In order to perform an effective detection of objects, a number of high performance, reliable and accurate avionics sensors and systems are adopted including non-cooperative sensors (visual and thermal cameras, Laser radar (LIDAR) and acoustic sensors) and cooperative systems (Automatic Dependent Surveillance-Broadcast (ADS-B) and Traffic Collision Avoidance System (TCAS)). In this paper the sensors and system information candidates are fully exploited in a Multi-Sensor Data Fusion (MSDF) architecture. An Unscented Kalman Filter (UKF) and a more advanced Particle Filter (PF) are adopted to estimate the state vector of the objects based for maneuvering and non-maneuvering DTA tasks. Furthermore, an artificial neural network is conceptualised/adopted to exploit the use of statistical learning methods, which acts to combined information obtained from the UKF and PF. After describing the MSDF architecture, the key mathematical models for data fusion are presented. Conceptual studies are carried out on visual and thermal image fusion architectures

Estimation of Vehicle Roll Angle

Haldex Traction can with their Active Yaw Control prevent unwanted handling by applying an extra yaw torque with their all wheel drive system. To be able to calculate when or when not, yaw torque should be applied, it is important to accurate know the different state information about the vehicle. When driving on banked roads, vehicle dynamics and sensor measurements are changed compared to driving on a flat surface. Because of this it is desirable to know the degree of banking the vehicle is exposed to. The estimation of the banking is made with sensors already present in modern production cars; lateral accelerometer, yaw rate gyro, steering wheel angle and longitudinal velocity. This by isolating the part of the measured lateral acceleration that is derived from the normal forces due to gravity. To be able to make a good and stable estimation it is necessary to also estimate the vehicle's lateral velocity, and especially its derivative. This is done by estimating vehicle states with a single track bicycle model. The model has been used in former thesis works, but it was in this thesis extended with the angle of the road as a parameter. Two different observers have been evaluated for measurement update of the model; Extended Kalman filter (EKF) and an Averaging observer. Evaluation of the algorithms have been done in Haldex simulator VehSim running in Matlab/Simulink and real measurements from a test vehicle