Ego-Downward and Ambient Video based Person Location Association

Using an ego-centric camera to do localization and tracking is highly needed for urban navigation and indoor assistive system when GPS is not available or not accurate enough. The traditional hand-designed feature tracking and estimation approach would fail without visible features. Recently, there are several works exploring to use context features to do localization. However, all of these suffer severe accuracy loss if given no visual context information. To provide a possible solution to this problem, this paper proposes a camera system with both ego-downward and third-static view to perform localization and tracking in a learning approach. Besides, we also proposed a novel action and motion verification model for cross-view verification and localization. We performed comparative experiments based on our collected dataset which considers the same dressing, gender, and background diversity. Results indicate that the proposed model can achieve $18.32 \%$ improvement in accuracy performance. Eventually, we tested the model on multi-people scenarios and obtained an average $67.767 \%$ accuracy

An Analytical Approach for Comparing Linearization Methods in EKF and UKF

The transformation of the mean and variance of a normally distributed random variable was considered through three different nonlinear functions: sin(x), cos(x), and xk, where k is a positive integer. The true mean and variance of the random variable after these transformations is theoretically derived within, and verified with respect to Monte Carlo experiments. These statistics are used as a reference in order to compare the accuracy of two different linearization techniques: analytical linearization used in the Extended Kalman Filter (EKF) and statistical linearization used in the Unscented Kalman Filter (UKF). This comparison demonstrated the advantage of using the unscented transformation in estimating the mean after transforming through each of the considered nonlinear functions. However, the variance estimation led to mixed results in terms of which linearization technique provided the best performance. As an additional analysis, the unscented transformation was evaluated with respect to its primary scaling parameter. A nonlinear filtering example is presented to demonstrate the usefulness of the theoretically derived results

PWM and PFM for visual servoing in fully decoupled approaches

In this paper, novel visual servoing techniques based on Pulse Width Modulation (PWM) and Pulse Frequency Modulation (PFM) are presented. In order to apply previous pulse modulations, a fully decoupled position based visual servoing approach (i.e. with block-diagonal interaction matrix) is considered, controlling independently translational and rotational camera motions. These techniques, working at high frequency, could be considered to address the sensor latency problem inherent in visual servoing systems. The expected appearance of ripple due to the concentration of the control action in pulses is quantified and analyzed under simulated scenario. This high frequency ripple does not affect the system performance since it is filtered by the manipulator dynamics. On the contrary it can be seen as a dither signal to minimize the impact of friction and overcome back-lashing.This work was supported in part by the Spanish Government under Grant BES-2010-038486 and Project DPI2013-42302-R.Muñoz Benavent, P.; Solanes Galbis, JE.; Gracia Calandin, LI.; Tornero Montserrat, J. (2015). PWM and PFM for visual servoing in fully decoupled approaches. Robotics and Autonomous Systems. 65(1):57-64. doi:10.1016/j.robot.2014.11.011S576465

An Analytical Approach for Comparing Linearization Methods in EKF and UKF

The transformation of the mean and variance of a normally distributed random variable was considered through three different nonlinear functions: sin(x), cos(x), and xk, where k is a positive integer. The true mean and variance of the random variable after these transformations is theoretically derived within, and verified with respect to Monte Carlo experiments. These statistics are used as a reference in order to compare the accuracy of two different linearization techniques: analytical linearization used in the Extended Kalman Filter (EKF) and statistical linearization used in the Unscented Kalman Filter (UKF). This comparison demonstrated the advantage of using the unscented transformation in estimating the mean after transforming through each of the considered nonlinear functions. However, the variance estimation led to mixed results in terms of which linearization technique provided the best performance. As an additional analysis, the unscented transformation was evaluated with respect to its primary scaling parameter. A nonlinear filtering example is presented to demonstrate the usefulness of the theoretically derived results

Dual-Rate Extended Kalman Filter Based Path-Following Motion Control for an Unmanned Ground Vehicle: Realistic Simulation

[EN] In this paper, a two-wheel drive unmanned ground vehicle (UGV) path-following motion control is proposed. The UGV is equipped with encoders to sense angular velocities and a beacon system which provides position and orientation data. Whereas velocities can be sampled at a fast rate, position and orientation can only be sensed at a slower rate. Designing a dynamic controller at this slower rate implies not reaching the desired control requirements, and hence, the UGV is not able to follow the predefined path. The use of dual-rate extended Kalman filtering techniques enables the estimation of the fast-rate non-available position and orientation measurements. As a result, a fast-rate dynamic controller can be designed, which is provided with the fast-rate estimates to generate the control signal. The fast-rate controller is able to achieve a satisfactory path following, outperforming the slow-rate counterpart. Additionally, the dual-rate extended Kalman filter (DREKF) is fit for dealing with non-linear dynamics of the vehicle and possible Gaussian-like modeling and measurement uncertainties. A Simscape Multibody (TM) (Matlab(R)/Simulink) model has been developed for a realistic simulation, considering the contact forces between the wheels and the ground, not included in the kinematic and dynamic UGV representation. Non-linear behavior of the motors and limited resolution of the encoders have also been included in the model for a more accurate simulation of the real vehicle. The simulation model has been experimentally validated from the real process. Simulation results reveal the benefits of the control solution.Grant RTI2018-096590-B-I00 funded by MCIN/AEI/10.13039/501100011033 and by "ERDF Away of making Europe" and Grant PRE2019-088467 funded by MCIN/AEI/10.13039/501100011033 and by "ESF Investing in your future".Carbonell-Lázaro, R.; Cuenca, Á.; Casanova Calvo, V.; Pizá, R.; Salt Llobregat, JJ. (2021). Dual-Rate Extended Kalman Filter Based Path-Following Motion Control for an Unmanned Ground Vehicle: Realistic Simulation. Sensors. 21(22):1-17. https://doi.org/10.3390/s21227557117212

State Estimation Based on Kinematic Models Considering Characteristics of Sensors

Abstract-The major benefit of the state estimation based on kinematic model such as the kinematic Kalman filter (KKF) is that it is immune to parameter variations and unknown disturbances and thus can provide an accurate and robust state estimation regardless of the operating condition. Since it suggests to use a combination of low cost sensors rather than a single costly sensor, the specific characteristics of each sensor may have a major effect on the performance of the state estimator. As an illustrative example, this paper considers the simplest form of the KKF, i.e., the velocity estimation combining the encoder with the accelerometer and addresses two major issues that arise in its implementation: the limited bandwidth of the accelerometer and the deterministic feature (non-whiteness) of the quantization noise of the encoder at slow speeds. It has been shown that each of these characteristics can degrade the performance of the state estimation at different regimes of the operation range. A simple method to use the variable Kalman filter gain has been suggested to alleviate these problems using the simplified parameterization of the Kalman filter gain matrix. Experimental results are presented to illustrate the main issues and also to validate the effectiveness of the proposed scheme

A 3 Points Vision Based Approach for MAV Localization in GPS Denied Environments

International audienceThis paper introduces a new method to localize a micro aerial vehicle (MAV) in GPS denied environments and without the usage of any known pattern. The method exploits the planar ground assumption and only uses the data provided by a monocular camera and an inertial measurement unit. It is based on a closed solution which provides the vehicle pose from a single camera image, once the roll and the pitch angles are obtained by the inertial measurements. Specifically, the vehicle position and attitude can uniquely be determined by having two point features. However, the precision is significantly improved by using three point features. The closed form solution makes the method very simple in terms of computational cost and therefore very suitable for real time implementation. Additionally, because of this closed solution, the method does not need any initialization. Results of experimentation show the effectiveness of the proposed approach

Fusing inertial sensor data in an extended kalman filter for 3D camera tracking

Due to copyright restrictions, the access to the full text of this article is only available via subscription.In a setup where camera measurements are used to estimate 3D egomotion in an extended Kalman filter (EKF) framework, it is well-known that inertial sensors (i.e., accelerometers and gyroscopes) are especially useful when the camera undergoes fast motion. Inertial sensor data can be fused at the EKF with the camera measurements in either the correction stage (as measurement inputs) or the prediction stage (as control inputs). In general, only one type of inertial sensor is employed in the EKF in the literature, or when both are employed they are both fused in the same stage. In this paper, we provide an extensive performance comparison of every possible combination of fusing accelerometer and gyroscope data as control or measurement inputs using the same data set collected at different motion speeds. In particular, we compare the performances of different approaches based on 3D pose errors, in addition to camera reprojection errors commonly found in the literature, which provides further insight into the strengths and weaknesses of different approaches. We show using both simulated and real data that it is always better to fuse both sensors in the measurement stage and that in particular, accelerometer helps more with the 3D position tracking accuracy, whereas gyroscope helps more with the 3D orientation tracking accuracy. We also propose a simulated data generation method, which is beneficial for the design and validation of tracking algorithms involving both camera and inertial measurement unit measurements in general.TÜBİTA

Cooperative Visual-Inertial Sensor Fusion: Fundamental Equations

International audienceThis paper provides a new theoretical and basic result in the framework of cooperative visual-inertial sensor fusion. Specifically, the case of two aerial vehicles is investigated. Each vehicle is equipped with inertial sensors (accelerometer and gyroscope) and with a monocular camera. By using the monocular camera, each vehicle can observe the other vehicle. No additional camera observations (e.g., of external point features in the environment) are considered. First, the entire observable state is analytically derived. This state includes the relative position between the two aerial vehicles (which includes the absolute scale), the relative velocity and the three Euler angles that express the rotation between the two vehicle frames. Then, the basic equations that describe this system are analytically obtained. In other words, both the dynamics of the observable state and all the camera observations are expressed only in terms of the components of the observable state and in terms of the inertial measurements. These are the fundamental equations that fully characterize the problem of fusing visual and inertial data in the cooperative case. The last part of the paper describes the use of these equations to achieve the state estimation through an EKF. In particular, a simple manner to limit communication among the vehicles is discussed. Results obtained through simulations show the performance of the proposed solution, and in particular how it is affected by limiting the communication between the two vehicles