Unscented Kalman Filter for Vision Based Target Localisation with a Quadrotor

Unmanned aerial vehicles (UAV) equipped with a navigation system and an embedded camera can be used to estimate the position of a desired target. The relative position of the UAV along with knowledge of camera orientation and imagery data can be used to produce bearing measurements that allow estimation of target position. The filter methods applied are prone to biases due to noisy measurements. Further noise may be encountered depending on the UAV trajectory for target localisation. This work presents the implementation of an Unscented Kalman Filter (UKF) to estimate the position of a target on the 3D cartesian plane within a small indoor scenario. A small UAV with a single board computer, equipped with a frontal camera and moving in an oval trajectory at a fixed height was employed. Such a trajectory enabled an experimental comparison of UAV simulation data with UAV real-time flight data for indoor conditions. Optitrack Motion system and the Robot Operative System (ROS) were used to retrieve the drone position and exchange information at high rates

3D Distance Filter for the Autonomous Navigation of UAVs in Agricultural Scenarios

In precision agriculture, remote sensing is an essential phase in assessing crop status and variability when considering both the spatial and the temporal dimensions. To this aim, the use of unmanned aerial vehicles (UAVs) is growing in popularity, allowing for the autonomous performance of a variety of in-field tasks which are not limited to scouting or monitoring. To enable autonomous navigation, however, a crucial capability lies in accurately locating the vehicle within the surrounding environment. This task becomes challenging in agricultural scenarios where the crops and/or the adopted trellis systems can negatively affect GPS signal reception and localisation reliability. A viable solution to this problem can be the exploitation of high-accuracy 3D maps, which provide important data regarding crop morphology, as an additional input of the UAVs’ localisation system. However, the management of such big data may be difficult in real-time applications. In this paper, an innovative 3D sensor fusion approach is proposed, which combines the data provided by onboard proprioceptive (i.e., GPS and IMU) and exteroceptive (i.e., ultrasound) sensors with the information provided by a georeferenced 3D low-complexity map. In particular, the parallel-cuts ellipsoid method is used to merge the data from the distance sensors and the 3D map. Then, the improved estimation of the UAV location is fused with the data provided by the GPS and IMU sensors, using a Kalman-based filtering scheme. The simulation results prove the efficacy of the proposed navigation approach when applied to a quadrotor that autonomously navigates between vine rows

Stochastic Real-time Optimal Control for Bearing-only Trajectory Planning

A method is presented to simultaneously solve the optimal control problem and the optimal estimation problem for a bearing-only sensor. For bearing-only systems that require a minimum level of certainty in position relative to a source for mission accomplishment, some amount of maneuver is required to measure range. Traditional methods of trajectory optimization and optimal estimation minimize an information metric. This paper proposes constraining the final value of the information states with known time propagation dynamics relative to a given trajectory which allows for attainment of the required level of information with minimal deviation from a general performance index that can be tailored to a specific vehicle. The proposed method does not suffer from compression of the information metric into a scalar, and provides a route that will attain a particular target estimate quality while maneuvering to a desired relative point or set. An algorithm is created to apply the method in real-time, iteratively estimating target position with an Unscented Kalman Filter and updating the trajectory with an efficient pseudospectral method. Methods and tools required for hardware implementation are presented that apply to any real-time optimal control (RTOC) system. The algorithm is validated with both simulation and flight test, autonomously landing a quadrotor on a wire

Stochastic Real-time Optimal Control: A Pseudospectral Approach for Bearing-Only Trajectory Optimization

A method is presented to couple and solve the optimal control and the optimal estimation problems simultaneously, allowing systems with bearing-only sensors to maneuver to obtain observability for relative navigation without unnecessarily detracting from a primary mission. A fundamentally new approach to trajectory optimization and the dual control problem is developed, constraining polynomial approximations of the Fisher Information Matrix to provide an information gradient and allow prescription of the level of future estimation certainty required for mission accomplishment. Disturbances, modeling deficiencies, and corrupted measurements are addressed with recursive updating of the target estimate with an Unscented Kalman Filter and the optimal path with Radau pseudospectral collocation methods and sequential quadratic programming. The basic real-time optimal control (RTOC) structure is investigated, specifically addressing limitations of current techniques in this area that lose error integration. The resulting guidance method can be applied to any bearing-only system, such as submarines using passive sonar, anti-radiation missiles, or small UAVs seeking to land on power lines for energy harvesting. Methods and tools required for implementation are developed, including variable calculation timing and tip-tail blending for potential discontinuities. Validation is accomplished with simulation and flight test, autonomously landing a quadrotor helicopter on a wire

A Review of Radio Frequency Based Localization for Aerial and Ground Robots with 5G Future Perspectives

Efficient localization plays a vital role in many modern applications of Unmanned Ground Vehicles (UGV) and Unmanned aerial vehicles (UAVs), which would contribute to improved control, safety, power economy, etc. The ubiquitous 5G NR (New Radio) cellular network will provide new opportunities for enhancing localization of UAVs and UGVs. In this paper, we review the radio frequency (RF) based approaches for localization. We review the RF features that can be utilized for localization and investigate the current methods suitable for Unmanned vehicles under two general categories: range-based and fingerprinting. The existing state-of-the-art literature on RF-based localization for both UAVs and UGVs is examined, and the envisioned 5G NR for localization enhancement, and the future research direction are explored

Enhancing 3D Autonomous Navigation Through Obstacle Fields: Homogeneous Localisation and Mapping, with Obstacle-Aware Trajectory Optimisation

Small flying robots have numerous potential applications, from quadrotors for search and rescue, infrastructure inspection and package delivery to free-flying satellites for assistance activities inside a space station. To enable these applications, a key challenge is autonomous navigation in 3D, near obstacles on a power, mass and computation constrained platform. This challenge requires a robot to perform localisation, mapping, dynamics-aware trajectory planning and control. The current state-of-the-art uses separate algorithms for each component. Here, the aim is for a more homogeneous approach in the search for improved efficiencies and capabilities. First, an algorithm is described to perform Simultaneous Localisation And Mapping (SLAM) with physical, 3D map representation that can also be used to represent obstacles for trajectory planning: Non-Uniform Rational B-Spline (NURBS) surfaces. Termed NURBSLAM, this algorithm is shown to combine the typically separate tasks of localisation and obstacle mapping. Second, a trajectory optimisation algorithm is presented that produces dynamically-optimal trajectories with direct consideration of obstacles, providing a middle ground between path planners and trajectory smoothers. Called the Admissible Subspace TRajectory Optimiser (ASTRO), the algorithm can produce trajectories that are easier to track than the state-of-the-art for flight near obstacles, as shown in flight tests with quadrotors. For quadrotors to track trajectories, a critical component is the differential flatness transformation that links position and attitude controllers. Existing singularities in this transformation are analysed, solutions are proposed and are then demonstrated in flight tests. Finally, a combined system of NURBSLAM and ASTRO are brought together and tested against the state-of-the-art in a novel simulation environment to prove the concept that a single 3D representation can be used for localisation, mapping, and planning

Computational time analysis in extended kalman filter based simultaneous localization and mapping

The simultaneous localization and mapping (SLAM) of a mobile robot is one of the applications that use estimation techniques. SLAM is a navigation technique that allows a mobile robot to navigate around autonomously while observing its surroundings in an unfamiliar environment. SLAM does not require a priori map, instead the mobile robot creates a map of the area incrementally with the help of sensors on board and uses this map to localize its location Due to its relatively easy algorithm and efficiency of estimation via the representation of the belief by a multivariate Gaussian distribution and a unimodal distribution, with a single mean annotated and corresponding covariance uncertainty, the extended Kalman filter (EKF) has become one of the most preferred estimators in mobile robot SLAM. However, due to the update process of the covariance matrix, EKF-based SLAM has high computational time. In SLAM, if more observation is being made by mobile robot, the state covariance size will be increasing. This eventually requires more memory and processing time due to excessive computation needs to be calculated over time. Therefore there is a need of enhancing the estimation performance by reducing the computational time in SLAM. Three phases involve in this research methodology which the first is theoretical formulation of the mobile robot model. This is followed by the environment and estimation method used to solve the SLAM of mobile robot. Simulation analysis was used to verify the findings. This research attempts to introduce a new approach to simplify the structure of the covariance matrix using the eigenvalues matrix diagonalization method. Through simulation result it is proved that time taken to complete the SLAM process using diagonalized covariance was reduced as compared to the normal covariance. However, there is one limitation encountered from this method in which the covariance values become too small, that indicates an optimistic estimation. For this reason, second objective is motivated to improve the optimistic problem. Addition of new element into the diagonal matrix, which is known as a pseudo element, is also investigated in this study. Via mathematical approach, these problems are discussed and explored from estimation-theoretic point of view. Through adding the pseudo noise element into diagonalized covariance, the optimistic condition of covariance matrix can be improved. This was shown through the increased size of covariance ellipses at the end of simulation process. Based on the findings it can be concluded that the addition of pseudo matrix in the updated state covariance can further improved the computational time for mobile robot estimation

Comprehensive review on controller for leader-follower robotic system

985-1007This paper presents a comprehensive review of the leader-follower robotics system. The aim of this paper is to find and elaborate on the current trends in the swarm robotic system, leader-follower, and multi-agent system. Another part of this review will focus on finding the trend of controller utilized by previous researchers in the leader-follower system. The controller that is commonly applied by the researchers is mostly adaptive and non-linear controllers. The paper also explores the subject of study or system used during the research which normally employs multi-robot, multi-agent, space flying, reconfigurable system, multi-legs system or unmanned system. Another aspect of this paper concentrates on the topology employed by the researchers when they conducted simulation or experimental studies

Multi-robot Collaborative Visual Navigation with Micro Aerial Vehicles

Micro Aerial Vehicles (MAVs), particularly multi-rotor MAVs have gained significant popularity in the autonomous robotics research field. The small size and agility of these aircraft makes them safe to use in contained environments. As such MAVs have numerous applications with respect to both the commercial and research fields, such as Search and Rescue (SaR), surveillance, inspection and aerial mapping. In order for an autonomous MAV to safely and reliably navigate within a given environment the control system must be able to determine the state of the aircraft at any given moment. The state consists of a number of extrinsic variables such as the position, velocity and attitude of the MAV. The most common approach for outdoor operations is the Global Positioning System (GPS). While GPS has been widely used for long range navigation in open environments, its performance degrades significantly in constrained environments and is unusable indoors. As a result state estimation for MAVs in such constrained environments is a popular and exciting research area. Many successful solutions have been developed using laser-range finder sensors. These sensors provide very accurate measurements at the cost of increased power and weight requirements. Cameras offer an attractive alternative state estimation sensor; they offer high information content per image coupled with light weight and low power consumption. As a result much recent work has focused on state estimation on MAVs where a camera is the only exteroceptive sensor. Much of this recent work focuses on single MAVs, however it is the author's belief that the full potential and benefits of the MAV platform can only be realised when teams of MAVs are able to cooperatively perform tasks such as SaR or mapping. Therefore the work presented in this thesis focuses on the problem of vision-based navigation for MAVs from a multi-robot perspective. Multi-robot visual navigation presents a number of challenges, as not only must the MAVs be able to estimate their state from visual observations of the environment but they must also be able to share the information they gain about their environment with other members of the team in a meaningful fashion. The meaningful sharing of observations is achieved when the MAVs have a common frame of reference for both positioning and observations. Such meaningful information sharing is key to achieving cooperative multi-robot navigation. In this thesis two main ideas are explored to address these issues. Firstly the idea of appearance based (re)-localisation is explored as a means of establishing a common reference frame for multiple MAVs. This approach allows a team of MAVs to very easily establish a common frame of reference prior to starting their mission. The common reference frame allows all subsequent operations, such as surveillance or mapping, to proceed with direct cooperative between all MAVs. The second idea focuses on the structure and nature of the inter-robot communication with respect to visual navigation; the thesis explores how a partially distributed architecture can be used to vastly improve the scalability and robustness of a multi-MAV visual navigation framework. A navigation framework would not be complete without a means of control. In the multi-robot setting the control problem is complicated by the need for inter-robot collision avoidance. This thesis presents a MAV trajectory controller based on a combination of classical control theory and distributed Velocity Obstacle (VO) based collision avoidance. Once a means of control is established an autonomous multi-MAV team requires a mission. One such mission is the task of exploration; that is exploration of a previously unknown environment in order to produce a map and/or search for objects of interest. This thesis also addressed the problem of multi-robot exploration using only the sparse interest-point data collected from the visual navigation system. In a multi-MAV exploration scenario the problem of task allocation, assigning areas to each MAV to explore, can be a challenging one. An auction-based protocol is considered to address the task allocation problem. The two applications discussed, VO-based trajectory control and auction-based environment exploration, form two case studies which serve as the partial basis of the evaluation of the navigation solutions presented in this thesis. In summary the visual navigation systems presented in this thesis allow MAVs to cooperatively perform task such as collision avoidance and environment exploration in a robust and efficient manner, with large teams of MAVs. The work presented is a step in the direction of fully autonomous teams of MAVs performing complex, dangerous and useful tasks in the real world