Robust convex optimisation techniques for autonomous vehicle vision-based navigation

This thesis investigates new convex optimisation techniques for motion and pose estimation. Numerous computer vision problems can be formulated as optimisation problems. These optimisation problems are generally solved via linear techniques using the singular value decomposition or iterative methods under an L2 norm minimisation. Linear techniques have the advantage of offering a closed-form solution that is simple to implement. The quantity being minimised is, however, not geometrically or statistically meaningful. Conversely, L2 algorithms rely on iterative estimation, where a cost function is minimised using algorithms such as Levenberg-Marquardt, Gauss-Newton, gradient descent or conjugate gradient. The cost functions involved are geometrically interpretable and can statistically be optimal under an assumption of Gaussian noise. However, in addition to their sensitivity to initial conditions, these algorithms are often slow and bear a high probability of getting trapped in a local minimum or producing infeasible solutions, even for small noise levels. In light of the above, in this thesis we focus on developing new techniques for finding solutions via a convex optimisation framework that are globally optimal. Presently convex optimisation techniques in motion estimation have revealed enormous advantages. Indeed, convex optimisation ensures getting a global minimum, and the cost function is geometrically meaningful. Moreover, robust optimisation is a recent approach for optimisation under uncertain data. In recent years the need to cope with uncertain data has become especially acute, particularly where real-world applications are concerned. In such circumstances, robust optimisation aims to recover an optimal solution whose feasibility must be guaranteed for any realisation of the uncertain data. Although many researchers avoid uncertainty due to the added complexity in constructing a robust optimisation model and to lack of knowledge as to the nature of these uncertainties, and especially their propagation, in this thesis robust convex optimisation, while estimating the uncertainties at every step is investigated for the motion estimation problem. First, a solution using convex optimisation coupled to the recursive least squares (RLS) algorithm and the robust H filter is developed for motion estimation. In another solution, uncertainties and their propagation are incorporated in a robust L convex optimisation framework for monocular visual motion estimation. In this solution, robust least squares is combined with a second order cone program (SOCP). A technique to improve the accuracy and the robustness of the fundamental matrix is also investigated in this thesis. This technique uses the covariance intersection approach to fuse feature location uncertainties, which leads to more consistent motion estimates. Loop-closure detection is crucial in improving the robustness of navigation algorithms. In practice, after long navigation in an unknown environment, detecting that a vehicle is in a location it has previously visited gives the opportunity to increase the accuracy and consistency of the estimate. In this context, we have developed an efficient appearance-based method for visual loop-closure detection based on the combination of a Gaussian mixture model with the KD-tree data structure. Deploying this technique for loop-closure detection, a robust L convex posegraph optimisation solution for unmanned aerial vehicle (UAVs) monocular motion estimation is introduced as well. In the literature, most proposed solutions formulate the pose-graph optimisation as a least-squares problem by minimising a cost function using iterative methods. In this work, robust convex optimisation under the L norm is adopted, which efficiently corrects the UAV’s pose after loop-closure detection. To round out the work in this thesis, a system for cooperative monocular visual motion estimation with multiple aerial vehicles is proposed. The cooperative motion estimation employs state-of-the-art approaches for optimisation, individual motion estimation and registration. Three-view geometry algorithms in a convex optimisation framework are deployed on board the monocular vision system for each vehicle. In addition, vehicle-to-vehicle relative pose estimation is performed with a novel robust registration solution in a global optimisation framework. In parallel, and as a complementary solution for the relative pose, a robust non-linear H solution is designed as well to fuse measurements from the UAVs’ on-board inertial sensors with the visual estimates. The suggested contributions have been exhaustively evaluated over a number of real-image data experiments in the laboratory using monocular vision systems and range imaging devices. In this thesis, we propose several solutions towards the goal of robust visual motion estimation using convex optimisation. We show that the convex optimisation framework may be extended to include uncertainty information, to achieve robust and optimal solutions. We observed that convex optimisation is a practical and very appealing alternative to linear techniques and iterative methods

Antenna array calibration in wireless communications

Imperial Users onl

Infrared based monocular relative navigation for active debris removal

In space, visual based relative navigation systems suffer from the harsh illumination conditions of the target (e.g. eclipse conditions, solar glare, etc.). In current Rendezvous and Docking (RvD) missions, most of these issues are addressed by advanced mission planning techniques (e.g strict manoeuvre timings). However, such planning would not always be feasible for Active Debris Removal (ADR) missions which have more unknowns. Fortunately, thermal infrared technology can operate under any lighting conditions and therefore has the potential to be exploited in the ADR scenario. In this context, this study investigates the benefits and the challenges of infrared based relative navigation. The infrared environment of ADR is very much different to that of terrestrial applications. This study proposes a methodology of modelling this environment in a computationally cost effective way to create a simulation environment in which the navigation solution can be tested. Through an intelligent classification of possible target surface coatings, the study is generalised to simulate the thermal environment of space debris in different orbit profiles. Through modelling various scenarios, the study also discusses the possible challenges of the infrared technology. In laboratory conditions, providing the thermal-vacuum environment of ADR, these theoretical findings were replicated. By use of this novel space debris set-up, the study investigates the behaviour of infrared cues extracted by different techniques and identifies the issue of short-lifespan features in the ADR scenarios. Based on these findings, the study suggests two different relative navigation methods based on the degree of target cooperativeness: partially cooperative targets, and uncooperative targets. Both algorithms provide the navigation solution with respect to an online reconstruction of the target. The method for partially cooperative targets provides a solution for smooth trajectories by exploiting the subsequent image tracks of features extracted from the first frame. The second algorithm is for uncooperative targets and exploits the target motion (e.g. tumbling) by formulating the problem in terms of a static target and a moving map (i.e. target structure) within a filtering framework. The optical flow information is related to the target motion derivatives and the target structure. A novel technique that uses the quality of the infrared cues to improve the algorithm performance is introduced. The problem of short measurement duration due to target tumbling motion is addressed by an innovative smart initialisation procedure. Both navigation solutions were tested in a number of different scenarios by using computer simulations and a specific laboratory set-up with real infrared camera. It is shown that these methods can perform well as the infrared-based navigation solutions using monocular cameras where knowledge relating to the infrared appearance of the target is limited

Advanced Wireless Localisation Methods Dealing with Incomplete Measurements

Positioning techniques have become an essential part of modern engineering, and the improvement in computing devices brings great potential for more advanced and complicated algorithms. This thesis first studies the existing radio signal based positioning techniques and then presents three developed methods in the sense of dealing with incomplete data. Firstly, on the basis of received signal strength (RSS) location fingerprinting techniques, the Kriging interpolation methods are applied to generate complete fingerprint databases of denser reference locations from sparse or incomplete data sets, as a solution of reducing the workload and cost of offline data collection. Secondly, with incomplete knowledge of shadowing correlation, a new approach of Bayesian inference on RSS based multiple target localisation is proposed taking advantage of the inverse Wishart conjugate prior. The MCMC method (Metropolis-within-Gibbs) and the maximum a posterior (MAP) / maximum likelihood (ML) method are then considered to produce target location estimates. Thirdly, a new information fusion approach is developed for the time difference of arrival (TDOF) and frequency difference of arrival (FDOA) based dual-satellite geolocation system, as a solution to the unknown time and frequency offsets. All proposed methods are studied and validated through simulations. Result analyses and future work directions are discussed

Random scattering of surface plasmons for sensing and tracking

In this thesis, a single particle biosensing setup, capable of sensing and tracking single nanoscale biological particles, is proposed and investigated theoretically. The setup is based on monitoring the speckle pattern intensity distribution arising due to random scattering of surface plasmon polaritons (SPPs) from a metal surface. An analyte particle close to the surface will additionally scatter light, perturbing the speckle pattern. From this speckle pattern perturbation, the analyte particle can be detected and tracked. Theoretical sensitivity analysis predicts a biological particle on the order of 10nm in radius gives a fractional intensity perturbation to the speckle intensity of 10^4, comparable to intensity contrasts used in existing interferometric scattering sensing techniques. A formula for the minimum detectable particle size is derived. In addition, an algorithm is derived capable of extracting the particle trajectory in the single scattering regime from the change to the speckle intensity perturbation over time and shown to be capable of errors of approximately 1nm on simulated data under optimal noise conditions. The effect of multiple scattering on the speckle pattern perturbation is studied, and it is shown that, by tuning the scattering mean free path and individual scatterer properties of a random nanostructure of scatterers on the metal surface, one can increase the magnitude of the speckle field perturbation by up to the order of 10^2. A neural network based localisation algorithm is developed to calculate the analyte particle position based on the speckle intensity perturbation and its performance on simulated data is studied. Mean errors on the order of 20nm were found, depending on the size of the region over which the particle must be tracked. Unlike the single scattering tracking algorithm, the neural network algorithm continues to function in the multiple scattering regime.Open Acces

Cooperative Radio Communications for Green Smart Environments

The demand for mobile connectivity is continuously increasing, and by 2020 Mobile and Wireless Communications will serve not only very dense populations of mobile phones and nomadic computers, but also the expected multiplicity of devices and sensors located in machines, vehicles, health systems and city infrastructures. Future Mobile Networks are then faced with many new scenarios and use cases, which will load the networks with different data traffic patterns, in new or shared spectrum bands, creating new specific requirements. This book addresses both the techniques to model, analyse and optimise the radio links and transmission systems in such scenarios, together with the most advanced radio access, resource management and mobile networking technologies. This text summarises the work performed by more than 500 researchers from more than 120 institutions in Europe, America and Asia, from both academia and industries, within the framework of the COST IC1004 Action on "Cooperative Radio Communications for Green and Smart Environments". The book will have appeal to graduates and researchers in the Radio Communications area, and also to engineers working in the Wireless industry. Topics discussed in this book include: • Radio waves propagation phenomena in diverse urban, indoor, vehicular and body environments• Measurements, characterization, and modelling of radio channels beyond 4G networks• Key issues in Vehicle (V2X) communication• Wireless Body Area Networks, including specific Radio Channel Models for WBANs• Energy efficiency and resource management enhancements in Radio Access Networks• Definitions and models for the virtualised and cloud RAN architectures• Advances on feasible indoor localization and tracking techniques• Recent findings and innovations in antenna systems for communications• Physical Layer Network Coding for next generation wireless systems• Methods and techniques for MIMO Over the Air (OTA) testin

Cooperative Radio Communications for Green Smart Environments

The demand for mobile connectivity is continuously increasing, and by 2020 Mobile and Wireless Communications will serve not only very dense populations of mobile phones and nomadic computers, but also the expected multiplicity of devices and sensors located in machines, vehicles, health systems and city infrastructures. Future Mobile Networks are then faced with many new scenarios and use cases, which will load the networks with different data traffic patterns, in new or shared spectrum bands, creating new specific requirements. This book addresses both the techniques to model, analyse and optimise the radio links and transmission systems in such scenarios, together with the most advanced radio access, resource management and mobile networking technologies. This text summarises the work performed by more than 500 researchers from more than 120 institutions in Europe, America and Asia, from both academia and industries, within the framework of the COST IC1004 Action on "Cooperative Radio Communications for Green and Smart Environments". The book will have appeal to graduates and researchers in the Radio Communications area, and also to engineers working in the Wireless industry. Topics discussed in this book include: • Radio waves propagation phenomena in diverse urban, indoor, vehicular and body environments• Measurements, characterization, and modelling of radio channels beyond 4G networks• Key issues in Vehicle (V2X) communication• Wireless Body Area Networks, including specific Radio Channel Models for WBANs• Energy efficiency and resource management enhancements in Radio Access Networks• Definitions and models for the virtualised and cloud RAN architectures• Advances on feasible indoor localization and tracking techniques• Recent findings and innovations in antenna systems for communications• Physical Layer Network Coding for next generation wireless systems• Methods and techniques for MIMO Over the Air (OTA) testin

Understanding sorting algorithms using music and spatial distribution

This thesis is concerned with the communication of information using auditory techniques. In particular, a music-based interface has been used to communicate the operation of a number of sorting algorithms to users. This auditory interface has been further enhanced by the creation of an auditory scene including a sound wall, which enables the auditory interface to utilise music parameters in conjunction with 2D/3D spatial distribution to communicate the essential processes in the algorithms. The sound wall has been constructed from a grid of measurements using a human head to create a spatial distribution. The algorithm designer can therefore communicate events using pitch, rhythm and timbre and associate these with particular positions in space. A number of experiments have been carried out to investigate the usefulness of music and the sound wall in communicating information relevant to the algorithms. Further, user understanding of the six algorithms has been tested. In all experiments the effects of previous musical experience has been allowed for. The results show that users can utilise musical parameters in understanding algorithms and that in all cases improvements have been observed using the sound wall. Different user performance was observed with different algorithms and it is concluded that certain types of information lend themselves more readily to communication through auditory interfaces than others. As a result of the experimental analysis, recommendations are given on how to improve the sound wall and user understanding by improved choice of the musical mappings

RF signal sensing and source localisation systems using Software Defined Radios

Radio frequency (RF) source localisation is a critical technology in numerous location-based military and civilian applications. In this thesis, the problem of RF source localisation has been studied from the perspective of the system implementation for real-world applications. Commercial off-the-shelf Software Defined Radio (SDR) devices are used to demonstrate the practical RF source localisation systems. Compared to the conventional localisation systems, which rely on dedicated hardware, the SDR-based system is developed using general-purpose hardware and software-defined components, offering great flexibility and cost efficiency in system design and implementation. In this thesis, the theoretical results of source localisation are evaluated and put into practice. To be specific, the practical localisation systems using different measurement techniques, including received-signal-strength-indication (RSSI) measurements, time-difference-of-arrival (TDOA) measurements and joint TDOA and frequency-difference-of-arrival (FDOA) measurements, are demonstrated to localise the stationary RF signal sources using the SDRs. The RSSI-based localisation system is demonstrated in small indoor and outdoor areas with a range of several metres using the SDR-based transceivers. Furthermore, interests from the defence area motivated us to implement the time-based localisation systems. The TDOA-based source localisation system is implemented using multiple spatially distributed SDRs in a large outdoor area with the sensor-target range of several kilometres. Moreover, they are implemented in a fully passive way without prior knowledge of the signal emitter, so the solutions can be applied in the localisation of non-cooperative signal sources provided that emitters are distant. To further reduce the system cost, and more importantly, to deal with the situation when the deployment of multiple SDRs, due to geographical restrictions, is not feasible, a joint TDOA and FDOA-based localisation system is also demonstrated using only one stationary SDR and one mobile SDR. To improve the localisation accuracy, the methods that can reduce measurement error and obtain accurate location estimates are studied. Firstly, to obtain a better understanding of the measurement error, the error sources that affect the measurement accuracy are systematically analysed from three aspects: the hardware precision, the accuracy of signal processing methods, and the environmental impact. Furthermore, the approaches to reduce the measurement error are proposed and verified in the experiments. Secondly, during the process of the location estimation, the theoretical results on the pre-existing localisation algorithms which can achieve a good trade-off between the accuracy of location estimation and the computational cost are evaluated, including the weight least-squares (WLS)-based solution and the Extended Kalman Filter (EKF)-based solution. In order to use the pre-existing algorithms in the practical source localisation, the proper adjustments are implemented. Overall, the SDR-based platforms are able to achieve low-cost and universal localisation solutions in the real-world environment. The RSSI-based localisation system shows tens of centimetres of accuracy in a range of several metres, which provides a useful tool for the verification of the range-based localisation algorithms. The localisation accuracy of the TDOA-based localisation system and the joint TDOA and FDOA-based localisation system is several tens of metres in a range of several kilometres, which offers potential in the low-cost localisation solutions in the defence area