Statically Fused Converted Measurement Kalman Filters

This chapter presents a state estimation method without using of nonlinear recursive filters when Doppler measurement is incorporated into the tracking system. The commonly used motions, such as the constant velocity (CV), constant acceleration (CA), and constant turn (CT), are represented in a pseudo-state space, defined from the product of target true range and range rate, by linear pseudo-state equations. Then the linear converted Doppler measurement Kalman filter (CDMKF) is presented to extract pseudo-state from the converted Doppler measurement, constructed by the product of the range and Doppler measurements. The output of the CDMKF is fused statically with that of the converted position measurement (range and one or two angles) Kalman filter (CPMKF) to produce target Cartesian state estimates. The accuracy and consistence of the estimator can be both guaranteed, since linear Kalman filters are both used to extract information from position and Doppler measurements

Robust Multi-sensor Data Fusion for Practical Unmanned Surface Vehicles (USVs) Navigation

The development of practical Unmanned Surface Vehicles (USVs) are attracting increasing attention driven by their assorted military and commercial application potential. However, addressing the uncertainties presented in practical navigational sensor measurements of an USV in maritime environment remain the main challenge of the development. This research aims to develop a multi-sensor data fusion system to autonomously provide an USV reliable navigational information on its own positions and headings as well as to detect dynamic target ships in the surrounding environment in a holistic fashion. A multi-sensor data fusion algorithm based on Unscented Kalman Filter (UKF) has been developed to generate more accurate estimations of USV’s navigational data considering practical environmental disturbances. A novel covariance matching adaptive estimation algorithm has been proposed to deal with the issues caused by unknown and varying sensor noise in practice to improve system robustness. Certain measures have been designed to determine the system reliability numerically, to recover USV trajectory during short term sensor signal loss, and to autonomously detect and discard permanently malfunctioned sensors, and thereby enabling potential sensor faults tolerance. The performance of the algorithms have been assessed by carrying out theoretical simulations as well as using experimental data collected from a real-world USV projected collaborated with Plymouth University. To increase the degree of autonomy of USVs in perceiving surrounding environments, target detection and prediction algorithms using an Automatic Identification System (AIS) in conjunction with a marine radar have been proposed to provide full detections of multiple dynamic targets in a wider coverage range, remedying the narrow detection range and sensor uncertainties of the AIS. The detection algorithms have been validated in simulations using practical environments with water current effects. The performance of developed multi-senor data fusion system in providing reliable navigational data and perceiving surrounding environment for USV navigation have been comprehensively demonstrated

Probabilistic Localization of a Soccer Robot

Mobiilsed autonoomsed robotid vajavad iseseisvaks navigeerimiseks teadmist oma umbkaudse asukoha kohta. Tihtipeale pole see otseselt tuvastatav, vaid roboti positsioon tuleb järeldada mitmete müraste sensorite mõõtmistest. Antud tees tegeleb probleemiga, kuidas lokaliseerida iseseisvat jalgpallirobotit videopildi alusel. Kasutatakse statistilisi Bayesi filtreerimise meetodeid nagu Kalmani- ja osakeste filter, mis arvestavad sellistele süsteemidele omase müra ja ebakindlusega. Implementeeritakse ja võrreldakse mitmeid erinevaid lokalisatsioonialgoritme ja testitakse neid ka lisaks simulaatorile ka füüsilise roboti peal. Töötatakse välja toimiv praktiline lahendus mobiilse jalgpalliroboti lokaliseerimiseks.The thesis deals with the problem of localizing a mobile soccer-playing robot using Bayes filtering methods. For navigating natural environments, autonomous robots need to know where they are located even if the position of the robot is not directly observable, but rather needs to be inferred from indirect measurements of several noisy sensors. The algorithms need to account for the inherent uncertainty of such systems. Several algorithms of robot positioning including Kalman filter and particle filter are investigated, implemented and compared. The algorithms are also tested on a real robot. A working solution for practical robot localization is developed

Intelligent image cropping and scaling

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University, 2011.Nowadays, there exist a huge number of end devices with different screen properties for watching television content, which is either broadcasted or transmitted over the internet. To allow best viewing conditions on each of these devices, different image formats have to be provided by the broadcaster. Producing content for every single format is, however, not applicable by the broadcaster as it is much too laborious and costly. The most obvious solution for providing multiple image formats is to produce one high resolution format and prepare formats of lower resolution from this. One possibility to do this is to simply scale video images to the resolution of the target image format. Two significant drawbacks are the loss of image details through ownscaling and possibly unused image areas due to letter- or pillarboxes. A preferable solution is to find the contextual most important region in the high-resolution format at first and crop this area with an aspect ratio of the target image format afterwards. On the other hand, defining the contextual most important region manually is very time consuming. Trying to apply that to live productions would be nearly impossible. Therefore, some approaches exist that automatically define cropping areas. To do so, they extract visual features, like moving reas in a video, and define regions of interest (ROIs) based on those. ROIs are finally used to define an enclosing cropping area. The extraction of features is done without any knowledge about the type of content. Hence, these approaches are not able to distinguish between features that might be important in a given context and those that are not. The work presented within this thesis tackles the problem of extracting visual features based on prior knowledge about the content. Such knowledge is fed into the system in form of metadata that is available from TV production environments. Based on the extracted features, ROIs are then defined and filtered dependent on the analysed content. As proof-of-concept, this application finally adapts SDTV (Standard Definition Television) sports productions automatically to image formats with lower resolution through intelligent cropping and scaling. If no content information is available, the system can still be applied on any type of content through a default mode. The presented approach is based on the principle of a plug-in system. Each plug-in represents a method for analysing video content information, either on a low level by extracting image features or on a higher level by processing extracted ROIs. The combination of plug-ins is determined by the incoming descriptive production metadata and hence can be adapted to each type of sport individually. The application has been comprehensively evaluated by comparing the results of the system against alternative cropping methods. This evaluation utilised videos which were manually cropped by a professional video editor, statically cropped videos and simply scaled, non-cropped videos. In addition to and apart from purely subjective evaluations, the gaze positions of subjects watching sports videos have been measured and compared to the regions of interest positions extracted by the system

Exploring Indoor Navigation Based on 9-dof Kalman Filter and SLAM Algorithm

Traditional localization techniques rely on triangulation or trilateration, where in a set of three or more stationary known locations is used to estimate a “client” position. For inertial navigation, these techniques can estimate client positions merely using the measured data from tri-axial accelerometers and gyroscopes. However, the use of double integration of the accelerometer data and a single integration of the gyroscope data to determine the client's position are greatly affected by gyro-drift and other noise, causing small errors to explode towards infinity. This process could be improved by applying reasonable algorithms and even deep learning tools such as the Kalman filter and simultaneous localization and mapping. Therefore, this research aims at exploring the possibility of indoor navigation based on inertial sensors that uses the fusion algorithms. Meanwhile, a multitude of formulas involving navigation are refined and corrected. These equations and optimized results provide accurate raw data for future deep learning models

Clustering for filtering: multi-object detection and estimation using multiple/massive sensors

Advanced multi-sensor systems are expected to combat the challenges that arise in object recognition and state estimation in harsh environments with poor or even no prior information, while bringing new challenges mainly related to data fusion and computational burden. Unlike the prevailing Markov-Bayes framework that is the basis of a large variety of stochastic filters and the approximate, we propose a clustering-based methodology for multi-sensor multi-object detection and estimation (MODE), named clustering for filtering (C4F), which abandons unrealistic assumptions with respect to the objects, background and sensors. Rather, based on cluster analysis of the input multi-sensor data, the C4F approach needs no prior knowledge about the latent objects (whether quantity or dynamics), can handle time-varying uncertainties regarding the background and sensors such as noises, clutter and misdetection, and does so computationally fast. This offers an inherently robust and computationally efficient alternative to conventional Markov–Bayes filters for dealing with the scenario with little prior knowledge but rich observation data. Simulations based on representative scenarios of both complete and little prior information have demonstrated the superiority of our C4F approach

An Acoustic Network Navigation System

This work describes a system for acoustic‐based navigation that relies on the addition of localization services to underwater networks. The localization capability has been added on top of an existing network, without imposing constraints on its structure/operation. The approach is based on the inclusion of timing information within acoustic messages through which it is possible to know the time of an acoustic transmission in relation to its reception. Exploiting such information at the network application level makes it possible to create an interrogation scheme similar to that of a long baseline. The advantage is that the nodes/autonomous underwater vehicles (AUVs) themselves become the transponders of a network baseline, and hence there is no need for dedicated instrumentation. The paper reports at sea results obtained from the COLLAB–NGAS14 experimental campaign. During the sea trial, the approach was implemented within an operational network in different configurations to support the navigation of the two Centre for Maritime Research and Experimentation Ocean Explorer (CMRE OEX) vehicles. The obtained results demonstrate that it is possible to support AUV navigation without constraining the network design and with a minimum communication overhead. Alternative solutions (e.g., synchronized clocks or two‐way‐travel‐time interrogations) might provide higher precision or accuracy, but they come at the cost of impacting on the network design and/or on the interrogation strategies. Results are discussed, and the performance achieved at sea demonstrates the viability to use the system in real, large‐scale operations involving multiple AUVs. These results represent a step toward location‐aware underwater networks that are able to provide node localization as a service

Rapid acceleration of legged robots: a pneumatic approach

For robotics to be useful to the public in a multifaceted manner, they need to be both legged and agile. The legged constraint arises as many environments and systems in our world are tailored to ablebodied adults. Therefore, a practically useful robot would need to have the same morphology for maximum efficacy. For robots to be useful in these environments, they need to perform at least as well as humans, therefore presenting the agility constraint. These requirements have been out of reach of the field until recently. The aim of this thesis was to design a planar monopod robot for rapid acceleration manoeuvres, that could later be expanded to a planar quadruped robot. This was achieved through a hybrid electric and pneumatic actuation system. To this end, modelling schemes for the pneumatic cylinder were investigated and verified with physical experiments. This was done to develop accurate models of the pneumatic system that were later used in simulation to aid in the design of the platform. The design of the platform was aided through the use of Simulink to conduct iterative testing and multivariate evaluations using Monte Carlo simulation methods. Once the topology of the leg was set, the detail design was conducted in Solidworks and validated with its built in simulation functions. In addition to the mechanical design of the platform, a specialist boom was designed. The design needed to compensate for the forces the robot exerts on the boom as well as the material constraints on the boom. This resulted in the development of a cable-stayed, four bar mechanism boom system. An embedded operating system was created to control the robot and take in and fuse sensor inputs. This was run using multiple sensors, sub-controllers and microcontrollers. Sensor fusion for the system was done using a Kalman Filter to improve readings and estimate unmeasured states of the robot. This Kalman Filter took LiDAR and accelerometer readings as inputs to the system to produce a subcentimetre accurate position measure for the system. Finally, the completed platform was validated using fixed-body forward hopping tests. These tests showed a significant degree of similarity to the simulated results and therefore validated the design process

Real-Time, Multiple Pan/Tilt/Zoom Computer Vision Tracking and 3D Positioning System for Unmanned Aerial System Metrology

The study of structural characteristics of Unmanned Aerial Systems (UASs) continues to be an important field of research for developing state of the art nano/micro systems. Development of a metrology system using computer vision (CV) tracking and 3D point extraction would provide an avenue for making these theoretical developments. This work provides a portable, scalable system capable of real-time tracking, zooming, and 3D position estimation of a UAS using multiple cameras. Current state-of-the-art photogrammetry systems use retro-reflective markers or single point lasers to obtain object poses and/or positions over time. Using a CV pan/tilt/zoom (PTZ) system has the potential to circumvent their limitations. The system developed in this paper exploits parallel-processing and the GPU for CV-tracking, using optical flow and known camera motion, in order to capture a moving object using two PTU cameras. The parallel-processing technique developed in this work is versatile, allowing the ability to test other CV methods with a PTZ system using known camera motion. Utilizing known camera poses, the object\u27s 3D position is estimated and focal lengths are estimated for filling the image to a desired amount. This system is tested against truth data obtained using an industrial system

Intelligent image cropping and scaling

Nowadays, there exist a huge number of end devices with different screen properties for watching television content, which is either broadcasted or transmitted over the internet. To allow best viewing conditions on each of these devices, different image formats have to be provided by the broadcaster. Producing content for every single format is, however, not applicable by the broadcaster as it is much too laborious and costly. The most obvious solution for providing multiple image formats is to produce one high resolution format and prepare formats of lower resolution from this. One possibility to do this is to simply scale video images to the resolution of the target image format. Two significant drawbacks are the loss of image details through ownscaling and possibly unused image areas due to letter- or pillarboxes. A preferable solution is to find the contextual most important region in the high-resolution format at first and crop this area with an aspect ratio of the target image format afterwards. On the other hand, defining the contextual most important region manually is very time consuming. Trying to apply that to live productions would be nearly impossible. Therefore, some approaches exist that automatically define cropping areas. To do so, they extract visual features, like moving reas in a video, and define regions of interest (ROIs) based on those. ROIs are finally used to define an enclosing cropping area. The extraction of features is done without any knowledge about the type of content. Hence, these approaches are not able to distinguish between features that might be important in a given context and those that are not. The work presented within this thesis tackles the problem of extracting visual features based on prior knowledge about the content. Such knowledge is fed into the system in form of metadata that is available from TV production environments. Based on the extracted features, ROIs are then defined and filtered dependent on the analysed content. As proof-of-concept, this application finally adapts SDTV (Standard Definition Television) sports productions automatically to image formats with lower resolution through intelligent cropping and scaling. If no content information is available, the system can still be applied on any type of content through a default mode. The presented approach is based on the principle of a plug-in system. Each plug-in represents a method for analysing video content information, either on a low level by extracting image features or on a higher level by processing extracted ROIs. The combination of plug-ins is determined by the incoming descriptive production metadata and hence can be adapted to each type of sport individually. The application has been comprehensively evaluated by comparing the results of the system against alternative cropping methods. This evaluation utilised videos which were manually cropped by a professional video editor, statically cropped videos and simply scaled, non-cropped videos. In addition to and apart from purely subjective evaluations, the gaze positions of subjects watching sports videos have been measured and compared to the regions of interest positions extracted by the system.EThOS - Electronic Theses Online ServiceGBUnited Kingdo