Context-dependent fusion with application to landmine detection.

Traditional machine learning and pattern recognition systems use a feature descriptor to describe the sensor data and a particular classifier (also called expert or learner ) to determine the true class of a given pattern. However, for complex detection and classification problems, involving data with large intra-class variations and noisy inputs, no single source of information can provide a satisfactory solution. As a result, combination of multiple classifiers is playing an increasing role in solving these complex pattern recognition problems, and has proven to be viable alternative to using a single classifier. In this thesis we introduce a new Context-Dependent Fusion (CDF) approach, We use this method to fuse multiple algorithms which use different types of features and different classification methods on multiple sensor data. The proposed approach is motivated by the observation that there is no single algorithm that can consistently outperform all other algorithms. In fact, the relative performance of different algorithms can vary significantly depending on several factions such as extracted features, and characteristics of the target class. The CDF method is a local approach that adapts the fusion method to different regions of the feature space. The goal is to take advantages of the strengths of few algorithms in different regions of the feature space without being affected by the weaknesses of the other algorithms and also avoiding the loss of potentially valuable information provided by few weak classifiers by considering their output as well. The proposed fusion has three main interacting components. The first component, called Context Extraction, partitions the composite feature space into groups of similar signatures, or contexts. Then, the second component assigns an aggregation weight to each detector\u27s decision in each context based on its relative performance within the context. The third component combines the multiple decisions, using the learned weights, to make a final decision. For Context Extraction component, a novel algorithm that performs clustering and feature discrimination is used to cluster the composite feature space and identify the relevant features for each cluster. For the fusion component, six different methods were proposed and investigated. The proposed approached were applied to the problem of landmine detection. Detection and removal of landmines is a serious problem affecting civilians and soldiers worldwide. Several detection algorithms on landmine have been proposed. Extensive testing of these methods has shown that the relative performance of different detectors can vary significantly depending on the mine type, geographical site, soil and weather conditions, and burial depth, etc. Therefore, multi-algorithm, and multi-sensor fusion is a critical component in land mine detection. Results on large and diverse real data collections show that the proposed method can identify meaningful and coherent clusters and that different expert algorithms can be identified for the different contexts. Our experiments have also indicated that the context-dependent fusion outperforms all individual detectors and several global fusion methods

A generic framework for context-dependent fusion with application to landmine detection.

For complex detection and classification problems, involving data with large intra-class variations and noisy inputs, no single source of information can provide a satisfactory solution. As a result, combination of multiple classifiers is playing an increasing role in solving these complex pattern recognition problems, and has proven to be a viable alternative to using a single classifier. Over the past few years, a variety of schemes have been proposed for combining multiple classifiers. Most of these were global as they assign a degree of worthiness to each classifier, that is averaged over the entire training data. This may not be the optimal way to combine the different experts since the behavior of each one may not be uniform over the different regions of the feature space. To overcome this issue, few local methods have been proposed in the last few years. Local fusion methods aim to adapt the classifiers\u27 worthiness to different regions of the feature space. First, they partition the input samples. Then, they identify the best classifier for each partition and designate it as the expert for that partition. Unfortunately, current local methods are either computationally expensive and/or perform these two tasks independently of each other. However, feature space partition and algorithm selection are not independent and their optimization should be simultaneous. In this dissertation, we introduce a new local fusion approach, called Context Extraction for Local Fusion (CELF). CELF was designed to adapt the fusion to different regions of the feature space. It takes advantage of the strength of the different experts and overcome their limitations. First, we describe the baseline CELF algorithm. We formulate a novel objective function that combines context identification and multi-algorithm fusion criteria into a joint objective function. The context identification component thrives to partition the input feature space into different clusters (called contexts), while the fusion component thrives to learn the optimal fusion parameters within each cluster. Second, we propose several variations of CELF to deal with different applications scenario. In particular, we propose an extension that includes a feature discrimination component (CELF-FD). This version is advantageous when dealing with high dimensional feature spaces and/or when the number of features extracted by the individual algorithms varies significantly. CELF-CA is another extension of CELF that adds a regularization term to the objective function to introduce competition among the clusters and to find the optimal number of clusters in an unsupervised way. CELF-CA starts by partitioning the data into a large number of small clusters. As the algorithm progresses, adjacent clusters compete for data points, and clusters that lose the competition gradually become depleted and vanish. Third, we propose CELF-M that generalizes CELF to support multiple classes data sets. The baseline CELF and its extensions were formulated to use linear aggregation to combine the output of the different algorithms within each context. For some applications, this can be too restrictive and non-linear fusion may be needed. To address this potential drawback, we propose two other variations of CELF that use non-linear aggregation. The first one is based on Neural Networks (CELF-NN) and the second one is based on Fuzzy Integrals (CELF-FI). The latter one has the desirable property of assigning weights to subsets of classifiers to take into account the interaction between them. To test a new signature using CELF (or its variants), each algorithm would extract its set of features and assigns a confidence value. Then, the features are used to identify the best context, and the fusion parameters of this context are used to fuse the individual confidence values. For each variation of CELF, we formulate an objective function, derive the necessary conditions to optimize it, and construct an iterative algorithm. Then we use examples to illustrate the behavior of the algorithm, compare it to global fusion, and highlight its advantages. We apply our proposed fusion methods to the problem of landmine detection. We use data collected using Ground Penetration Radar (GPR) and Wideband Electro -Magnetic Induction (WEMI) sensors. We show that CELF (and its variants) can identify meaningful and coherent contexts (e.g. mines of same type, mines buried at the same site, etc.) and that different expert algorithms can be identified for the different contexts. In addition to the land mine detection application, we apply our approaches to semantic video indexing, image database categorization, and phoneme recognition. In all applications, we compare the performance of CELF with standard fusion methods, and show that our approach outperforms all these methods

Integration of ground-penetrating radar and gamma-ray detectors for non-intrusive localisation of buried radioactive sources

This thesis reports on the integration of ground-penetrating radar (GPR) and gamma ray detectors to improve the non-intrusive localisation of radioactive wastes buried in porous materials such as soil and concrete. The research was undertaken in two phases. In the first phase, a new non-intrusive technique for retrieving the depth of a buried radioactive source from two-dimensional raster radiation images was developed. The images were obtained by moving a gamma-ray detector in discrete steps on the surface of the material volume in which the source is buried and measuring the gamma spectrum at each step. The depth of the source was then estimated by fitting the intensity values from the measured spectra to an approximate three-dimensional gamma-ray attenuation model. This procedure was first optimised using Monte Carlo simulations and then validated using experiments. The results showed that this method is able to estimate the depth of a 658 kBq caesium-137 point source buried up to 18 cm in each of sand, soil and gravel. However, the use of only gamma-ray data to estimate the depth of the sources requires foreknowledge of the density of the embedding material. This is usually III IV difficult without having recourse to intrusive density estimation methods or historical density values. Therefore, the second phase of the research employed integrated GPR and gamma ray detection to solve this density requirement problem. Firstly, four density models were investigated using a suite of materials and the best model was then used to develop the integration method. Results from numerical simulations showed that the developed integration method can simultaneously retrieve the soil density and the depth and radius of disk-shaped radioactive objects buried up to 20 cm in soil of varying conditions with a elative error of less than 10%. Therefore, the integration method eliminates the need for prior knowledge of the density of the embedding material. This work represents the first time data from these two systems i.e., GPR and gamma-ray detector, will be integrated for the detection and localisation of radioactive sources. Furthermore, the results from the developed methods confirm that an integrated GPR and gamma-ray detector system is a viable tool for non-intrusive localisation of buried radioactive sources. This will enable improved characterisation of buried radioactive wastes encountered during the decommissioning of nuclear sites and facilities

An evaluation of the performance of multi-static handheld ground penetrating radar using full wave inversion for landmine detection

This thesis presents an empirical study comparing the ability of multi-static and bi-static, handheld, ground penetrating radar (GPR) systems, using full wave inversion (FWI), to determine the properties of buried anti-personnel (AP) landmines. A major problem associated with humanitarian demining is the occurrence of many false positives during clearance operations. Therefore, a reduction of the false alarm rate (FAR) and/or increasing the probability of detection (POD) is a key research and technical objective. Sensor fusion has emerged as a technique that promises to significantly enhance landmine detection. This study considers a handheld, combined metal detector (MD) and GPR device, and quantifies the advantages of the use of antenna arrays. During demining operations with such systems, possible targets are detected using the MD and further categorised using the GPR, possibly excluding false positives. A system using FWI imaging techniques to estimate the subsurface parameters is considered in this work.A previous study of multi-static GPR FWI used simplistic, 2D far-field propagation models, despite the targets being 3D and within the near field. This novel study uses full 3D electromagnetic (EM) wave simulation of the antenna arrays and propagation through the air and ground. Full EM simulation allows the sensitivity of radio measurements to landmine characteristics to be determined. The number and configuration of antenna elements are very important and must be optimised, contrary to the 2D sensitivity studies in (Watson, Lionheart 2014, Watson 2016) which conclude that the degree (number of elements) of the multi-static system is not critical. A novel sensitivity analysis for tilted handheld GPR antennas is used to demonstrate the positive impact of tilted antenna orientation on detection performance. A time domain GPR and A-scan data, consistent with a commercial handheld system, the MINEHOUND, is used throughout the simulated experiments which are based on synthetic GPR measurements.Finally, this thesis introduces a novel method of optimising the FWI solution through feature extraction or estimation of the internal air void typically present in pressure activated mines, to distinguish mines from non-mine targets and reduce the incidence of false positives

Radar Technology

In this book “Radar Technology”, the chapters are divided into four main topic areas: Topic area 1: “Radar Systems” consists of chapters which treat whole radar systems, environment and target functional chain. Topic area 2: “Radar Applications” shows various applications of radar systems, including meteorological radars, ground penetrating radars and glaciology. Topic area 3: “Radar Functional Chain and Signal Processing” describes several aspects of the radar signal processing. From parameter extraction, target detection over tracking and classification technologies. Topic area 4: “Radar Subsystems and Components” consists of design technology of radar subsystem components like antenna design or waveform design

Guidebook on Detection Technologies and Systems for Humanitarian Demining

The aim of this publication is to provide the mine action community, and those supporting mine action, with a consolidated review and status summary of detection technologies that could be applied to humanitarian demining operations. This Guidebook is meant to provide information to a wide variety of readers. For those not familiar with the spectrum of technologies being considered for the detection of landmines and for area reduction, there is a brief overview of the principle of operation for each technology as well as a summary listing of the strengths, limitations, and potential for use of the technology to humanitarian demining. For those with an intermediate level of understanding for detection technologies, there is information regarding some of the more technical details of the system to give an expanded overview of the principles involved and hardware development that has taken place. Where possible, technical specifications for the systems are provided. For those requiring more information for a particular system, relevant publications lists and contact information are also provided

Real-Time Hyperbola Recognition and Fitting in GPR Data

The problem of automatically recognising and fitting hyperbolae from Ground Penetrating Radar (GPR) images is addressed, and a novel technique computationally suitable for real time on-site application is proposed. After pre-processing of the input GPR images, a novel thresholding method is applied to separate the regions of interest from background. A novel column-connection clustering (C3) algorithm is then applied to separate the regions of interest from each other. Subsequently, a machine learnt model is applied to identify hyperbolic signatures from outputs of the C3 algorithm and a hyperbola is fitted to each such signature with an orthogonal distance hyperbola fitting algorithm. The novel clustering algorithm C3 is a central component of the proposed system, which enables the identification of hyperbolic signatures and hyperbola fitting. Only two features are used in the machine learning algorithm, which is easy to train using a small set of training data. An orthogonal distance hyperbola fitting algorithm for ‘south-opening’ hyperbolae is introduced in this work, which is more robust and accurate than algebraic hyperbola fitting algorithms. The proposed method can successfully recognise and fit hyperbolic signatures with intersections with others, hyperbolic signatures with distortions and incomplete hyperbolic signatures with one leg fully or largely missed. As an additional novel contribution, formulae to compute an initial ‘south-opening’ hyperbola directly from a set of given points are derived, which make the system more efficient. The parameters obtained by fitting hyperbolae to hyperbolic signatures are very important features, they can be used to estimate the location, size of the related target objects, and the average propagation velocity of the electromagnetic wave in the medium. The effectiveness of the proposed system is tested on both synthetic and real GPR data

Signal Processing Techniques for Landmine Detection Using Impulse Ground Penetrating Radar (ImGPR)

Landmines and unexploded ordinance (UXO) are laid during a conflict against enemy forces. However, they kill or maim civilians decades after the conflict has ended. There are more than 110 million landmines actively lodged in the globe. Every year more than 26,000 innocent civilians are killed or maimed. Most modern landmines are mainly nonmetallic or plastic, which are difficult to be detected using conventional metal detectors. Detection using hand-held prodding is a slow and expensive process. Impulse Ground Penetrating Radar (ImGPR) is a nondestructive technique capable of detecting shallowly buried nonmetallic anti-personnel (AP) and anti-tank (AT) landmines. In this PhD thesis, ImGPR is considered as a tool to detect landmines and UXO. The presence of strong ground clutter and noise degrade the performance of GPR. Hence, using a GPR sensor is almost impossible without the application of sophisticated signal processing. In electromagnetic wave propagation modeling, a multilayer transmission line technique is applied. It considers different soil types at different moisture levels. Plastic targets of different diameters are buried at different depths. The modeled signal is then used to estimate the ground and buried target parameters. In a parameter estimation procedure, a surface reflection parameter method (SRPM) is applied. Signal processing algorithms are implemented for clutter reduction and decision making purposes. Attention is mainly given to the development of techniques, that are applicable to real-time landmine detection. Advanced techniques are preceded by elementary preprocessing techniques, which are useful for signal correction and noise reduction. Background subtraction techniques based on multilayer modeling, spatial filtering and adaptive background subtraction are implemented. In addition to that, decorrelation and symmetry filtering techniques are also investigated. In the correlated decision fusion framework, local decisions are transmitted to the fusion center so as to compute a global decision. In this case, the concept of confidence information of local decisions is crucial to obtain acceptable detection results. The Bahadur-Lazarsfeld and Chow expansions are used to estimate the joint probability density function of the correlated decisions. Furthermore, a decision fusion based on fuzzy set is implemented. All proposed methods are evaluated using simulated as well as real GPR data measurements of many scenarios. The real data collection campaign took place at the Griesheim old airport and Botanischer Garten, Darmstadt, Germany in July 2011

Advanced Feature Learning and Representation in Image Processing for Anomaly Detection

Techniques for improving the information quality present in imagery for feature extraction are proposed in this thesis. Specifically, two methods are presented: soft feature extraction and improved Evolution-COnstructed (iECO) features. Soft features comprise the extraction of image-space knowledge by performing a per-pixel weighting based on an importance map. Through soft features, one is able to extract features relevant to identifying a given object versus its background. Next, the iECO features framework is presented. The iECO features framework uses evolutionary computation algorithms to learn an optimal series of image transforms, specific to a given feature descriptor, to best extract discriminative information. That is, a composition of image transforms are learned from training data to present a given feature descriptor with the best opportunity to extract its information for the application at hand. The proposed techniques are applied to an automatic explosive hazard detection application and significant results are achieved

Multi-function intelligent robotic in metals detection applications

Recent technologies for robotics have been offered an effective and efficient solution to safeguard workers from risks in their work environments. These risks involve radioactive, toxic, explosive and mines. In this paper, design and implement computer robot based on metal detection as well as avoiding obstacles automatically. The proposed wireless controlled robotic vehicle can be used in metal detection applications such as landmine detection, obstacles avoidance, selecting best routing without imposing human's harms and workforce aspects. The robotic wheel can sense the obstacles that positioning at ahead of its path, and also avoids the obstacles forward, left and right of its routes. The robot is controlled by using Bluetooth wireless communication to interface between the controller and the implemented robot. Furthermore, sensor IR (FC-03) for the metal detector and used ultrasonic sensor (HC-SR04) for objects or obstacles sensing. The presented controlled robotic designed for desert and dry soil that can replace the human role in avoiding obstacles and metal detection capabilities. The produced robot was useful due to it can detect metals and avoiding obstacles consecutively besides it was effective to select the best route based on the intelligent technique that adopted, the predefined metals by using an intelligent decision maker for route finder in a flat surface environment