Context-dependent fusion with application to landmine detection.

Traditional machine learning and pattern recognition systems use a feature descriptor to describe the sensor data and a particular classifier (also called expert or learner ) to determine the true class of a given pattern. However, for complex detection and classification problems, involving data with large intra-class variations and noisy inputs, no single source of information can provide a satisfactory solution. As a result, combination of multiple classifiers is playing an increasing role in solving these complex pattern recognition problems, and has proven to be viable alternative to using a single classifier. In this thesis we introduce a new Context-Dependent Fusion (CDF) approach, We use this method to fuse multiple algorithms which use different types of features and different classification methods on multiple sensor data. The proposed approach is motivated by the observation that there is no single algorithm that can consistently outperform all other algorithms. In fact, the relative performance of different algorithms can vary significantly depending on several factions such as extracted features, and characteristics of the target class. The CDF method is a local approach that adapts the fusion method to different regions of the feature space. The goal is to take advantages of the strengths of few algorithms in different regions of the feature space without being affected by the weaknesses of the other algorithms and also avoiding the loss of potentially valuable information provided by few weak classifiers by considering their output as well. The proposed fusion has three main interacting components. The first component, called Context Extraction, partitions the composite feature space into groups of similar signatures, or contexts. Then, the second component assigns an aggregation weight to each detector\u27s decision in each context based on its relative performance within the context. The third component combines the multiple decisions, using the learned weights, to make a final decision. For Context Extraction component, a novel algorithm that performs clustering and feature discrimination is used to cluster the composite feature space and identify the relevant features for each cluster. For the fusion component, six different methods were proposed and investigated. The proposed approached were applied to the problem of landmine detection. Detection and removal of landmines is a serious problem affecting civilians and soldiers worldwide. Several detection algorithms on landmine have been proposed. Extensive testing of these methods has shown that the relative performance of different detectors can vary significantly depending on the mine type, geographical site, soil and weather conditions, and burial depth, etc. Therefore, multi-algorithm, and multi-sensor fusion is a critical component in land mine detection. Results on large and diverse real data collections show that the proposed method can identify meaningful and coherent clusters and that different expert algorithms can be identified for the different contexts. Our experiments have also indicated that the context-dependent fusion outperforms all individual detectors and several global fusion methods

Theoretical Developments in Electromagnetic Induction Geophysics with Selected Applications in the Near Surface

Near-surface applied electromagnetic geophysics is experiencing an explosive period of growth with many innovative techniques and applications presently emergent and others certain to be forthcoming. An attempt is made here to bring together and describe some of the most notable advances. This is a difficult task since papers describing electromagnetic induction methods are widely dispersed throughout the scientific literature. The traditional topics discussed herein include modeling, inversion, heterogeneity, anisotropy, target recognition, logging, and airborne electromagnetics (EM). Several new or emerging techniques are introduced including landmine detection, biogeophysics, interferometry, shallow-water electromagnetics, radiomagnetotellurics, and airborne unexploded ordnance (UXO) discrimination. Representative case histories that illustrate the range of exciting new geoscience that has been enabled by the developing techniques are presented from important application areas such as hydrogeology, contamination, UXO and landmines, soils and agriculture, archeology, and hazards and climat

Hyperspectral Imaging for Landmine Detection

This PhD thesis aims at investigating the possibility to detect landmines using hyperspectral imaging. Using this technology, we are able to acquire at each pixel of the image spectral data in hundreds of wavelengths. So, at each pixel we obtain a reflectance spectrum that is used as fingerprint to identify the materials in each pixel, and mainly in our project help us to detect the presence of landmines. The proposed process works as follows: a preconfigured drone (hexarotor or octorotor) will carry the hyperspectral camera. This programmed drone is responsible of flying over the contaminated area in order to take images from a safe distance. Various image processing techniques will be used to treat the image in order to isolate the landmine from the surrounding. Once the presence of a mine or explosives is suspected, an alarm signal is sent to the base station giving information about the type of the mine, its location and the clear path that could be taken by the mine removal team in order to disarm the mine. This technology has advantages over the actually used techniques: • It is safer because it limits the need of humans in the searching process and gives the opportunity to the demining team to detect the mines while they are in a safe region. • It is faster. A larger area could be cleared in a single day by comparison with demining techniques • This technique can be used to detect at the same time objects other than mines such oil or minerals. First, a presentation of the problem of landmines that is expanding worldwide referring to some statistics from the UN organizations is provided. In addition, a brief presentation of different types of landmines is shown. Unfortunately, new landmines are well camouflaged and are mainly made of plastic in order to make their detection using metal detectors harder. A summary of all landmine detection techniques is shown to give an idea about the advantages and disadvantages of each technique. In this work, we give an overview of different projects that worked on the detection of landmines using hyperspectral imaging. We will show the main results achieved in this field and future work to be done in order to make this technology effective. Moreover, we worked on different target detection algorithms in order to achieve high probability of detection with low false alarm rate. We tested different statistical and linear unmixing based methods. In addition, we introduced the use of radial basis function neural networks in order to detect landmines at subpixel level. A comparative study between different detection methods will be shown in the thesis. A study of the effect of dimensionality reduction using principal component analysis prior to classification is also provided. The study shows the dependency between the two steps (feature extraction and target detection). The selection of target detection algorithm will define if feature extraction in previous phase is necessary. A field experiment has been done in order to study how the spectral signature of landmine will change depending on the environment in which the mine is planted. For this, we acquired the spectral signature of 6 types of landmines in different conditions: in Lab where specific source of light is used; in field where mines are covered by grass; and when mines are buried in soil. The results of this experiment are very interesting. The signature of two types of landmines are used in the simulations. They are a database necessary for supervised detection of landmines. Also we extracted some spectral characteristics of landmines that would help us to distinguish mines from background

A generic framework for context-dependent fusion with application to landmine detection.

For complex detection and classification problems, involving data with large intra-class variations and noisy inputs, no single source of information can provide a satisfactory solution. As a result, combination of multiple classifiers is playing an increasing role in solving these complex pattern recognition problems, and has proven to be a viable alternative to using a single classifier. Over the past few years, a variety of schemes have been proposed for combining multiple classifiers. Most of these were global as they assign a degree of worthiness to each classifier, that is averaged over the entire training data. This may not be the optimal way to combine the different experts since the behavior of each one may not be uniform over the different regions of the feature space. To overcome this issue, few local methods have been proposed in the last few years. Local fusion methods aim to adapt the classifiers\u27 worthiness to different regions of the feature space. First, they partition the input samples. Then, they identify the best classifier for each partition and designate it as the expert for that partition. Unfortunately, current local methods are either computationally expensive and/or perform these two tasks independently of each other. However, feature space partition and algorithm selection are not independent and their optimization should be simultaneous. In this dissertation, we introduce a new local fusion approach, called Context Extraction for Local Fusion (CELF). CELF was designed to adapt the fusion to different regions of the feature space. It takes advantage of the strength of the different experts and overcome their limitations. First, we describe the baseline CELF algorithm. We formulate a novel objective function that combines context identification and multi-algorithm fusion criteria into a joint objective function. The context identification component thrives to partition the input feature space into different clusters (called contexts), while the fusion component thrives to learn the optimal fusion parameters within each cluster. Second, we propose several variations of CELF to deal with different applications scenario. In particular, we propose an extension that includes a feature discrimination component (CELF-FD). This version is advantageous when dealing with high dimensional feature spaces and/or when the number of features extracted by the individual algorithms varies significantly. CELF-CA is another extension of CELF that adds a regularization term to the objective function to introduce competition among the clusters and to find the optimal number of clusters in an unsupervised way. CELF-CA starts by partitioning the data into a large number of small clusters. As the algorithm progresses, adjacent clusters compete for data points, and clusters that lose the competition gradually become depleted and vanish. Third, we propose CELF-M that generalizes CELF to support multiple classes data sets. The baseline CELF and its extensions were formulated to use linear aggregation to combine the output of the different algorithms within each context. For some applications, this can be too restrictive and non-linear fusion may be needed. To address this potential drawback, we propose two other variations of CELF that use non-linear aggregation. The first one is based on Neural Networks (CELF-NN) and the second one is based on Fuzzy Integrals (CELF-FI). The latter one has the desirable property of assigning weights to subsets of classifiers to take into account the interaction between them. To test a new signature using CELF (or its variants), each algorithm would extract its set of features and assigns a confidence value. Then, the features are used to identify the best context, and the fusion parameters of this context are used to fuse the individual confidence values. For each variation of CELF, we formulate an objective function, derive the necessary conditions to optimize it, and construct an iterative algorithm. Then we use examples to illustrate the behavior of the algorithm, compare it to global fusion, and highlight its advantages. We apply our proposed fusion methods to the problem of landmine detection. We use data collected using Ground Penetration Radar (GPR) and Wideband Electro -Magnetic Induction (WEMI) sensors. We show that CELF (and its variants) can identify meaningful and coherent contexts (e.g. mines of same type, mines buried at the same site, etc.) and that different expert algorithms can be identified for the different contexts. In addition to the land mine detection application, we apply our approaches to semantic video indexing, image database categorization, and phoneme recognition. In all applications, we compare the performance of CELF with standard fusion methods, and show that our approach outperforms all these methods

An evaluation of the performance of multi-static handheld ground penetrating radar using full wave inversion for landmine detection

This thesis presents an empirical study comparing the ability of multi-static and bi-static, handheld, ground penetrating radar (GPR) systems, using full wave inversion (FWI), to determine the properties of buried anti-personnel (AP) landmines. A major problem associated with humanitarian demining is the occurrence of many false positives during clearance operations. Therefore, a reduction of the false alarm rate (FAR) and/or increasing the probability of detection (POD) is a key research and technical objective. Sensor fusion has emerged as a technique that promises to significantly enhance landmine detection. This study considers a handheld, combined metal detector (MD) and GPR device, and quantifies the advantages of the use of antenna arrays. During demining operations with such systems, possible targets are detected using the MD and further categorised using the GPR, possibly excluding false positives. A system using FWI imaging techniques to estimate the subsurface parameters is considered in this work.A previous study of multi-static GPR FWI used simplistic, 2D far-field propagation models, despite the targets being 3D and within the near field. This novel study uses full 3D electromagnetic (EM) wave simulation of the antenna arrays and propagation through the air and ground. Full EM simulation allows the sensitivity of radio measurements to landmine characteristics to be determined. The number and configuration of antenna elements are very important and must be optimised, contrary to the 2D sensitivity studies in (Watson, Lionheart 2014, Watson 2016) which conclude that the degree (number of elements) of the multi-static system is not critical. A novel sensitivity analysis for tilted handheld GPR antennas is used to demonstrate the positive impact of tilted antenna orientation on detection performance. A time domain GPR and A-scan data, consistent with a commercial handheld system, the MINEHOUND, is used throughout the simulated experiments which are based on synthetic GPR measurements.Finally, this thesis introduces a novel method of optimising the FWI solution through feature extraction or estimation of the internal air void typically present in pressure activated mines, to distinguish mines from non-mine targets and reduce the incidence of false positives

Classification of Metallic Targets Using a Walk-Through Metal Detection Portal

Metal detectors have been used for a long time for treasure hunting, security screening, and finding buried objects such as landmines or unexploded ordnance. Walk-through metal detection (WTMD) portals are used for making sure that forbidden or threatening metallic items, such as knives or guns, are not carried into secure areas at critical locations such as airports, court rooms, embassies, and prisons.The 9/11 terrorist act has given rise to stricter rules for aviation security worldwide, and the ensuing tighter security procedures have meant that passengers face more delays at airports. Moreover, the fear of terrorism has led to the adoption of security screening technology in a variety of places such as railway and coach stations, sports events, malls, and nightclubs.However, the current WTMD technology and scanning procedures at airports require that all metallic items be removed from clothing prior to scanning, causing inconvenience. Furthermore, alarms are triggered by innocuous items such as shoe shanks and artificial joints, along with overlooked items such as jewellery and belts. These lead to time- consuming, manual pat-down searches, which are found inconvenient, uncomfortable, and obtrusive by some.Modern WTMD portals are very sensitive devices that can detect items with only small amounts of metal, but they currently lack the ability to further classify the detected item. However, if a WTMD portal were able to classify objects reliably into, e.g., “knives”, “belts”, “keys”, the need for removing the items prior to screening would disappear, enabling a paradigm shift in the field of security screening.This thesis is based on novel research presented in five peer-reviewed publications. The scope of the problem has been narrowed down to a situation in which only one metallic item is carried through the portal at a time. However, the methods and results presented in this thesis can be generalized into a multi-object scenario. It has been shown that by using a WTMD portal and the magnetic polarisability tensor, it is possible to accurately distinguish between threatening and innocuous targets and to classify them into 10 to 13 arbitrary classes. Furthermore, a data library consisting of natural walk-throughs has been collected, and it has been demonstrated that the walk-through data collected with the above portal are subject to phenomena that might affect classification, in particular a bias and the so-called body effect. However, the publications show that, by using realistic walk-through data, high classification accuracy can be maintained regardless of the above problems. Furthermore, a self-diagnostics method for detecting unreliable samples has also been presented with potential to significantly increase classification accuracy and the reliability of decision making.The contributions presented in this thesis have a variety of implications in the field of WTMD-based security screening. The novel technology offers more information, such as an indication of the probable cause of the alarm, to support the conventional screening procedure. Moreover, eliminating the need for removing all metallic items prior to screening enables design of new products for scenarios such as sports events, where conventional screening procedures might be inconvenient, creating thus new business possibilities for WTMD manufacturing companies.The positive results give rise to a variety of future research topics such as using wideband data, enabling simultaneous classification of multiple objects, and developing the portal coil design to diminish signal nonlinearities. Furthermore, the ideas and the basic principles presented in this thesis may be applied to other metal detection applications, such as humanitarian demining

A Multidisciplinary Analysis of Frequency Domain Metal Detectors for Humanitarian Demining

This thesis details an analysis of metal detectors (low frequency electromagnetic induction devices) with emphasis on Frequency Domain (FD) systems and the operational conditions of interest to humanitarian demining. After an initial look at humanitarian demining and a review of their basic principles we turn our attention to electromagnetic induction modelling and to analytical solutions to some basic FD direct (forward) problems. The second half of the thesis focuses then on the analysis of an extensive amount of experimental data. The possibility of target classification is first discussed on a qualitative basis, then quantitatively. Finally, we discuss shape and size determination via near field imaging