Multi-Sensor Data Fusion between Radio Tomographic Imaging and Noise Radar

The lack of situational awareness within an operational environment is a problem that carries high risk and expensive consequences. Radio Tomographic Imaging (RTI) and noise radar are two proven technologies capable of through-wall imaging and foliage penetration. The intent of this thesis is to provide a proof of concept for the fusion of data from RTI and noise radar. The output of this thesis will consist of a performance comparison between the two technologies followed by the derivation of a fusion technique to produce a single image. Proposals have been made for the integration of multiple-input multiple-output (MIMO) radar with RTI, however, no research has been done. Data fusion between RTI and noise radar has not been explored in academia. The impact of the expected results will provide the RTI and noise radar community a proof of concept for the fusion of data from two disparate sensor technologies. RTI is a tenured field of study at Air Force Institute of Technology (AFIT), whose results can be used to produce a platform for further options to be considered for military surveillance applications. The novelty of fusing data from RTI and noise radar is achieved with the derivation of a fusion technique utilizing Tikhonov regularization. Analyzing the results of the Tikhonov influenced techniques reveals up to a 100% error decrease in target pixel location, a 75% error decrease in target centroid location, a 28% size decrease in target pixel dispersion and a 72% improvement in an ideal solution comparison. The results of the research prove that Multi-Sensor Data Fusion (MSDF) images are of greater quality than that of the images generated by the disparate sensors independently. This effectively provides the RTI and noise radar communities a proof of concept for the fusion of data from two disparate sensor technologies

Miniature mobile sensor platforms for condition monitoring of structures

In this paper, a wireless, multisensor inspection system for nondestructive evaluation (NDE) of materials is described. The sensor configuration enables two inspection modes-magnetic (flux leakage and eddy current) and noncontact ultrasound. Each is designed to function in a complementary manner, maximizing the potential for detection of both surface and internal defects. Particular emphasis is placed on the generic architecture of a novel, intelligent sensor platform, and its positioning on the structure under test. The sensor units are capable of wireless communication with a remote host computer, which controls manipulation and data interpretation. Results are presented in the form of automatic scans with different NDE sensors in a series of experiments on thin plate structures. To highlight the advantage of utilizing multiple inspection modalities, data fusion approaches are employed to combine data collected by complementary sensor systems. Fusion of data is shown to demonstrate the potential for improved inspection reliability

A Bayesian Approach to Broad-Area Nuclear and Radiological Search Operations

This dissertation describes the development, implementation, and initial performance testing of the Broad-Area Search Bayesian Processor (BASBP). The BASBP is a novel FORTAN code designed to combine the data from aerial radiation detection platforms with available geo-spatial data using Bayesian techniques to provide updated parameter estimates of the problem space. By employing empirical fits to the Monte Carlo photon flux estimates generated using MCNP6, the core BASBP model accounts for the increasing significance of photon scattering and absorption events with source-detector range. The BASBP employs Bayesian signal processing methods to estimate both the spatially varying background and the most likely signal contribution from radioactive sources of interest. In demonstrating the capabilities of the BASBP, it is shown that the coupling of Bayesian signal processing methods with radiation transport physics affords the opportunity to effectively treat the spatially varying background signal, improve the range at which detection, localization, and identification decisions are made; provide real-time recommendations on sensor employment; provide the framework for fusing data from multiple sensors and data from disparate sensor types (true multi-source data fusion); and, enhance the nuclear detection capabilities of first responder or national security organizations

Adaptive detection and tracking using multimodal information

This thesis describes work on fusing data from multiple sources of information, and focuses on two main areas: adaptive detection and adaptive object tracking in automated vision scenarios. The work on adaptive object detection explores a new paradigm in dynamic parameter selection, by selecting thresholds for object detection to maximise agreement between pairs of sources. Object tracking, a complementary technique to object detection, is also explored in a multi-source context and an efficient framework for robust tracking, termed the Spatiogram Bank tracker, is proposed as a means to overcome the difficulties of traditional histogram tracking. As well as performing theoretical analysis of the proposed methods, specific example applications are given for both the detection and the tracking aspects, using thermal infrared and visible spectrum video data, as well as other multi-modal information sources

Uncertainty Minimization in Robotic 3D Mapping Systems Operating in Dynamic Large-Scale Environments

This dissertation research is motivated by the potential and promise of 3D sensing technologies in safety and security applications. With specific focus on unmanned robotic mapping to aid clean-up of hazardous environments, under-vehicle inspection, automatic runway/pavement inspection and modeling of urban environments, we develop modular, multi-sensor, multi-modality robotic 3D imaging prototypes using localization/navigation hardware, laser range scanners and video cameras. While deploying our multi-modality complementary approach to pose and structure recovery in dynamic real-world operating conditions, we observe several data fusion issues that state-of-the-art methodologies are not able to handle. Different bounds on the noise model of heterogeneous sensors, the dynamism of the operating conditions and the interaction of the sensing mechanisms with the environment introduce situations where sensors can intermittently degenerate to accuracy levels lower than their design specification. This observation necessitates the derivation of methods to integrate multi-sensor data considering sensor conflict, performance degradation and potential failure during operation. Our work in this dissertation contributes the derivation of a fault-diagnosis framework inspired by information complexity theory to the data fusion literature. We implement the framework as opportunistic sensing intelligence that is able to evolve a belief policy on the sensors within the multi-agent 3D mapping systems to survive and counter concerns of failure in challenging operating conditions. The implementation of the information-theoretic framework, in addition to eliminating failed/non-functional sensors and avoiding catastrophic fusion, is able to minimize uncertainty during autonomous operation by adaptively deciding to fuse or choose believable sensors. We demonstrate our framework through experiments in multi-sensor robot state localization in large scale dynamic environments and vision-based 3D inference. Our modular hardware and software design of robotic imaging prototypes along with the opportunistic sensing intelligence provides significant improvements towards autonomous accurate photo-realistic 3D mapping and remote visualization of scenes for the motivating applications

An architectural selection framework for data fusion in sensor platforms

Thesis (S.M.)--Massachusetts Institute of Technology, System Design and Management Program, February 2007.Includes bibliographical references (leaves 97-100).The role of data fusion in sensor platforms is becoming increasingly important in various domains of science, technology and business. Fusion pertains to the merging or integration of information towards an enhanced level of awareness. This thesis provides a canonical overview of several major fusion architectures developed from the remote sensing and defense community. Additionally, it provides an assessment of current sensors and their platforms, the influence of reliability measures, and the connection to fusion applications. We present several types of architecture for managing multi-sensor data fusion, specifically as they relate to the tracking-correlation function and blackboard processing representations in knowledge engineering. Object-Process Methods are used to model the information fusion process and supporting systems. Several mathematical techniques are shown to be useful in the fusion of numerical properties, sensor data updating and the implementation of unique detection probabilities. Finally, we discuss the importance of fusion to the concept and operation of the Semantic Web, which promises new ways to exploit the synergy of multi-sensor data platforms. This requires the synthesis of fusion with ontology models for knowledge representation. We discuss the importance of fusion as a reuse process in ontological engineering, and review key lifecycle models in ontology development. The evolutionary approach to ontology development is considered the most useful and adaptable to the complexities of semantic networks. Several potential applications for data fusion are screened and ranked according to the Joint Directors of Laboratories (JDL) process model for information fusion. Based on these predetermined criteria, the case of medical diagnostic imaging was found to offer the most promising applications for fusion, on which future product platforms can be built.by Atif R. Mirza.S.M