Automatic X-ray Image Segmentation and Clustering for Threat Detection

Firearms currently pose a known risk at the borders. The enormous number of X-ray images from parcels, luggage and freight coming into each country via rail, aviation and maritime presents a continual challenge to screening officers. To further improve UK capability and aid officers in their search for firearms we suggest an automated object segmentation and clustering architecture to focus officers’ attentions to high-risk threat objects. Our proposal utilizes dual-view single/ dual-energy 2D X-ray imagery and is a blend of radiology, image processing and computer vision concepts. It consists of a triple-layered processing scheme that supports segmenting the luggage contents based on the effective atomic number of each object, which is then followed by a dual-layered clustering procedure. The latter comprises of mild and a hard clustering phase. The former is based on a number of morphological operations obtained from the image-processing domain and aims at disjoining mild-connected objects and to filter noise. The hard clustering phase exploits local feature matching techniques obtained from the computer vision domain, aiming at sub-clustering the clusters obtained from the mild clustering stage. Evaluation on highly challenging single and dual-energy X-ray imagery reveals the architecture’s promising performance

Enhanced colour encoding of materials discrimination information for multiple view dual-energy x-ray imaging

This thesis reports an investigation into dual-energy X-ray discrimination techniques. These techniques are designed to provide colour-coded materials discrimination information in a sequence of perspective images exhibiting sequential parallax. The methods developed are combined with a novel 3D imaging technique employing depth from motion or kinetic depth effect (KDE). This technique when applied to X-ray images is termed KDEX imaging and was developed previously by the university team for luggage screening applications at security checkpoints. A primary motivation for this research is that the dual-energy X-ray techniques, which are routinely incorporated into ‘standard’ 2D luggage scanners, provide relatively crude materials discrimination information. In this work it was critical that robust materials discrimination and colour encoding process was implemented as the sequential parallax exhibited by the KDEX imagery may introduce colour changes, due to the different X-ray beam paths associated with each perspective image. Any introduction of ‘colour noise’ into the resultant image sequences could affect the perception of depth and hinder the ongoing assessment of the potential utility of the dual-energy KDEX technique. Two dual-energy discrimination methods have been developed, termed K-II and W-E respectively. Employing the total amount of attenuation measured at each energy level and the weight fraction of layered structures, a combination of the K-II and the W-E techniques enables the computation and extraction of a target objects’ effective atomic number (Zeff) and its surface density (ρS) in the presence of masking layers

View synthesis for kinetic depth X-ray imaging

This thesis reports the development and analysis of feature based synthesis of transmission X-ray images. The synthetic imagery is formed through matching and morphing or warping line-scan format images produced by a novel multi-view X-ray machine. In this way video type sequences, which periodically alternate between synthetic and detector based views, may be formed. The purpose of these sequences is to provide depth from motion or kinetic depth effect (KDE) in a visual display; while the role of the synthesis is to reduce the total number of detector arrays, associated collimators and X-ray flux per inspection. A specific challenge is to explore the bounds for producing synthetic imagery that can be seamlessly introduced into the resultant sequences. This work is distinct from the image collection and display technique, termed KDEX, previously undertaken by the Imaging Science Group at NTU. The ultimate aim of the research programme in collaboration with The UK Home Office and The US Dept. of Homeland Security is to enhance the detection and identification of threats in X-ray scans of luggage. A multi-view „KDEX scanner‟ was employed to collect greyscale and colour coded image sequences of 30 different bags; each sequence comprised of 7 perspective views separated from one another by 10. This imagery was organised and stored in a database to enable a coherent series of experiments to be conducted. Corresponding features in sequential pairs of images, at various different angular separations, were identified by applying a scale invariant feature transform (SIFT)

Enhanced information extraction in the multi-energy x-ray tomography for security

Thesis (Ph.D.)--Boston UniversityX-ray Computed Tomography (CT) is an effective nondestructive technology widely used for medical diagnosis and security. In CT, three-dimensional images of the interior of an object are generated based on its X-ray attenuation. Conventional CT is performed with a single energy spectrum and materials can only be differentiated based on an averaged measure of the attenuation. Multi-Energy CT (MECT) methods have been developed to provide more information about the chemical composition of the scanned material using multiple energy-selective measurements of the attenuation. Existing literature on MECT is mostly focused on differentiation between body tissues and other medical applications. The problems in security are more challenging due to the larger range of materials and threats which may be found. Objects may appear in high clutter and in different forms of concealment. Thus, the information extracted by the medical domain methods may not be optimal for detection of explosives and improved performance is desired. In this dissertation, learning and adaptive model-based methods are developed to address the challenges of multi-energy material discrimination for security. First, the fundamental information contained in the X-ray attenuation versus energy curves of materials is studied. For this purpose, a database of these curves for a set of explosive and non-explosive compounds was created. The dimensionality and span of the curves is estimated and their space is shown to be larger than two-dimensional, contrary to what is typically assumed. In addition, optimized feature selection methods are developed and applied to the curves and it is demonstrated that detection performance may be improved by using more than two features and when using features different than the standard photoelectric and Compton coefficients. Second, several MECT reconstruction methods are studied and compared. This includes a new structure-preserving inversion technique which can mitigate metal artifacts and provide precise object localization in the estimated parameter images. Finally, a learning-based MECT framework for joint material classification and segmentation is developed, which can produce accurate material labels in the presence of metal and clutter. The methods are tested on simulated and real multi-energy data and it is shown that they outperform previously published MECT techniques

Reconstruction algorithms for multispectral diffraction imaging

Thesis (Ph.D.)--Boston UniversityIn conventional Computed Tomography (CT) systems, a single X-ray source spectrum is used to radiate an object and the total transmitted intensity is measured to construct the spatial linear attenuation coefficient (LAC) distribution. Such scalar information is adequate for visualization of interior physical structures, but additional dimensions would be useful to characterize the nature of the structures. By imaging using broadband radiation and collecting energy-sensitive measurement information, one can generate images of additional energy-dependent properties that can be used to characterize the nature of specific areas in the object of interest. In this thesis, we explore novel imaging modalities that use broadband sources and energy-sensitive detection to generate images of energy-dependent properties of a region, with the objective of providing high quality information for material component identification. We explore two classes of imaging problems: 1) excitation using broad spectrum sub-millimeter radiation in the Terahertz regime and measure- ment of the diffracted Terahertz (THz) field to construct the spatial distribution of complex refractive index at multiple frequencies; 2) excitation using broad spectrum X-ray sources and measurement of coherent scatter radiation to image the spatial distribution of coherent-scatter form factors. For these modalities, we extend approaches developed for multimodal imaging and propose new reconstruction algorithms that impose regularization structure such as common object boundaries across reconstructed regions at different frequencies. We also explore reconstruction techniques that incorporate prior knowledge in the form of spectral parametrization, sparse representations over redundant dictionaries and explore the advantage and disadvantages of these techniques in terms of image quality and potential for accurate material characterization. We use the proposed reconstruction techniques to explore alternative architectures with reduced scanning time and increased signal-to-noise ratio, including THz diffraction tomography, limited angle X-ray diffraction tomography and the use of coded aperture masks. Numerical experiments and Monte Carlo simulations were conducted to compare performances of the developed methods, and validate the studied architectures as viable options for imaging of energy-dependent properties

Enhanced reconstruction and material recognition in X-ray CT for security applications

X-ray Computed Tomography (CT) is a non-destructive way of imaging object interiors, with broad applications in medical, industrial, and security imaging. This dissertation is motivated by X-ray CT for security imaging. In security applications, CT scanners are used at airports to scan passenger baggage, parcels, and air cargo. Unlike other imaging applications, security imaging needs to characterize the materials being scanned. Material characterization requires accurate estimation of properties such as effective atomic number and density of all materials. X-ray CT offers the potential for estimation of such material properties, by reconstructing the X-ray attenuation coefficients at different spatial locations, particularly when multiple sets of measurements of the scene are acquired with different spectral energy distributions. However, the reconstructed images have distortions due to monochromatic approximations, low signal-to-noise ratio, and the presence of high-density materials such as metal. Coupled with the wide range of possible materials in baggage, these distortions can lead to inaccurate material characterization. This is further compounded by the use of limited view sensing geometries, which are increasingly used because of lower costs and lower dosage for increased throughput. In this dissertation, we provide novel reconstruction algorithms and material characterization algorithms for multi-spectral X-ray CT. We first explore dual-energy CT (DECT), where two distinct sets of measurements of the scene are captured. We decompose the measurements into basis sinograms and generate basis coefficient images to estimate material properties. We integrate metal artifact reduction techniques commonly found in single energy CT with dual-basis image reconstructions and propose novel reconstruction algorithms to reduce noise and metal artifacts in DECT. We further explore various alternative basis functions for enhanced material identification. We then extend the reconstruction algorithms to generate basis coefficient images from multi-spectral CT (MECT) where more than two sets of measurements are collected. We propose a novel technique to estimate effective atomic number and electron density with MECT combining basis coefficient image reconstructions and direct energy bin reconstructions. Finally, we extend our reconstruction algorithms for artifact reduction in a commercial 3D cargo scanner with limited angle illumination

Algorithms for enhanced artifact reduction and material recognition in computed tomography

Computed tomography (CT) imaging provides a non-destructive means to examine the interior of an object which is a valuable tool in medical and security applications. The variety of materials seen in the security applications is higher than in the medical applications. Factors such as clutter, presence of dense objects, and closely placed items in a bag or a parcel add to the difficulty of the material recognition in security applications. Metal and dense objects create image artifacts which degrade the image quality and deteriorate the recognition accuracy. Conventional CT machines scan the object using single source or dual source spectra and reconstruct the effective linear attenuation coefficient of voxels in the image which may not provide the sufficient information to identify the occupying materials. In this dissertation, we provide algorithmic solutions to enhance CT material recognition. We provide a set of algorithms to accommodate different classes of CT machines. First, we provide a metal artifact reduction algorithm for conventional CT machines which perform the measurements using single X-ray source spectrum. Compared to previous methods, our algorithm is robust to severe metal artifacts and accurately reconstructs the regions that are in proximity to metal. Second, we propose a novel joint segmentation and classification algorithm for dual-energy CT machines which extends prior work to capture spatial correlation in material X-ray attenuation properties. We show that the classification performance of our method surpasses the prior work's result. Third, we propose a new framework for reconstruction and classification using a new class of CT machines known as spectral CT which has been recently developed. Spectral CT uses multiple energy windows to scan the object, thus it captures data across higher energy dimensions per detector. Our reconstruction algorithm extracts essential features from the measured data by using spectral decomposition. We explore the effect of using different transforms in performing the measurement decomposition and we develop a new basis transform which encapsulates the sufficient information of the data and provides high classification accuracy. Furthermore, we extend our framework to perform the task of explosive detection. We show that our framework achieves high detection accuracy and it is robust to noise and variations. Lastly, we propose a combined algorithm for spectral CT, which jointly reconstructs images and labels each region in the image. We offer a tractable optimization method to solve the proposed discrete tomography problem. We show that our method outperforms the prior work in terms of both reconstruction quality and classification accuracy