Enhanced colour encoding of materials discrimination information for multiple view dual-energy x-ray imaging

This thesis reports an investigation into dual-energy X-ray discrimination techniques. These techniques are designed to provide colour-coded materials discrimination information in a sequence of perspective images exhibiting sequential parallax. The methods developed are combined with a novel 3D imaging technique employing depth from motion or kinetic depth effect (KDE). This technique when applied to X-ray images is termed KDEX imaging and was developed previously by the university team for luggage screening applications at security checkpoints. A primary motivation for this research is that the dual-energy X-ray techniques, which are routinely incorporated into ‘standard’ 2D luggage scanners, provide relatively crude materials discrimination information. In this work it was critical that robust materials discrimination and colour encoding process was implemented as the sequential parallax exhibited by the KDEX imagery may introduce colour changes, due to the different X-ray beam paths associated with each perspective image. Any introduction of ‘colour noise’ into the resultant image sequences could affect the perception of depth and hinder the ongoing assessment of the potential utility of the dual-energy KDEX technique. Two dual-energy discrimination methods have been developed, termed K-II and W-E respectively. Employing the total amount of attenuation measured at each energy level and the weight fraction of layered structures, a combination of the K-II and the W-E techniques enables the computation and extraction of a target objects’ effective atomic number (Zeff) and its surface density (ρS) in the presence of masking layers

Sporadic absorption tomography using a conical shell X-ray beam

We demonstrate tomography by measuring a sporadic sequence of ring shaped projections collected during a translational scan. We show that projections using 10% sampling may be used to construct optical sections with peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) of the order of 40 dB and 0.9, respectively. This relatively small degradation in image fidelity was achieved for a 90% potential reduction in X-ray dose coupled with a reduction in scan time. Our approach is scalable in both X-ray energy and inspection volume. A driver for our method is to complement previously reported conical shell beam techniques concerning the measurement of diffracted flux for structural analysis. This work is of great relevance to time critical analytical scanning applications in security screening, process control and diagnostic imaging

View synthesis for kinetic depth X-ray imaging

This thesis reports the development and analysis of feature based synthesis of transmission X-ray images. The synthetic imagery is formed through matching and morphing or warping line-scan format images produced by a novel multi-view X-ray machine. In this way video type sequences, which periodically alternate between synthetic and detector based views, may be formed. The purpose of these sequences is to provide depth from motion or kinetic depth effect (KDE) in a visual display; while the role of the synthesis is to reduce the total number of detector arrays, associated collimators and X-ray flux per inspection. A specific challenge is to explore the bounds for producing synthetic imagery that can be seamlessly introduced into the resultant sequences. This work is distinct from the image collection and display technique, termed KDEX, previously undertaken by the Imaging Science Group at NTU. The ultimate aim of the research programme in collaboration with The UK Home Office and The US Dept. of Homeland Security is to enhance the detection and identification of threats in X-ray scans of luggage. A multi-view „KDEX scanner‟ was employed to collect greyscale and colour coded image sequences of 30 different bags; each sequence comprised of 7 perspective views separated from one another by 10. This imagery was organised and stored in a database to enable a coherent series of experiments to be conducted. Corresponding features in sequential pairs of images, at various different angular separations, were identified by applying a scale invariant feature transform (SIFT)

Flight data acquisition methodology for validation of passive ranging algorithms for obstacle avoidance

The automation of low-altitude rotorcraft flight depends on the ability to detect, locate, and navigate around obstacles lying in the rotorcraft's intended flightpath. Computer vision techniques provide a passive method of obstacle detection and range estimation, for obstacle avoidance. Several algorithms based on computer vision methods have been developed for this purpose using laboratory data; however, further development and validation of candidate algorithms require data collected from rotorcraft flight. A data base containing low-altitude imagery augmented with the rotorcraft and sensor parameters required for passive range estimation is not readily available. Here, the emphasis is on the methodology used to develop such a data base from flight-test data consisting of imagery, rotorcraft and sensor parameters, and ground-truth range measurements. As part of the data preparation, a technique for obtaining the sensor calibration parameters is described. The data base will enable the further development of algorithms for computer vision-based obstacle detection and passive range estimation, as well as provide a benchmark for verification of range estimates against ground-truth measurements

Application of signal detection theory to the recognition of objects in colour-encoded x-ray images

Aviation security personnel encounter problems when interpreting x-ray images of hand luggage. This research seeks to determine whether the performance of the human operator can be improved, in terms of both reliability and accuracy, through the employment of a novel multiple-view x-ray imaging technique. Thus, a series of experiments were undertaken with the aim of providing evidence for the feasibility of using KDEX displays to aid in the recognition of threatening objects in airport carry-on luggage; and furthermore demonstrate the real-world value of this technique. This thesis describes experiments comparing how introducing depth information affects the performance of aviation security personnel attempting to detect various weapons in x-ray images of hand luggage. Specifically, multiple 2-dimensional (2D) x-ray luggage scans were acquired and processed to create the perception of 3-dimensionality (3D) in kinetic displays. These results were compared with weapon detection in standard static 2D scans of the same luggage. Threatening objects hidden in this luggage were more readily detected in kinetic 3-dimensional images than in the standard images. Initial results were obtained using greyscale images and limited to various types of knives. Subsequent experiments evolved to primarily use pseudo-colour x-ray images

Quality-controlled audio-visual depth in stereoscopic 3D media

BACKGROUND: The literature proposes several algorithms that produce “quality-controlled” stereoscopic depth in 3D films by limiting the stereoscopic depth to a defined depth budget. Like stereoscopic displays, spatial sound systems provide the listener with enhanced (auditory) depth cues, and are now commercially available in multiple forms. AIM: We investigate the implications of introducing auditory depth cues to quality-controlled 3D media, by asking: “Is it important to quality-control audio-visual depth by considering audio-visual interactions, when integrating stereoscopic display and spatial sound systems?” MOTIVATION: There are several reports in literature of such “audio-visual interactions”, in which visual and auditory perception influence each other. We seek to answer our research question by investigating whether these audio-visual interactions could extend the depth budget used in quality-controlled 3D media. METHOD/CONCLUSIONS: The related literature is reviewed before presenting four novel experiments that build upon each other’s conclusions. In the first experiment, we show that content created with a stereoscopic depth budget creates measurable positive changes in audiences’ attitude towards 3D films. These changes are repeatable for different locations, displays and content. In the second experiment we calibrate an audio-visual display system and use it to measure the minimum audible depth difference. Our data is used to formulate recommendations for content designers and systems engineers. These recommendations include the design of an auditory depth perception screening test. We then show that an auditory-visual stimulus with a nearer auditory depth is perceived as nearer. We measure the impact of this effect upon a relative depth judgement, and investigate how the impact varies with audio-visual depth separation. Finally, the size of the cross-modal bias in depth is measured, from which we conclude that sound does have the potential to extend the depth budget by a small, but perceivable, amount

Characteristics of flight simulator visual systems

The physical parameters of the flight simulator visual system that characterize the system and determine its fidelity are identified and defined. The characteristics of visual simulation systems are discussed in terms of the basic categories of spatial, energy, and temporal properties corresponding to the three fundamental quantities of length, mass, and time. Each of these parameters are further addressed in relation to its effect, its appropriate units or descriptors, methods of measurement, and its use or importance to image quality

Optical instrumentation for fluid flow in gas turbines

Both a novel shearing interferometer and the first demonstration of particle image velocimetry (PIV) to the stator-rotor gap of a spinning turbine cascade are presented. Each of these techniques are suitable for measuring gas turbine representative flows. The simple interferometric technique has been demonstrated on a compressor representative flow in a 2-D wind tunnel. The interferometer has obvious limitations, as it requires a clear line of sight for the integration of refractive index along an optical path. Despite this, it is a credible alternative to schlieren or shadowgraph in that it provides both qualitative visualisation and a quantitative measurement of refractive index and the variables to which it is dependent without the vibration isolation requirements of beam splitting interferometry. The 2-D PIV measurements have been made in the stator-rotor gap of the MTI high-pressure turbine stage within DERA's Isentropic Light Piston Facility (lLPF). The measurements were made at full engine representative conditions adjacent to a rotor spinning at 8200 rpm. This is a particularly challenging application due to the complex geometry and random and periodic effects generated as the stator wake interacts with the adjacent spinning rotor. The application is further complicated due to the transient nature of the facility. The measurements represent a 2- D, instantaneous, quantitative description of the unsteady flow field and reveal evidence of shocks and wakes. The estimated accuracy after scaling, timing, particle centroid and particle lag errors have been considered is ± 5%. Non-smoothed, non-time averaged measurements are qualitatively compared with a numerical prediction generated using a 2-D unsteady flow solver (prediction supplied by DERA). A very close agreement has been achieved. A novel approach to characterising the third component of velocity from the diffraction rings of a defocusing particle viewed through a single camera has been explored. This 3-D PIV technique has been demonstrated on a nozzle flow but issues concerning the aberrations of the curved test section window of the turbine cascade could not be resolved in time for testing on the facility. Suggestions have been made towards solving this problem. Recommendations are also made towards the eventual goal of revealing a temporally and spatially resolved 3-D velocity distribution of the stator wake impinging on the passing rotor