Image-based 3-D reconstruction of constrained environments

Nuclear power plays a important role to the United Kingdom electricity generation infrastructure, providing a reliable baseload of low carbon electricity. The Advanced Gas-cooled Reactor (AGR) design makes up approximately 50% of the existing fleet, however, many of the operating reactors have exceeding their original design lifetimes.To ensure safe reactor operation, engineers perform periodic in-core visual inspections of reactor components to monitor the structural health of the core as it ages. However, current inspection mechanisms deployed provide limited structural information about the fuel channel or defects.;This thesis investigates the suitability of image-based 3-D reconstruction techniques to acquire 3-D structural geometry to enable improved diagnostic and prognostic abilities for inspection engineers. The application of image-based 3-D reconstruction to in-core inspection footage highlights significant challenges, most predominantly that the image saliency proves insuffcient for general reconstruction frameworks. The contribution of the thesis is threefold. Firstly, a novel semi-dense matching scheme which exploits sparse and dense image correspondence in combination with a novel intra-image region strength approach to improve the stability of the correspondence between images.;This results in a percentage increase of 138.53% of correct feature matches over similar state-of-the-art image matching paradigms. Secondly, a bespoke incremental Structure-from-Motion (SfM) framework called the Constrained Homogeneous SfM (CH-SfM) which is able to derive structure from deficient feature spaces and constrained environments. Thirdly, the application of the CH-SfM framework to remote visual inspection footage gathered within AGR fuel channels, outperforming other state-of-the-art reconstruction approaches and extracting representative 3-D structural geometry of orientational scans and fully circumferential reconstructions.;This is demonstrated on in-core and laboratory footage, achieving an approximate 3-D point density of 2.785 - 23.8025NX/cm² for real in-core inspection footage and high quality laboratory footage respectively. The demonstrated novelties have applicability to other constrained or feature-poor environments, with future work looking to producing fully dense, photo-realistic 3-D reconstructions.Nuclear power plays a important role to the United Kingdom electricity generation infrastructure, providing a reliable baseload of low carbon electricity. The Advanced Gas-cooled Reactor (AGR) design makes up approximately 50% of the existing fleet, however, many of the operating reactors have exceeding their original design lifetimes.To ensure safe reactor operation, engineers perform periodic in-core visual inspections of reactor components to monitor the structural health of the core as it ages. However, current inspection mechanisms deployed provide limited structural information about the fuel channel or defects.;This thesis investigates the suitability of image-based 3-D reconstruction techniques to acquire 3-D structural geometry to enable improved diagnostic and prognostic abilities for inspection engineers. The application of image-based 3-D reconstruction to in-core inspection footage highlights significant challenges, most predominantly that the image saliency proves insuffcient for general reconstruction frameworks. The contribution of the thesis is threefold. Firstly, a novel semi-dense matching scheme which exploits sparse and dense image correspondence in combination with a novel intra-image region strength approach to improve the stability of the correspondence between images.;This results in a percentage increase of 138.53% of correct feature matches over similar state-of-the-art image matching paradigms. Secondly, a bespoke incremental Structure-from-Motion (SfM) framework called the Constrained Homogeneous SfM (CH-SfM) which is able to derive structure from deficient feature spaces and constrained environments. Thirdly, the application of the CH-SfM framework to remote visual inspection footage gathered within AGR fuel channels, outperforming other state-of-the-art reconstruction approaches and extracting representative 3-D structural geometry of orientational scans and fully circumferential reconstructions.;This is demonstrated on in-core and laboratory footage, achieving an approximate 3-D point density of 2.785 - 23.8025NX/cm² for real in-core inspection footage and high quality laboratory footage respectively. The demonstrated novelties have applicability to other constrained or feature-poor environments, with future work looking to producing fully dense, photo-realistic 3-D reconstructions

A Visualization Tool Used to Develop New Photon Mapping Techniques

We present a visualisation tool aimed specifically at the development and optimisation of photon map denoising methods. Our tool allows the rapid testing of hypotheses and algorithms through the use of parallel coordinates, domain-specific scripting, color mapping and point plots. Interaction is carried out by brushing, adjusting parameters and focus-plus-context, and yields interactive visual feedback and debugging information. We demonstrate the use of the tool to explore high-dimensional photon map data, facilitating the discovery of novel parameter spaces which can be used to dissociate complex caustic illumination. We then show how these new parameterisations may be used to improve upon pre-existing noise removal methods in the context of the photon relaxation framework

Automated data inspection in jet engines

Rolls Royce accumulate a large amount of sensor data throughout the testing and deployment of their engines. The availability of this rich source of data offers exciting opportunities to automate the monitoring and testing of the engines. In this thesis we have developed statistical models to make meaningful insights from engine test data. We have built a classification model to identify different types of engine running in Pass-Off tests. The labels can be used for post-analysis and highlight problematic engine tests. The model has been applied to two different types of engines, in which it gives close to perfect classification accuracy. We have also created an unsupervised approach when there are no defined classes of engine running. These models have been incorporated into Rolls Royce systems. Early warnings for potential issues can enable relatively cheap maintenance to be performed and reduce the risk of irreparable engine damage. We have therefore developed an outlier detection model to identify abnormal temperature behaviour. The capabilities of the model are shown theoretically and tested on experimental and real data. Lastly, in a test decisions are made by engineers to ensure the engine complies with certain standards. To support the engineers we have developed a predictive model to identify segments of the engine test that should be retested. The model is tested against the current decision making of the engineers, and gives good predictive performance. The model highlights the possibility of automating the decision making process within a test

Using Geovisual Analytics to investigate the performance of Geographically Weighted Discriminant Analysis

Geographically Weighted Discriminant Analysis (GWDA) is a method for prediction and analysis of categorical spatial data. It is an extension of Linear Discriminant Analysis (LDA) that allows the relationship between the predictor variables and the categories to vary spatially. This is also referred to spatial non-stationarity. If spatial non-stationarity exists, GWDA should model the relationship between the categories and predictor variables more accurately, thus resulting in a lower classification uncertainty and ultimately a higher classification accuracy. The GWDA output also requires interpretation to understand which variables are important in driving the classification in different geographical regions. This research uses interactive visualisations from the field of geovisual analytics to investigate the performance of GWDA in terms of classification accuracy, classification uncertainty and spatial non-stationarity. The methodology is demonstrated in a case study that uses GWDA to examine the relationship between county level voting patterns in the 2004 US presidential election and five socio-economic indicators. This research builds on existing techniques to interpret the GWDA output and provides additional insight into the processes driving the classification. It also demonstrates a practical application of geovisual analytic tools

A Survey on Explainable Anomaly Detection

In the past two decades, most research on anomaly detection has focused on improving the accuracy of the detection, while largely ignoring the explainability of the corresponding methods and thus leaving the explanation of outcomes to practitioners. As anomaly detection algorithms are increasingly used in safety-critical domains, providing explanations for the high-stakes decisions made in those domains has become an ethical and regulatory requirement. Therefore, this work provides a comprehensive and structured survey on state-of-the-art explainable anomaly detection techniques. We propose a taxonomy based on the main aspects that characterize each explainable anomaly detection technique, aiming to help practitioners and researchers find the explainable anomaly detection method that best suits their needs.Comment: Paper accepted by the ACM Transactions on Knowledge Discovery from Data (TKDD) for publication (preprint version

Investigating the Effect of Variable Mass Loading in Structural Health Monitoring from a Machine Learning Perspective

This study is centered around investigating the effects of operational loading variations caused by various fuel tank loading on an aircraft wing from the perspective of Structural Health Monitoring (SHM) and Machine Learning (ML) paradigm. The main goal is to detect and identify various damage severities under the influence of various loading conditions. To perform the task, a vibration response from an aircraft wing structure is first acquired and measured through accelerometers placed around the structure, which the Frequency Response Function is then computed. The structure’s most important characteristics that is its natural frequencies are extracted using Principal Component Analysis (PCA), which the principal components data becomes the input of an Artificial Neural Network model in aim to predict various damage severities under the effects of various loading variables. The work comprised of two main parts; the first part is a Vibration Based Damaged Detection (VBDD) experiment performed on a replicated wing box structure, which is attached with two pseudo-fuel-tanks located on top of the structure. The findings are then concluded and supported with a final vibration test performed on a real and full-scale aircraft wing which its fuel tank loading is varied extensively throughout the test. Kernel PCA (KPCA) techniques are introduced into the current work with aim to improve data separation from different data groups mainly from smaller damage groups. Besides that, the goal is also trying to minimize false negative damage detection due to the effects of loading variables. The finding from this study has highlighted that nonlinear PCA by kernel Gaussian PCA can improve the chance of detecting damage as well reducing the false negative damage detection. The study also provides a data insight by exploring the data structure obtained from the wing box through Gaussian Mixture Model (GMM), which the first two principal components are considered in building the GMM model. This study intends to serve as a data exploratory framework from a statistics and ML perspective in the interest of SHM with the concern of the structure when exposed to various loading conditions. On other note, it is beneficial to recognize that there is significant numbers in research related to the discrimination of the effects of operational loading and environmental conditions in the field of SHM [1]–[6]. This study, however, aims to provide a finding from the effects of fuel tank loading changes on damage detection. It provides statistical models (based on PCA and KPCA algorithms) and machine learning through ANN architecture as its primary solution to the damage detection of the aircraft wing structure. Nevertheless, this study aims to fill-in the gap in the research area of damage detection under the influence of operational loading changes produced inside the fuel tank of an aircraft wing

Development and Application of Chemometric Methods for Modelling Metabolic Spectral Profiles

The interpretation of metabolic information is crucial to understanding the functioning of a biological system. Latent information about the metabolic state of a sample can be acquired using analytical chemistry methods, which generate spectroscopic profiles. Thus, nuclear magnetic resonance spectroscopy and mass spectrometry techniques can be employed to generate vast amounts of highly complex data on the metabolic content of biofluids and tissue, and this thesis discusses ways to process, analyse and interpret these data successfully. The evaluation of J -resolved spectroscopy in magnetic resonance profiling and the statistical techniques required to extract maximum information from the projections of these spectra are studied. In particular, data processing is evaluated, and correlation and regression methods are investigated with respect to enhanced model interpretation and biomarker identification. Additionally, it is shown that non-linearities in metabonomic data can be effectively modelled with kernel-based orthogonal partial least squares, for which an automated optimisation of the kernel parameter with nested cross-validation is implemented. The interpretation of orthogonal variation and predictive ability enabled by this approach are demonstrated in regression and classification models for applications in toxicology and parasitology. Finally, the vast amount of data generated with mass spectrometry imaging is investigated in terms of data processing, and the benefits of applying multivariate techniques to these data are illustrated, especially in terms of interpretation and visualisation using colour-coding of images. The advantages of methods such as principal component analysis, self-organising maps and manifold learning over univariate analysis are highlighted. This body of work therefore demonstrates new means of increasing the amount of biochemical information that can be obtained from a given set of samples in biological applications using spectral profiling. Various analytical and statistical methods are investigated and illustrated with applications drawn from diverse biomedical areas