Automatic region-of-interest extraction in low depth-of-field images

PhD ThesisAutomatic extraction of focused regions from images with low depth-of-field (DOF) is a problem without an efficient solution yet. The capability of extracting focused regions can help to bridge the semantic gap by integrating image regions which are meaningfully relevant and generally do not exhibit uniform visual characteristics. There exist two main difficulties for extracting focused regions from low DOF images using high-frequency based techniques: computational complexity and performance. A novel unsupervised segmentation approach based on ensemble clustering is proposed to extract the focused regions from low DOF images in two stages. The first stage is to cluster image blocks in a joint contrast-energy feature space into three constituent groups. To achieve this, we make use of a normal mixture-based model along with standard expectation-maximization (EM) algorithm at two consecutive levels of block size. To avoid the common problem of local optima experienced in many models, an ensemble EM clustering algorithm is proposed. As a result, relevant blocks, i.e., block-based region-of-interest (ROI), closely conforming to image objects are extracted. In stage two, two different approaches have been developed to extract pixel-based ROI. In the first approach, a binary saliency map is constructed from the relevant blocks at the pixel level, which is based on difference of Gaussian (DOG) and binarization methods. Then, a set of morphological operations is employed to create the pixel-based ROI from the map. Experimental results demonstrate that the proposed approach achieves an average segmentation performance of 91.3% and is computationally 3 times faster than the best existing approach. In the second approach, a minimal graph cut is constructed by using the max-flow method and also by using object/background seeds provided by the ensemble clustering algorithm. Experimental results demonstrate an average segmentation performance of 91.7% and approximately 50% reduction of the average computational time by the proposed colour based approach compared with existing unsupervised approaches

Corrosion Behaviour of Additively Manufactured High Entropy Alloys

Additive manufacturing (AM) is a modern manufacturing technique that facilitates the production of components layer by layer from CAD files, with more recent developments in the field leading to the ability to create these components from metal. Laser powder bed fusion (LPBF) is one of the many techniques used to manufacture metallic components and has drawn significant attention for its ability to create parts with high degrees of complexity, exceptional strength-to-weight ratios and internal structures. However, parts produced by AM are documented to suffer from build defects such as porosity, which can negatively affect not only its mechanical properties but its corrosion resistance,particularly its resistance to pitting corrosion. Whilst the mechanical properties of components produced through metal AM have been well documented since the technology’s inception, there are significant knowledge gaps in understanding the corrosion behaviour of metals produced in this way.This thesis aims to expand upon the current understanding of this manufacturing method with a particular focus on its corrosion resistance. High Entropy Alloys (HEAs) are a class of advanced materials that differ from conventional alloys in composition. Traditional alloys usually consist of one or two principal elements with smaller amounts of additional elements to impart specific properties. In contrast, HEAs are characterised by the presence of multiple principal elements in roughly equal proportions. HEAs' complex and disordered structure can result in unique mechanical, thermal, and magnetic properties. HEAs have shown promise in exhibiting high strength, hardness, and corrosion resistance, making them attractive for various engineering applications. Studies of HEAs have been increasing over recent years; however, significant knowledge gaps are still associated with this classification of materials, especially concerning their corrosion resistance. This lack of knowledge is intensified when discussing the properties of these alloys when manufactured by AM methods.LPBF was used to produce parts in 316L with process induced porosity by manipulating the process parameters to investigate the effect density has on the corrosion resistance of AM parts. The corrosion resistance of these parts were compared to their wrought counterpart using potentiodynamic polarisation. It was observed that increasing the porosity in the AM parts resulted in poorer corrosion resistance, both by weaker performance across key metrics and a greater degree of unreliability. It was also found that the AM parts proved to have a greater corrosion resistance than the wrought material. However, the decreased consistency in this resistance is often cited as a barrier these components must overcome to supplace conventionally manufactured components.316L was also produced through induction casting as well as a schedule more representative of industry that consisted of a solution anneal at 1080 °C followed by water quenching followed by a cold rolling reduction by 70 %, and a final anneal at 900 °C. The microstructures and corrosion resistance of these were investigated using SEM-EDS, XRD and potentiodynamic polarisation, and whilst the corrosion resistance of the cold rolled sample had increased, it was less than expected due to the formation of detrimental chromium carbides.A Swansea University developed AlCrFeMnNi HEA was put through the same 3 manufacturing processes to investigate their effect on the microstructure and corrosion resistance. It was found that, unlike 316L, the HEA suffered less from pitting corrosion and more from a generalised corrosion attack. Very similar corrosion results were seen across the manufacturing methods; however, the cast sample was observed to have the most consistent display of corrosion resistance.Based on the pitting resistance equivalent number, which relates the amount of Cr and Mo by wt.% in a stainless steel to its corrosion resistance, it was theorised that the addition of Mo to this HEA could also increase its corrosion resistance. The results were inconclusive; however, better corrosion resistance was seen in the AM sample of the HEA with the addition than in the AM sample without

Robust Modular Feature-Based Terrain-Aided Visual Navigation and Mapping

The visual feature-based Terrain-Aided Navigation (TAN) system presented in this thesis addresses the problem of constraining inertial drift introduced into the location estimate of Unmanned Aerial Vehicles (UAVs) in GPS-denied environment. The presented TAN system utilises salient visual features representing semantic or human-interpretable objects (roads, forest and water boundaries) from onboard aerial imagery and associates them to a database of reference features created a-priori, through application of the same feature detection algorithms to satellite imagery. Correlation of the detected features with the reference features via a series of the robust data association steps allows a localisation solution to be achieved with a finite absolute bound precision defined by the certainty of the reference dataset. The feature-based Visual Navigation System (VNS) presented in this thesis was originally developed for a navigation application using simulated multi-year satellite image datasets. The extension of the system application into the mapping domain, in turn, has been based on the real (not simulated) flight data and imagery. In the mapping study the full potential of the system, being a versatile tool for enhancing the accuracy of the information derived from the aerial imagery has been demonstrated. Not only have the visual features, such as road networks, shorelines and water bodies, been used to obtain a position ’fix’, they have also been used in reverse for accurate mapping of vehicles detected on the roads into an inertial space with improved precision. Combined correction of the geo-coding errors and improved aircraft localisation formed a robust solution to the defense mapping application. A system of the proposed design will provide a complete independent navigation solution to an autonomous UAV and additionally give it object tracking capability

Multi-Modal Learning For Adaptive Scene Understanding

Modern robotics systems typically possess sensors of different modalities. Segmenting scenes observed by the robot into a discrete set of classes is a central requirement for autonomy. Equally, when a robot navigates through an unknown environment, it is often necessary to adjust the parameters of the scene segmentation model to maintain the same level of accuracy in changing situations. This thesis explores efficient means of adaptive semantic scene segmentation in an online setting with the use of multiple sensor modalities. First, we devise a novel conditional random field(CRF) inference method for scene segmentation that incorporates global constraints, enforcing particular sets of nodes to be assigned the same class label. To do this efficiently, the CRF is formulated as a relaxed quadratic program whose maximum a posteriori(MAP) solution is found using a gradient-based optimization approach. These global constraints are useful, since they can encode "a priori" information about the final labeling. This new formulation also reduces the dimensionality of the original image-labeling problem. The proposed model is employed in an urban street scene understanding task. Camera data is used for the CRF based semantic segmentation while global constraints are derived from 3D laser point clouds. Second, an approach to learn CRF parameters without the need for manually labeled training data is proposed. The model parameters are estimated by optimizing a novel loss function using self supervised reference labels, obtained based on the information from camera and laser with minimum amount of human supervision. Third, an approach that can conduct the parameter optimization while increasing the model robustness to non-stationary data distributions in the long trajectories is proposed. We adopted stochastic gradient descent to achieve this goal by using a learning rate that can appropriately grow or diminish to gain adaptability to changes in the data distribution

A discrete graph Laplacian for signal processing

In this thesis we exploit diffusion processes on graphs to effect two fundamental problems of image processing: denoising and segmentation. We treat these two low-level vision problems on the pixel-wise level under a unified framework: a graph embedding. Using this framework opens us up to the possibilities of exploiting recently introduced algorithms from the semi-supervised machine learning literature. We contribute two novel edge-preserving smoothing algorithms to the literature. Furthermore we apply these edge-preserving smoothing algorithms to some computational photography tasks. Many recent computational photography tasks require the decomposition of an image into a smooth base layer containing large scale intensity variations and a residual layer capturing fine details. Edge-preserving smoothing is the main computational mechanism in producing these multi-scale image representations. We, in effect, introduce a new approach to edge-preserving multi-scale image decompositions. Where as prior approaches such as the Bilateral filter and weighted-least squares methods require multiple parameters to tune the response of the filters our method only requires one. This parameter can be interpreted as a scale parameter. We demonstrate the utility of our approach by applying the method to computational photography tasks that utilise multi-scale image decompositions. With minimal modification to these edge-preserving smoothing algorithms we show that we can extend them to produce interactive image segmentation. As a result the operations of segmentation and denoising are conducted under a unified framework. Moreover we discuss how our method is related to region based active contours. We benchmark our proposed interactive segmentation algorithms against those based upon energy-minimisation, specifically graph-cut methods. We demonstrate that we achieve competitive performance

Optimisation of welding parameters to mitigate the effect of residual stress on the fatigue life of nozzle–shell welded joints in cylindrical pressure vessels.

Doctoral Degree. University of KwaZulu-Natal, Durban.The process of welding steel structures inadvertently causes residual stress as a result of thermal cycles that the material is subjected to. These welding-induced residual stresses have been shown to be responsible for a number of catastrophic failures in critical infrastructure installations such as pressure vessels, ship’s hulls, steel roof structures, and others. The present study examines the relationship between welding input parameters and the resultant residual stress, fatigue properties, weld bead geometry and mechanical properties of welded carbon steel pressure vessels. The study focuses on circumferential nozzle-to-shell welds, which have not been studied to this extent until now. A hybrid methodology including experimentation, numerical analysis, and mathematical modelling is employed to map out the relationship between welding input parameters and the output weld characteristics in order to further optimize the input parameters to produce an optimal welded joint whose stress and fatigue characteristics enhance service life of the welded structure. The results of a series of experiments performed show that the mechanical properties such as hardness are significantly affected by the welding process parameters and thereby affect the service life of a welded pressure vessel. The weld geometry is also affected by the input parameters of the welding process such that bead width and bead depth will vary depending on the parametric combination of input variables. The fatigue properties of a welded pressure vessel structure are affected by the residual stress conditions of the structure. The fractional factorial design technique shows that the welding current (I) and voltage (V) are statistically significant controlling parameters in the welding process. The results of the neutron diffraction (ND) tests reveal that there is a high concentration of residual stresses close to the weld centre-line. These stresses subside with increasing distance from the centre-line. The resultant hoop residual stress distribution shows that the hoop stresses are highly tensile close to the weld centre-line, decrease in magnitude as the distance from the weld centre-line increases, then decrease back to zero before changing direction to compressive further away from the weld centre-line. The hoop stress distribution profile on the flange side is similar to that of the pipe side around the circumferential weld, and the residual stress peak values are equal to or higher than the yield strength of the filler material. The weld specimens failed at the weld toe where the hoop stress was generally highly tensile in most of the welded specimens. The multiobjective genetic algorithm is successfully used to produce a set of optimal solutions that are in agreement with values obtained during experiments. The 3D finite element model produced using MSC Marc software is generally comparable to physical experimentation. The results obtained in the present study are in agreement with similar studies reported in the literature